2021-07-26T15:35:47.600 INFO:root:teuthology version: 1.1.0-b6f3efab 2021-07-26T15:35:47.602 DEBUG:teuthology.run:Teuthology command: teuthology --name sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi --archive /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293853 --owner scheduled_sage@teuthology --description upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} --verbose -- /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293853/orig.config.yaml 2021-07-26T15:35:47.649 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-07-26T15:35:47.704 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293853 branch: wip-kefu-testing-2021-07-24-1158 description: upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary} email: null first_in_suite: false job_id: '6293853' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi nuke-on-error: true overrides: admin_socket: branch: wip-kefu-testing-2021-07-24-1158 ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= rgw curl low speed time: 300 rgw data log num shards: 4 rgw md log max shards: 4 rgw sync log trim interval: 0 rgw sync obj etag verify: true setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon_warn_on_insecure_global_id_reclaim: false mon_warn_on_insecure_global_id_reclaim_allowed: false osd: debug ms: 1 debug osd: 20 log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e wait-for-scrub: false ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: branch: octopus sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e rgw: compression type: random frontend: beast rgw-multisite: realm: is default: true name: test-realm zonegroups: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zonegroup zones: - endpoints: - c1.client.0 is_default: true is_master: true name: test-zone1 - endpoints: - c2.client.0 is_default: true name: test-zone2 - endpoints: - c2.client.1 is_pubsub: true name: test-zone3 rgw-multisite-tests: args: - tests.py - tests_ps.py branch: octopus repo: https://github.com/ceph/ceph.git workunit: branch: wip-kefu-testing-2021-07-24-1158 sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e owner: scheduled_sage@teuthology priority: 90 repo: git://git.ceph.com/ceph-ci.git roles: - - c1.mon.a - c1.mgr.x - c1.osd.0 - c1.osd.1 - c1.osd.2 - c1.client.0 - - c2.mon.a - c2.mgr.x - c2.osd.0 - c2.osd.1 - c2.osd.2 - c2.client.0 - c2.client.1 sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e sleep_before_teardown: 0 suite: upgrade suite_branch: wip-kefu-testing-2021-07-24-1158 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e targets: smithi067.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW3/rIpnOb9l3Yyz6bZXXGq1w/Y4PLohUySyGWDeKu1qrSzsuJNZ8lcm4lqk1yZDEaHdhaIf/W2Csod3HvbpL2xt++asgvrveXs8xmPXU30cNzz7Ids1Nus48OLAnW1I4MMS5/SspyIc4brszUtEls3B60X4DhTztrpjPerQU4yguQtWjqngsp5LI69t0CmhMV5zYQCOSExMC3FofevQtEhJQjJ2dPKVOAcKIOLicpaLuBkfIJw1cX5vZaODr7JS3P9jnaIG157WS8uSlRmWB1xD94DCVCsIpekDW/hEbt4M/eGaWyLnb+UfmyJ3/fiW/0Fywg+84sIO46kR54i4AY5UPMRaL989+Cdp0oudvgNeh7tvFDmRDtbaA7yD9rQ66Deor7izCJGDj8auWnhkKw/84b/5uWqqe2Is1IyqnrTU5wcrJXhwZBAIDaAti0sqVH57veJwk5AFRbZP6U6X8sn+AvY5xgp/i8HdTx1VFC5ekW5jn/BqOBnN+HwHD5EfM= smithi087.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBBTcZju7nXW6kP1AOdUkhnSc9lqjBY4+lA70AbJvVQldB2S3HLwBdcibDZc6sVdIEiNpvMehyRlbh0NGoIdwaKkL/peCQMFz0C16TJL4tkiGsmpyrAgxTUxuJIbRdPTEnHVUt2hPPOiHB9KIAOBFGm02PcvNFdmpbfSE7tPq8EF3wFhStHL+AULdQBUM5shVCU2IU1DdqbJ1U3+mP/oUkISexe2R34UiAvb/aiKik/6GgD26lL4lak/2zgePRGcLYnBIQIAFO9XQ2KEqzAdOFDFhxob9FygzvWTCB3x0oET7Ab47sm4kzyNsQDEQJifpYylC9rHXuPEOntyS56KczfWvXzM94dWVHYTRrTT/auwIzuk9cdLlCbWqntVW6upa57Tw5uOXxGgp4bQ+g8vVidDwyBagbPWh2Rq4qqpOotM3BIkuIfuZnlfDelnJ8OJoXKytETZZcvxausAC9hdQ3eBQNnJ+bGjRlNBJzqe1ftROaD8mamoBcR9pN4aq3OnU= tasks: - install: null - ceph: cluster: c1 - ceph: cluster: c2 - parallel: - upgrade-task - rgw: c1.client.0: port: 8000 c2.client.0: port: 8000 c2.client.1: port: 8001 - rgw-multisite: null - rgw-multisite-tests: config: reconfigure_delay: 60 teuthology_branch: master teuthology_sha1: b6f3efab84b70e18e86ec271a07564aeb4ed3bac timestamp: 2021-07-26_15:05:01 tube: smithi upgrade-task: - install.upgrade: c2.client.0: null c2.client.1: null c2.mgr.x: null c2.mon.a: null c2.osd.0: null c2.osd.1: null c2.osd.2: null user: sage verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.30581 2021-07-26T15:35:47.705 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa; will attempt to use it 2021-07-26T15:35:47.705 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa/tasks 2021-07-26T15:35:47.706 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-07-26T15:35:47.715 INFO:teuthology.task.internal:Checking packages... 2021-07-26T15:35:47.716 INFO:teuthology.task.internal:Checking packages skipped, missing os_type 'None' or ceph hash 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e' 2021-07-26T15:35:47.716 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-07-26T15:35:47.726 INFO:teuthology.task.internal:no buildpackages task found 2021-07-26T15:35:47.727 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-07-26T15:35:47.760 INFO:teuthology.task.internal:Saving configuration 2021-07-26T15:35:47.774 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-07-26T15:35:47.791 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-07-26T15:35:47.808 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-07-26 15:30:15.345751', 'description': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293853', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOYcVImuMFre2WwdIkZ/sJ0PlMNZBqkEkoToxyfp38ws', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi067.front.sepia.ceph.com'} 2021-07-26T15:35:47.825 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-07-26 15:30:15.345729', 'description': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293853', 'locked_by': 'scheduled_sage@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINXQA7vRxrCO17pxeIt07oLVqQL8FUOp2sfASPsF5ZsA', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi087.front.sepia.ceph.com'} 2021-07-26T15:35:47.827 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-07-26T15:35:47.836 INFO:teuthology.task.internal:roles: ubuntu@smithi067.front.sepia.ceph.com - ['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'] 2021-07-26T15:35:47.837 INFO:teuthology.task.internal:roles: ubuntu@smithi087.front.sepia.ceph.com - ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1'] 2021-07-26T15:35:47.837 INFO:teuthology.run_tasks:Running task console_log... 2021-07-26T15:35:47.918 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f13940e0f28>, signals=[15]) 2021-07-26T15:35:47.920 INFO:teuthology.run_tasks:Running task internal.connect... 2021-07-26T15:35:47.928 INFO:teuthology.task.internal:Opening connections... 2021-07-26T15:35:47.929 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi067.front.sepia.ceph.com 2021-07-26T15:35:47.930 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:35:47.989 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi087.front.sepia.ceph.com 2021-07-26T15:35:47.991 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:35:48.043 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-07-26T15:35:48.052 DEBUG:teuthology.orchestra.run.smithi067:> uname -m 2021-07-26T15:35:48.070 INFO:teuthology.orchestra.run.smithi067.stdout:x86_64 2021-07-26T15:35:48.070 DEBUG:teuthology.orchestra.run.smithi067:> cat /etc/os-release 2021-07-26T15:35:48.120 INFO:teuthology.orchestra.run.smithi067.stdout:NAME="Ubuntu" 2021-07-26T15:35:48.120 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-07-26T15:35:48.121 INFO:teuthology.orchestra.run.smithi067.stdout:ID=ubuntu 2021-07-26T15:35:48.121 INFO:teuthology.orchestra.run.smithi067.stdout:ID_LIKE=debian 2021-07-26T15:35:48.121 INFO:teuthology.orchestra.run.smithi067.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-07-26T15:35:48.122 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_ID="20.04" 2021-07-26T15:35:48.122 INFO:teuthology.orchestra.run.smithi067.stdout:HOME_URL="https://www.ubuntu.com/" 2021-07-26T15:35:48.122 INFO:teuthology.orchestra.run.smithi067.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-07-26T15:35:48.122 INFO:teuthology.orchestra.run.smithi067.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-07-26T15:35:48.122 INFO:teuthology.orchestra.run.smithi067.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-07-26T15:35:48.123 INFO:teuthology.orchestra.run.smithi067.stdout:VERSION_CODENAME=focal 2021-07-26T15:35:48.123 INFO:teuthology.orchestra.run.smithi067.stdout:UBUNTU_CODENAME=focal 2021-07-26T15:35:48.124 INFO:teuthology.lock.ops:Updating smithi067.front.sepia.ceph.com on lock server 2021-07-26T15:35:48.141 DEBUG:teuthology.orchestra.run.smithi087:> uname -m 2021-07-26T15:35:48.149 INFO:teuthology.orchestra.run.smithi087.stdout:x86_64 2021-07-26T15:35:48.149 DEBUG:teuthology.orchestra.run.smithi087:> cat /etc/os-release 2021-07-26T15:35:48.156 INFO:teuthology.orchestra.run.smithi087.stdout:NAME="Ubuntu" 2021-07-26T15:35:48.157 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION="20.04.2 LTS (Focal Fossa)" 2021-07-26T15:35:48.157 INFO:teuthology.orchestra.run.smithi087.stdout:ID=ubuntu 2021-07-26T15:35:48.157 INFO:teuthology.orchestra.run.smithi087.stdout:ID_LIKE=debian 2021-07-26T15:35:48.157 INFO:teuthology.orchestra.run.smithi087.stdout:PRETTY_NAME="Ubuntu 20.04.2 LTS" 2021-07-26T15:35:48.158 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_ID="20.04" 2021-07-26T15:35:48.158 INFO:teuthology.orchestra.run.smithi087.stdout:HOME_URL="https://www.ubuntu.com/" 2021-07-26T15:35:48.158 INFO:teuthology.orchestra.run.smithi087.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-07-26T15:35:48.158 INFO:teuthology.orchestra.run.smithi087.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-07-26T15:35:48.159 INFO:teuthology.orchestra.run.smithi087.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-07-26T15:35:48.159 INFO:teuthology.orchestra.run.smithi087.stdout:VERSION_CODENAME=focal 2021-07-26T15:35:48.159 INFO:teuthology.orchestra.run.smithi087.stdout:UBUNTU_CODENAME=focal 2021-07-26T15:35:48.159 INFO:teuthology.lock.ops:Updating smithi087.front.sepia.ceph.com on lock server 2021-07-26T15:35:48.175 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-07-26T15:35:48.188 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-07-26T15:35:48.206 INFO:teuthology.task.internal:Checking for old test directory... 2021-07-26T15:35:48.207 DEBUG:teuthology.orchestra.run.smithi067:> test '!' -e /home/ubuntu/cephtest 2021-07-26T15:35:48.210 DEBUG:teuthology.orchestra.run.smithi087:> test '!' -e /home/ubuntu/cephtest 2021-07-26T15:35:48.217 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-07-26T15:35:48.232 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-07-26T15:35:48.235 DEBUG:teuthology.orchestra.run.smithi067:> test -z $(ls -A /var/lib/ceph) 2021-07-26T15:35:48.237 DEBUG:teuthology.orchestra.run.smithi087:> test -z $(ls -A /var/lib/ceph) 2021-07-26T15:35:48.246 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-07-26T15:35:48.293 INFO:teuthology.run_tasks:Running task kernel... 2021-07-26T15:35:48.320 DEBUG:teuthology.task.kernel:normalized config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c1.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c1.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c1.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mgr.x': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.0': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.1': {'kdb': True, 'sha1': 'distro'}, 'c2.osd.2': {'kdb': True, 'sha1': 'distro'}, 'c2.client.0': {'kdb': True, 'sha1': 'distro'}, 'c2.client.1': {'kdb': True, 'sha1': 'distro'}} 2021-07-26T15:35:48.321 INFO:teuthology.task.kernel:config {'c1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'c2.mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-07-26T15:35:48.321 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2021-07-26T15:35:48.328 INFO:teuthology.orchestra.run.smithi067.stdout:5.4.0-66-generic 2021-07-26T15:35:48.329 INFO:teuthology.task.kernel:Running kernel on smithi067: 5.4.0-66-generic 2021-07-26T15:35:48.329 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get clean 2021-07-26T15:35:48.408 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2021-07-26T15:35:48.559 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:35:48.678 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:35:48.759 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-07-26T15:35:48.855 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:35:48.938 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:35:48.943 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [155 kB] 2021-07-26T15:35:48.946 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,304 B] 2021-07-26T15:35:48.946 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [327 kB] 2021-07-26T15:35:48.952 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [16.5 kB] 2021-07-26T15:35:48.953 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.4 kB] 2021-07-26T15:35:48.954 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:35:48.954 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:35:48.961 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:35:48.968 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [97.5 kB] 2021-07-26T15:35:48.970 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.9 kB] 2021-07-26T15:35:48.990 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [25.4 kB] 2021-07-26T15:35:48.990 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,912 B] 2021-07-26T15:35:48.990 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,952 B] 2021-07-26T15:35:48.990 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [600 B] 2021-07-26T15:35:49.101 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:35:49.236 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,126 kB] 2021-07-26T15:35:49.553 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [511 kB] 2021-07-26T15:35:49.583 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [245 kB] 2021-07-26T15:35:49.597 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.8 kB] 2021-07-26T15:35:49.598 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.2 kB] 2021-07-26T15:35:49.599 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [367 kB] 2021-07-26T15:35:49.621 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [52.9 kB] 2021-07-26T15:35:49.624 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:35:49.624 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [626 kB] 2021-07-26T15:35:49.670 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [843 kB] 2021-07-26T15:35:49.711 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [176 kB] 2021-07-26T15:35:49.717 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [18.4 kB] 2021-07-26T15:35:49.718 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [23.6 kB] 2021-07-26T15:35:49.719 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [7,472 B] 2021-07-26T15:35:49.719 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,472 B] 2021-07-26T15:35:49.750 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [676 B] 2021-07-26T15:35:49.750 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [2,568 B] 2021-07-26T15:35:49.750 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [2,568 B] 2021-07-26T15:35:49.809 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [1,120 B] 2021-07-26T15:35:49.809 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [400 B] 2021-07-26T15:35:49.810 INFO:teuthology.orchestra.run.smithi067.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [4,724 B] 2021-07-26T15:35:49.810 INFO:teuthology.orchestra.run.smithi067.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [5,792 B] 2021-07-26T15:35:49.832 INFO:teuthology.orchestra.run.smithi067.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [2,060 B] 2021-07-26T15:35:49.833 INFO:teuthology.orchestra.run.smithi067.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [288 B] 2021-07-26T15:35:52.920 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 7,282 kB in 1s (5,028 kB/s) 2021-07-26T15:35:54.028 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2021-07-26T15:35:54.054 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:35:54.120 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2021-07-26T15:35:54.284 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2021-07-26T15:35:54.285 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2021-07-26T15:35:54.367 INFO:teuthology.orchestra.run.smithi067.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:35:54.368 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:35:54.369 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:35:54.437 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2021-07-26T15:35:54.598 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2021-07-26T15:35:54.599 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2021-07-26T15:35:54.745 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2021-07-26T15:35:54.746 INFO:teuthology.orchestra.run.smithi067.stdout: linux-generic linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:35:54.746 INFO:teuthology.orchestra.run.smithi067.stdout: linux-headers-generic linux-image-5.4.0-80-generic 2021-07-26T15:35:54.746 INFO:teuthology.orchestra.run.smithi067.stdout: linux-modules-5.4.0-80-generic linux-modules-extra-5.4.0-80-generic 2021-07-26T15:35:54.747 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2021-07-26T15:35:54.747 INFO:teuthology.orchestra.run.smithi067.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-07-26T15:35:54.747 INFO:teuthology.orchestra.run.smithi067.stdout:Recommended packages: 2021-07-26T15:35:54.748 INFO:teuthology.orchestra.run.smithi067.stdout: thermald 2021-07-26T15:35:54.776 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2021-07-26T15:35:54.777 INFO:teuthology.orchestra.run.smithi067.stdout: linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:35:54.777 INFO:teuthology.orchestra.run.smithi067.stdout: linux-image-5.4.0-80-generic linux-modules-5.4.0-80-generic 2021-07-26T15:35:54.777 INFO:teuthology.orchestra.run.smithi067.stdout: linux-modules-extra-5.4.0-80-generic 2021-07-26T15:35:54.778 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages will be upgraded: 2021-07-26T15:35:54.778 INFO:teuthology.orchestra.run.smithi067.stdout: linux-generic linux-headers-generic linux-image-generic 2021-07-26T15:35:54.957 INFO:teuthology.orchestra.run.smithi067.stdout:3 upgraded, 5 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:35:54.957 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 75.6 MB of archives. 2021-07-26T15:35:54.957 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 377 MB of additional disk space will be used. 2021-07-26T15:35:54.957 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-80-generic amd64 5.4.0-80.90 [14.8 MB] 2021-07-26T15:35:56.058 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-80-generic amd64 5.4.0-80.90 [8,976 kB] 2021-07-26T15:35:56.319 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-80-generic amd64 5.4.0-80.90 [39.4 MB] 2021-07-26T15:35:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.80.84 [1,900 B] 2021-07-26T15:35:57.599 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.80.84 [2,568 B] 2021-07-26T15:35:57.600 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80 all 5.4.0-80.90 [11.0 MB] 2021-07-26T15:35:57.892 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80-generic amd64 5.4.0-80.90 [1,410 kB] 2021-07-26T15:35:57.949 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.80.84 [2,436 B] 2021-07-26T15:35:58.356 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 75.6 MB in 3s (23.9 MB/s) 2021-07-26T15:35:58.566 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-modules-5.4.0-80-generic. 2021-07-26T15:35:59.949 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-07-26T15:35:59.955 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../0-linux-modules-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:36:00.046 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:02.025 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-image-5.4.0-80-generic. 2021-07-26T15:36:02.038 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../1-linux-image-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:36:02.140 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:03.164 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-80-generic. 2021-07-26T15:36:03.175 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:36:03.209 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:08.161 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../3-linux-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:36:08.278 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:36:08.624 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:36:08.782 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-image-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:36:09.108 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-headers-5.4.0-80. 2021-07-26T15:36:09.127 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../5-linux-headers-5.4.0-80_5.4.0-80.90_all.deb ... 2021-07-26T15:36:09.162 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:36:15.291 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package linux-headers-5.4.0-80-generic. 2021-07-26T15:36:15.312 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../6-linux-headers-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:36:15.373 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:18.986 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:36:19.123 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking linux-headers-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:36:19.467 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:20.703 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:36:20.829 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:21.993 INFO:teuthology.orchestra.run.smithi067.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:36:21.993 INFO:teuthology.orchestra.run.smithi067.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-80-generic 2021-07-26T15:36:22.139 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:22.282 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:23.484 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-image-generic (5.4.0.80.84) ... 2021-07-26T15:36:23.585 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-headers-generic (5.4.0.80.84) ... 2021-07-26T15:36:23.694 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up linux-generic (5.4.0.80.84) ... 2021-07-26T15:36:23.846 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:36:24.016 INFO:teuthology.orchestra.run.smithi067.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-07-26T15:36:24.016 INFO:teuthology.orchestra.run.smithi067.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:36:45.994 INFO:teuthology.orchestra.run.smithi067.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-07-26T15:36:45.995 INFO:teuthology.orchestra.run.smithi067.stdout:Sourcing file `/etc/default/grub' 2021-07-26T15:36:46.011 INFO:teuthology.orchestra.run.smithi067.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:36:46.027 INFO:teuthology.orchestra.run.smithi067.stdout:Generating grub configuration file ... 2021-07-26T15:36:46.361 INFO:teuthology.orchestra.run.smithi067.stdout:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:36:46.384 INFO:teuthology.orchestra.run.smithi067.stdout:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:36:46.734 INFO:teuthology.orchestra.run.smithi067.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:36:46.745 INFO:teuthology.orchestra.run.smithi067.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:36:48.737 INFO:teuthology.orchestra.run.smithi067.stdout:done 2021-07-26T15:36:49.082 DEBUG:teuthology.orchestra.run.smithi067:> dpkg -s linux-image-generic 2021-07-26T15:36:49.113 INFO:teuthology.orchestra.run.smithi067.stdout:Package: linux-image-generic 2021-07-26T15:36:49.191 INFO:teuthology.orchestra.run.smithi067.stdout:Status: install ok installed 2021-07-26T15:36:49.191 INFO:teuthology.orchestra.run.smithi067.stdout:Priority: optional 2021-07-26T15:36:49.192 INFO:teuthology.orchestra.run.smithi067.stdout:Section: kernel 2021-07-26T15:36:49.192 INFO:teuthology.orchestra.run.smithi067.stdout:Installed-Size: 18 2021-07-26T15:36:49.192 INFO:teuthology.orchestra.run.smithi067.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:36:49.192 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: amd64 2021-07-26T15:36:49.193 INFO:teuthology.orchestra.run.smithi067.stdout:Source: linux-meta 2021-07-26T15:36:49.193 INFO:teuthology.orchestra.run.smithi067.stdout:Version: 5.4.0.80.84 2021-07-26T15:36:49.194 INFO:teuthology.orchestra.run.smithi067.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:36:49.194 INFO:teuthology.orchestra.run.smithi067.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:36:49.194 INFO:teuthology.orchestra.run.smithi067.stdout:Recommends: thermald 2021-07-26T15:36:49.194 INFO:teuthology.orchestra.run.smithi067.stdout:Description: Generic Linux kernel image 2021-07-26T15:36:49.195 INFO:teuthology.orchestra.run.smithi067.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:36:49.195 INFO:teuthology.orchestra.run.smithi067.stdout: available. 2021-07-26T15:36:49.195 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-80-generic 2021-07-26T15:36:49.196 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2021-07-26T15:36:49.204 INFO:teuthology.orchestra.run.smithi087.stdout:5.4.0-66-generic 2021-07-26T15:36:49.205 INFO:teuthology.task.kernel:Running kernel on smithi087: 5.4.0-66-generic 2021-07-26T15:36:49.205 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2021-07-26T15:36:49.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2021-07-26T15:36:49.493 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:36:49.608 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:36:49.690 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-07-26T15:36:49.786 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:36:49.867 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:36:49.873 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [155 kB] 2021-07-26T15:36:49.875 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [8,304 B] 2021-07-26T15:36:49.876 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [17.9 kB] 2021-07-26T15:36:49.876 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [331 kB] 2021-07-26T15:36:49.880 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.6 kB] 2021-07-26T15:36:49.889 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:36:49.889 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:36:49.890 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:36:49.896 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [97.5 kB] 2021-07-26T15:36:49.897 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [11.9 kB] 2021-07-26T15:36:49.909 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.6 kB] 2021-07-26T15:36:49.910 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [6,464 B] 2021-07-26T15:36:49.911 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,648 B] 2021-07-26T15:36:49.911 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [600 B] 2021-07-26T15:36:50.034 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-07-26T15:36:50.164 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [1,126 kB] 2021-07-26T15:36:50.495 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [511 kB] 2021-07-26T15:36:50.510 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [245 kB] 2021-07-26T15:36:50.517 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [13.8 kB] 2021-07-26T15:36:50.519 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [367 kB] 2021-07-26T15:36:50.530 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [19.2 kB] 2021-07-26T15:36:50.530 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [52.9 kB] 2021-07-26T15:36:50.532 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [428 B] 2021-07-26T15:36:50.532 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [843 kB] 2021-07-26T15:36:50.599 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [626 kB] 2021-07-26T15:36:50.620 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [176 kB] 2021-07-26T15:36:50.626 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [18.4 kB] 2021-07-26T15:36:50.626 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [23.6 kB] 2021-07-26T15:36:50.626 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [7,472 B] 2021-07-26T15:36:50.626 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [6,472 B] 2021-07-26T15:36:50.675 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [676 B] 2021-07-26T15:36:50.675 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [2,568 B] 2021-07-26T15:36:50.676 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [2,568 B] 2021-07-26T15:36:50.706 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main Translation-en [1,120 B] 2021-07-26T15:36:50.707 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [400 B] 2021-07-26T15:36:50.707 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [4,724 B] 2021-07-26T15:36:50.708 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [5,792 B] 2021-07-26T15:36:50.756 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal-backports/universe Translation-en [2,060 B] 2021-07-26T15:36:50.757 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [288 B] 2021-07-26T15:36:53.798 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 7,281 kB in 1s (5,037 kB/s) 2021-07-26T15:36:54.907 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-07-26T15:36:54.928 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:36:54.999 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-07-26T15:36:55.157 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-07-26T15:36:55.158 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-07-26T15:36:55.235 INFO:teuthology.orchestra.run.smithi087.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:36:55.237 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:36:55.238 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:36:55.307 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-07-26T15:36:55.465 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-07-26T15:36:55.466 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-07-26T15:36:55.601 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2021-07-26T15:36:55.603 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:36:55.603 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-generic linux-image-5.4.0-80-generic 2021-07-26T15:36:55.603 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-5.4.0-80-generic linux-modules-extra-5.4.0-80-generic 2021-07-26T15:36:55.604 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2021-07-26T15:36:55.604 INFO:teuthology.orchestra.run.smithi087.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-07-26T15:36:55.604 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2021-07-26T15:36:55.605 INFO:teuthology.orchestra.run.smithi087.stdout: thermald 2021-07-26T15:36:55.629 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2021-07-26T15:36:55.630 INFO:teuthology.orchestra.run.smithi087.stdout: linux-headers-5.4.0-80 linux-headers-5.4.0-80-generic 2021-07-26T15:36:55.630 INFO:teuthology.orchestra.run.smithi087.stdout: linux-image-5.4.0-80-generic linux-modules-5.4.0-80-generic 2021-07-26T15:36:55.630 INFO:teuthology.orchestra.run.smithi087.stdout: linux-modules-extra-5.4.0-80-generic 2021-07-26T15:36:55.631 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2021-07-26T15:36:55.631 INFO:teuthology.orchestra.run.smithi087.stdout: linux-generic linux-headers-generic linux-image-generic 2021-07-26T15:36:55.810 INFO:teuthology.orchestra.run.smithi087.stdout:3 upgraded, 5 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:36:55.810 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 75.6 MB of archives. 2021-07-26T15:36:55.810 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 377 MB of additional disk space will be used. 2021-07-26T15:36:55.811 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-80-generic amd64 5.4.0-80.90 [14.8 MB] 2021-07-26T15:36:56.925 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-80-generic amd64 5.4.0-80.90 [8,976 kB] 2021-07-26T15:36:57.141 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-80-generic amd64 5.4.0-80.90 [39.4 MB] 2021-07-26T15:36:58.452 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.80.84 [1,900 B] 2021-07-26T15:36:58.452 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.80.84 [2,568 B] 2021-07-26T15:36:58.452 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80 all 5.4.0-80.90 [11.0 MB] 2021-07-26T15:36:58.801 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-80-generic amd64 5.4.0-80.90 [1,410 kB] 2021-07-26T15:36:58.820 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.80.84 [2,436 B] 2021-07-26T15:36:59.215 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 75.6 MB in 3s (23.7 MB/s) 2021-07-26T15:36:59.380 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-5.4.0-80-generic. 2021-07-26T15:37:00.785 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 101691 files and directories currently installed.) 2021-07-26T15:37:00.790 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../0-linux-modules-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:37:00.876 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:02.941 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-image-5.4.0-80-generic. 2021-07-26T15:37:02.954 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../1-linux-image-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:37:03.058 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:04.223 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-80-generic. 2021-07-26T15:37:04.237 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:37:04.284 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:09.419 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../3-linux-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:37:09.573 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:37:09.907 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:37:10.017 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-image-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:37:10.363 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.4.0-80. 2021-07-26T15:37:10.376 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../5-linux-headers-5.4.0-80_5.4.0-80.90_all.deb ... 2021-07-26T15:37:10.415 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:37:16.464 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package linux-headers-5.4.0-80-generic. 2021-07-26T15:37:16.486 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../6-linux-headers-5.4.0-80-generic_5.4.0-80.90_amd64.deb ... 2021-07-26T15:37:16.530 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:19.118 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.80.84_amd64.deb ... 2021-07-26T15:37:19.256 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking linux-headers-generic (5.4.0.80.84) over (5.4.0.66.69) ... 2021-07-26T15:37:19.571 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:20.753 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.4.0-80 (5.4.0-80.90) ... 2021-07-26T15:37:20.879 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:22.002 INFO:teuthology.orchestra.run.smithi087.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:37:22.002 INFO:teuthology.orchestra.run.smithi087.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-80-generic 2021-07-26T15:37:22.157 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:22.283 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-modules-extra-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:23.475 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-image-generic (5.4.0.80.84) ... 2021-07-26T15:37:23.585 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-headers-generic (5.4.0.80.84) ... 2021-07-26T15:37:23.702 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up linux-generic (5.4.0.80.84) ... 2021-07-26T15:37:23.863 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for linux-image-5.4.0-80-generic (5.4.0-80.90) ... 2021-07-26T15:37:24.049 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-07-26T15:37:24.049 INFO:teuthology.orchestra.run.smithi087.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:37:46.085 INFO:teuthology.orchestra.run.smithi087.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-07-26T15:37:46.085 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub' 2021-07-26T15:37:46.090 INFO:teuthology.orchestra.run.smithi087.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:37:46.113 INFO:teuthology.orchestra.run.smithi087.stdout:Generating grub configuration file ... 2021-07-26T15:37:46.461 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:37:46.485 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:37:46.858 INFO:teuthology.orchestra.run.smithi087.stdout:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:37:46.868 INFO:teuthology.orchestra.run.smithi087.stdout:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:37:48.874 INFO:teuthology.orchestra.run.smithi087.stdout:done 2021-07-26T15:37:49.268 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2021-07-26T15:37:49.298 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2021-07-26T15:37:49.298 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2021-07-26T15:37:49.298 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2021-07-26T15:37:49.299 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2021-07-26T15:37:49.299 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 18 2021-07-26T15:37:49.299 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:37:49.299 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2021-07-26T15:37:49.300 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2021-07-26T15:37:49.300 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.4.0.80.84 2021-07-26T15:37:49.300 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:37:49.300 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:37:49.300 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2021-07-26T15:37:49.301 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2021-07-26T15:37:49.301 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:37:49.301 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2021-07-26T15:37:49.302 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-66-generic Expected: 5.4.0-80-generic 2021-07-26T15:37:49.303 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-07-26T15:37:49.303 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-07-26T15:37:49.304 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-07-26T15:37:49.305 INFO:teuthology.task.kernel:Installing distro kernel on c1.mon.a... 2021-07-26T15:37:49.305 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi067.front.sepia.ceph.com, path=None, version=distro) 2021-07-26T15:37:49.305 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get clean 2021-07-26T15:37:49.418 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2021-07-26T15:37:49.544 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2021-07-26T15:37:49.675 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:37:49.760 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:37:49.779 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [268 kB] 2021-07-26T15:37:49.837 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [789 kB] 2021-07-26T15:37:49.838 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-07-26T15:37:49.868 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [17.9 kB] 2021-07-26T15:37:49.869 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [331 kB] 2021-07-26T15:37:49.875 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [47.6 kB] 2021-07-26T15:37:49.876 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [505 kB] 2021-07-26T15:37:49.883 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [633 kB] 2021-07-26T15:37:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [21.6 kB] 2021-07-26T15:37:49.891 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [6,464 B] 2021-07-26T15:37:49.892 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [4,648 B] 2021-07-26T15:37:50.318 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 2,737 kB in 1s (4,084 kB/s) 2021-07-26T15:37:51.120 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2021-07-26T15:37:51.141 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:37:51.210 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2021-07-26T15:37:51.357 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2021-07-26T15:37:51.357 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2021-07-26T15:37:51.433 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:37:51.434 INFO:teuthology.orchestra.run.smithi067.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:37:51.435 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:37:51.506 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2021-07-26T15:37:51.652 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2021-07-26T15:37:51.653 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2021-07-26T15:37:51.800 INFO:teuthology.orchestra.run.smithi067.stdout:linux-image-generic is already the newest version (5.4.0.80.84). 2021-07-26T15:37:51.800 INFO:teuthology.orchestra.run.smithi067.stdout:0 upgraded, 0 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:37:51.802 DEBUG:teuthology.orchestra.run.smithi067:> dpkg -s linux-image-generic 2021-07-26T15:37:51.824 INFO:teuthology.orchestra.run.smithi067.stdout:Package: linux-image-generic 2021-07-26T15:37:51.825 INFO:teuthology.orchestra.run.smithi067.stdout:Status: install ok installed 2021-07-26T15:37:51.825 INFO:teuthology.orchestra.run.smithi067.stdout:Priority: optional 2021-07-26T15:37:51.825 INFO:teuthology.orchestra.run.smithi067.stdout:Section: kernel 2021-07-26T15:37:51.825 INFO:teuthology.orchestra.run.smithi067.stdout:Installed-Size: 18 2021-07-26T15:37:51.826 INFO:teuthology.orchestra.run.smithi067.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:37:51.826 INFO:teuthology.orchestra.run.smithi067.stdout:Architecture: amd64 2021-07-26T15:37:51.826 INFO:teuthology.orchestra.run.smithi067.stdout:Source: linux-meta 2021-07-26T15:37:51.827 INFO:teuthology.orchestra.run.smithi067.stdout:Version: 5.4.0.80.84 2021-07-26T15:37:51.827 INFO:teuthology.orchestra.run.smithi067.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:37:51.827 INFO:teuthology.orchestra.run.smithi067.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:37:51.827 INFO:teuthology.orchestra.run.smithi067.stdout:Recommends: thermald 2021-07-26T15:37:51.828 INFO:teuthology.orchestra.run.smithi067.stdout:Description: Generic Linux kernel image 2021-07-26T15:37:51.828 INFO:teuthology.orchestra.run.smithi067.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:37:51.828 INFO:teuthology.orchestra.run.smithi067.stdout: available. 2021-07-26T15:37:51.828 DEBUG:teuthology.orchestra.run.smithi067:> mktemp 2021-07-26T15:37:51.873 INFO:teuthology.orchestra.run.smithi067.stdout:/tmp/tmp.tXJgBti3zU 2021-07-26T15:37:51.873 DEBUG:teuthology.orchestra.run.smithi067:> sudo cp /boot/grub/grub.cfg /tmp/tmp.tXJgBti3zU 2021-07-26T15:37:51.887 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0666 /tmp/tmp.tXJgBti3zU 2021-07-26T15:37:51.964 DEBUG:teuthology.orchestra.remote:smithi067:/tmp/tmp.tXJgBti3zU is 8KB 2021-07-26T15:37:51.979 DEBUG:teuthology.orchestra.run.smithi067:> rm -fr /tmp/tmp.tXJgBti3zU 2021-07-26T15:37:51.986 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-07-26T15:37:52.044 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:37:52.044 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-07-26T15:37:52.045 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-07-26T15:37:52.095 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-80-generic 2021-07-26T15:37:52.095 DEBUG:teuthology.orchestra.run.smithi067:> sudo update-grub 2021-07-26T15:37:53.423 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub' 2021-07-26T15:37:53.425 INFO:teuthology.orchestra.run.smithi067.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:37:53.443 INFO:teuthology.orchestra.run.smithi067.stderr:Generating grub configuration file ... 2021-07-26T15:37:53.676 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:37:53.688 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:37:54.019 INFO:teuthology.orchestra.run.smithi067.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:37:54.031 INFO:teuthology.orchestra.run.smithi067.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:37:55.127 INFO:teuthology.orchestra.run.smithi067.stderr:done 2021-07-26T15:37:55.129 DEBUG:teuthology.orchestra.run.smithi067:> sudo shutdown -r now 2021-07-26T15:37:55.133 INFO:teuthology.task.kernel:Installing distro kernel on c2.mon.a... 2021-07-26T15:37:55.133 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi087.front.sepia.ceph.com, path=None, version=distro) 2021-07-26T15:37:55.134 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get clean 2021-07-26T15:37:55.220 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2021-07-26T15:37:55.350 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:37:55.467 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:37:55.549 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:37:55.637 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-07-26T15:37:56.793 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-07-26T15:37:56.817 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-07-26T15:37:56.883 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-07-26T15:37:57.028 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-07-26T15:37:57.029 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-07-26T15:37:57.099 INFO:teuthology.orchestra.run.smithi087.stderr:E: Unable to locate package linux-image-current-generic 2021-07-26T15:37:57.100 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-07-26T15:37:57.101 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-07-26T15:37:57.167 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-07-26T15:37:57.325 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-07-26T15:37:57.326 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-07-26T15:37:57.484 INFO:teuthology.orchestra.run.smithi087.stdout:linux-image-generic is already the newest version (5.4.0.80.84). 2021-07-26T15:37:57.485 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 0 newly installed, 0 to remove and 160 not upgraded. 2021-07-26T15:37:57.487 DEBUG:teuthology.orchestra.run.smithi087:> dpkg -s linux-image-generic 2021-07-26T15:37:57.513 INFO:teuthology.orchestra.run.smithi087.stdout:Package: linux-image-generic 2021-07-26T15:37:57.513 INFO:teuthology.orchestra.run.smithi087.stdout:Status: install ok installed 2021-07-26T15:37:57.513 INFO:teuthology.orchestra.run.smithi087.stdout:Priority: optional 2021-07-26T15:37:57.514 INFO:teuthology.orchestra.run.smithi087.stdout:Section: kernel 2021-07-26T15:37:57.515 INFO:teuthology.orchestra.run.smithi087.stdout:Installed-Size: 18 2021-07-26T15:37:57.515 INFO:teuthology.orchestra.run.smithi087.stdout:Maintainer: Ubuntu Kernel Team 2021-07-26T15:37:57.516 INFO:teuthology.orchestra.run.smithi087.stdout:Architecture: amd64 2021-07-26T15:37:57.516 INFO:teuthology.orchestra.run.smithi087.stdout:Source: linux-meta 2021-07-26T15:37:57.516 INFO:teuthology.orchestra.run.smithi087.stdout:Version: 5.4.0.80.84 2021-07-26T15:37:57.516 INFO:teuthology.orchestra.run.smithi087.stdout:Provides: virtualbox-guest-modules (= 6.1.16-dfsg-6~ubuntu1.20.04.2), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.10) 2021-07-26T15:37:57.516 INFO:teuthology.orchestra.run.smithi087.stdout:Depends: linux-image-5.4.0-80-generic, linux-modules-extra-5.4.0-80-generic, linux-firmware, intel-microcode, amd64-microcode 2021-07-26T15:37:57.517 INFO:teuthology.orchestra.run.smithi087.stdout:Recommends: thermald 2021-07-26T15:37:57.517 INFO:teuthology.orchestra.run.smithi087.stdout:Description: Generic Linux kernel image 2021-07-26T15:37:57.517 INFO:teuthology.orchestra.run.smithi087.stdout: This package will always depend on the latest generic kernel image 2021-07-26T15:37:57.517 INFO:teuthology.orchestra.run.smithi087.stdout: available. 2021-07-26T15:37:57.518 DEBUG:teuthology.orchestra.run.smithi087:> mktemp 2021-07-26T15:37:57.563 INFO:teuthology.orchestra.run.smithi087.stdout:/tmp/tmp.Bd4FQj2pCt 2021-07-26T15:37:57.564 DEBUG:teuthology.orchestra.run.smithi087:> sudo cp /boot/grub/grub.cfg /tmp/tmp.Bd4FQj2pCt 2021-07-26T15:37:57.579 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0666 /tmp/tmp.Bd4FQj2pCt 2021-07-26T15:37:57.678 DEBUG:teuthology.orchestra.remote:smithi087:/tmp/tmp.Bd4FQj2pCt is 8KB 2021-07-26T15:37:57.693 DEBUG:teuthology.orchestra.run.smithi087:> rm -fr /tmp/tmp.Bd4FQj2pCt 2021-07-26T15:37:57.700 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-07-26T15:37:57.759 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:37:57.760 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-07-26T15:37:57.760 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-07-26T15:37:57.791 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-80-generic 2021-07-26T15:37:57.792 DEBUG:teuthology.orchestra.run.smithi087:> sudo update-grub 2021-07-26T15:37:59.011 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub' 2021-07-26T15:37:59.013 INFO:teuthology.orchestra.run.smithi087.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-07-26T15:37:59.027 INFO:teuthology.orchestra.run.smithi087.stderr:Generating grub configuration file ... 2021-07-26T15:37:59.265 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-80-generic 2021-07-26T15:37:59.276 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-80-generic 2021-07-26T15:37:59.628 INFO:teuthology.orchestra.run.smithi087.stderr:Found linux image: /boot/vmlinuz-5.4.0-66-generic 2021-07-26T15:37:59.638 INFO:teuthology.orchestra.run.smithi087.stderr:Found initrd image: /boot/initrd.img-5.4.0-66-generic 2021-07-26T15:38:00.726 INFO:teuthology.orchestra.run.smithi087.stderr:done 2021-07-26T15:38:00.728 DEBUG:teuthology.orchestra.run.smithi087:> sudo shutdown -r now 2021-07-26T15:38:30.758 INFO:teuthology.misc:Re-opening connections... 2021-07-26T15:38:30.758 INFO:teuthology.misc:trying to connect to ubuntu@smithi067.front.sepia.ceph.com 2021-07-26T15:38:30.759 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:38:30.760 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:39:05.291 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.67 2021-07-26T15:39:05.292 INFO:teuthology.misc:trying to connect to ubuntu@smithi087.front.sepia.ceph.com 2021-07-26T15:39:05.292 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:39:05.293 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:39:36.779 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.87 2021-07-26T15:39:36.780 DEBUG:teuthology.misc:waited 66.0216851234436 2021-07-26T15:39:37.782 INFO:teuthology.misc:trying to connect to ubuntu@smithi067.front.sepia.ceph.com 2021-07-26T15:39:37.782 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:39:37.783 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:39:37.989 DEBUG:teuthology.orchestra.run.smithi067:> true 2021-07-26T15:39:38.583 DEBUG:teuthology.misc:waited 67.82464480400085 2021-07-26T15:39:39.585 INFO:teuthology.misc:trying to connect to ubuntu@smithi087.front.sepia.ceph.com 2021-07-26T15:39:39.585 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:39:39.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:39:40.218 DEBUG:teuthology.orchestra.run.smithi087:> true 2021-07-26T15:39:40.768 DEBUG:teuthology.misc:waited 70.0095546245575 2021-07-26T15:39:41.769 INFO:teuthology.task.kernel:Checking client c1.mon.a for new kernel version... 2021-07-26T15:39:41.770 INFO:teuthology.task.kernel:Checking kernel version of c1.mon.a, want "5.4.0-80-generic"... 2021-07-26T15:39:41.770 DEBUG:teuthology.orchestra.run.smithi067:> uname -r 2021-07-26T15:39:41.779 INFO:teuthology.orchestra.run.smithi067.stdout:5.4.0-80-generic 2021-07-26T15:39:41.779 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-80-generic vs 5.4.0-80-generic 2021-07-26T15:39:41.780 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-07-26T15:39:41.780 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-07-26T15:39:41.781 INFO:teuthology.task.kernel:Checking client c2.mon.a for new kernel version... 2021-07-26T15:39:41.781 INFO:teuthology.task.kernel:Checking kernel version of c2.mon.a, want "5.4.0-80-generic"... 2021-07-26T15:39:41.782 DEBUG:teuthology.orchestra.run.smithi087:> uname -r 2021-07-26T15:39:41.788 INFO:teuthology.orchestra.run.smithi087.stdout:5.4.0-80-generic 2021-07-26T15:39:41.790 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-80-generic vs 5.4.0-80-generic 2021-07-26T15:39:41.790 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-07-26T15:39:41.790 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-07-26T15:39:42.791 INFO:teuthology.task.kernel:Enabling kdb on c1.mon.a... 2021-07-26T15:39:42.792 DEBUG:teuthology.orchestra.run.smithi067:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-07-26T15:39:42.858 INFO:teuthology.orchestra.run.smithi067.stdout:ttyS1 2021-07-26T15:39:42.899 INFO:teuthology.task.kernel:Enabling kdb on c2.mon.a... 2021-07-26T15:39:42.899 DEBUG:teuthology.orchestra.run.smithi087:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-07-26T15:39:42.969 INFO:teuthology.orchestra.run.smithi087.stdout:ttyS1 2021-07-26T15:39:42.995 INFO:teuthology.run_tasks:Running task internal.base... 2021-07-26T15:39:43.012 INFO:teuthology.task.internal:Creating test directory... 2021-07-26T15:39:43.013 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-07-26T15:39:43.015 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-07-26T15:39:43.023 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-07-26T15:39:43.059 INFO:teuthology.run_tasks:Running task internal.archive... 2021-07-26T15:39:43.136 INFO:teuthology.task.internal:Creating archive directory... 2021-07-26T15:39:43.137 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-07-26T15:39:43.142 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-07-26T15:39:43.168 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-07-26T15:39:43.226 INFO:teuthology.task.internal:Enabling coredump saving... 2021-07-26T15:39:43.226 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-07-26T15:39:43.229 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-07-26T15:39:43.249 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:39:43.254 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:39:43.259 INFO:teuthology.orchestra.run.smithi067.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:39:43.264 INFO:teuthology.orchestra.run.smithi087.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-07-26T15:39:43.265 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-07-26T15:39:43.309 INFO:teuthology.task.internal:Configuring sudo... 2021-07-26T15:39:43.310 DEBUG:teuthology.orchestra.run.smithi067:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-07-26T15:39:43.312 DEBUG:teuthology.orchestra.run.smithi087:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-07-26T15:39:43.329 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-07-26T15:39:43.403 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-07-26T15:39:43.403 DEBUG:teuthology.orchestra.run.smithi067:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-07-26T15:39:43.406 DEBUG:teuthology.orchestra.run.smithi087:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-07-26T15:39:43.413 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-07-26T15:39:43.420 DEBUG:teuthology.orchestra.run.smithi067:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-07-26T15:39:43.471 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:39:43.471 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-07-26T15:39:43.488 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-07-26T15:39:43.496 DEBUG:teuthology.orchestra.run.smithi087:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-07-26T15:39:43.546 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:39:43.547 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-07-26T15:39:43.569 DEBUG:teuthology.orchestra.run.smithi067:> sudo service rsyslog restart 2021-07-26T15:39:43.572 DEBUG:teuthology.orchestra.run.smithi087:> sudo service rsyslog restart 2021-07-26T15:39:43.625 INFO:teuthology.run_tasks:Running task internal.timer... 2021-07-26T15:39:43.643 INFO:teuthology.task.internal:Starting timer... 2021-07-26T15:39:43.644 INFO:teuthology.run_tasks:Running task pcp... 2021-07-26T15:39:43.696 INFO:teuthology.run_tasks:Running task selinux... 2021-07-26T15:39:43.778 DEBUG:teuthology.task.selinux:Excluding smithi067: OS 'ubuntu' does not support SELinux 2021-07-26T15:39:43.778 DEBUG:teuthology.task.selinux:Excluding smithi087: OS 'ubuntu' does not support SELinux 2021-07-26T15:39:43.779 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-07-26T15:39:43.779 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-07-26T15:39:43.779 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-07-26T15:39:43.780 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-07-26T15:39:43.905 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-07-26T15:39:43.906 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-07-26T15:39:43.931 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-07-26T15:39:43.934 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi067.front.sepia.ceph.com,smithi087.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-07-26T15:39:44.303 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-07-26T15:39:45.150 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-07-26T15:39:48.015 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-07-26T15:39:48.039 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:48 +0000 (0:00:00.038) 0:00:00.038 *********** 2021-07-26T15:39:48.052 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:48 +0000 (0:00:00.013) 0:00:00.051 *********** 2021-07-26T15:39:50.331 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-07-26T15:39:50.332 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi087.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. 2021-07-26T15:39:50.332 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] 2021-07-26T15:39:50.343 INFO:teuthology.task.ansible.out:[DEPRECATION WARNING]: Distribution Ubuntu 20.04 on host smithi067.front.sepia.ceph.com should use /usr/bin/python3, but is using /usr/bin/python for backward compatibility with prior Ansible releases. A future Ansible release will default to using the discovered platform python for this host. See https://docs.ansible.com/ansible/2.9/reference_appendices/inter preter_discovery.html for more information. This feature will be removed in version 2.12. Deprecation warnings can be disabled by setting deprecation_warnings=False in ansible.cfg. ok: [smithi067.front.sepia.ceph.com] 2021-07-26T15:39:50.403 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:50 +0000 (0:00:02.351) 0:00:02.402 *********** 2021-07-26T15:39:50.539 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:50 +0000 (0:00:00.135) 0:00:02.538 *********** 2021-07-26T15:39:50.820 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-07-26T15:39:50.822 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:39:50.843 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:50 +0000 (0:00:00.303) 0:00:02.842 *********** 2021-07-26T15:39:50.866 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:50 +0000 (0:00:00.022) 0:00:02.865 *********** 2021-07-26T15:39:51.381 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-07-26T15:39:51.383 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-07-26T15:39:51.405 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:51 +0000 (0:00:00.539) 0:00:03.404 *********** 2021-07-26T15:39:51.444 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-07-26T15:39:51.468 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:51 +0000 (0:00:00.062) 0:00:03.467 *********** 2021-07-26T15:39:51.750 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2021-07-26T15:39:51.751 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.046976", "end": "2021-07-26 15:39:51.424894", "rc": 0, "start": "2021-07-26 15:39:51.377918", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-07-26T15:39:51.773 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:51 +0000 (0:00:00.304) 0:00:03.772 *********** 2021-07-26T15:39:51.791 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.080532", "end": "2021-07-26 15:39:51.474413", "rc": 0, "start": "2021-07-26 15:39:51.393881", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-07-26T15:39:51.815 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:51 +0000 (0:00:00.041) 0:00:03.814 *********** 2021-07-26T15:39:52.032 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:39:52.056 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:52 +0000 (0:00:00.240) 0:00:04.055 *********** 2021-07-26T15:39:52.082 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:52 +0000 (0:00:00.025) 0:00:04.080 *********** 2021-07-26T15:39:52.805 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-07-26T15:39:52.807 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313992.1232142-2494-107487435549167/source", "state": "file", "uid": 0} 2021-07-26T15:39:52.828 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:52 +0000 (0:00:00.747) 0:00:04.828 *********** 2021-07-26T15:39:52.836 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627313992.0904877-2488-261814970895875/source", "state": "file", "uid": 0} 2021-07-26T15:39:52.860 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:52 +0000 (0:00:00.031) 0:00:04.860 *********** 2021-07-26T15:39:53.262 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-07-26T15:39:53.264 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-07-26T15:39:53.265 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-07-26T15:39:53.267 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-07-26T15:39:53.269 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-07-26T15:39:53.354 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-07-26T15:39:53.356 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-07-26T15:39:53.369 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-07-26T15:39:53.371 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:53 +0000 (0:00:00.508) 0:00:05.368 *********** 2021-07-26T15:39:54.051 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] 2021-07-26T15:39:54.071 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] 2021-07-26T15:39:54.090 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** 2021-07-26T15:39:54.091 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:54 +0000 (0:00:00.720) 0:00:06.089 *********** 2021-07-26T15:39:54.126 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-07-26T15:39:54.128 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-07-26T15:39:54.132 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-07-26T15:39:54.353 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:54 +0000 (0:00:00.263) 0:00:06.353 *********** 2021-07-26T15:39:54.382 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:54 +0000 (0:00:00.028) 0:00:06.381 *********** 2021-07-26T15:39:55.289 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi087.front.sepia.ceph.com] 2021-07-26T15:39:55.347 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-07-26T15:39:55.349 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:55 +0000 (0:00:00.965) 0:00:07.347 *********** 2021-07-26T15:39:55.422 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] 2021-07-26T15:39:55.479 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:55 +0000 (0:00:00.131) 0:00:07.478 *********** 2021-07-26T15:39:55.783 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-07-26T15:39:55.784 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.184308", "end": "2021-07-26 15:39:55.755938", "rc": 0, "start": "2021-07-26 15:39:55.571630", "stderr": "", "stderr_lines": [], "stdout": "fa3530b6c8007ac148c609947f616c9ce81a7370", "stdout_lines": ["fa3530b6c8007ac148c609947f616c9ce81a7370"]} 2021-07-26T15:39:55.808 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:55 +0000 (0:00:00.328) 0:00:07.807 *********** 2021-07-26T15:39:55.962 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.212134", "end": "2021-07-26 15:39:55.934818", "rc": 0, "start": "2021-07-26 15:39:55.722684", "stderr": "", "stderr_lines": [], "stdout": "fa3530b6c8007ac148c609947f616c9ce81a7370", "stdout_lines": ["fa3530b6c8007ac148c609947f616c9ce81a7370"]} 2021-07-26T15:39:55.964 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.018785", "end": "2021-07-26 15:39:55.634639", "failed_when_result": false, "rc": 0, "start": "2021-07-26 15:39:55.615854", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-07-26T15:39:55.987 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:55 +0000 (0:00:00.179) 0:00:07.986 *********** 2021-07-26T15:39:56.009 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.021) 0:00:08.007 *********** 2021-07-26T15:39:56.077 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-07-26T15:39:56.079 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:56.101 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.092) 0:00:08.100 *********** 2021-07-26T15:39:56.128 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-07-26T15:39:56.130 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.010480", "end": "2021-07-26 15:39:55.823408", "failed_when_result": false, "rc": 0, "start": "2021-07-26 15:39:55.812928", "stderr": "", "stderr_lines": [], "stdout": "df8946f08e870e2d2565b79099289ca48bd825f3", "stdout_lines": ["df8946f08e870e2d2565b79099289ca48bd825f3"]} 2021-07-26T15:39:56.156 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.055) 0:00:08.155 *********** 2021-07-26T15:39:56.174 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-07-26T15:39:56.176 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:56.199 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.042) 0:00:08.198 *********** 2021-07-26T15:39:56.226 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** 2021-07-26T15:39:56.227 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:56.250 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.051) 0:00:08.250 *********** 2021-07-26T15:39:56.268 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-07-26T15:39:56.270 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:56.293 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.042) 0:00:08.292 *********** 2021-07-26T15:39:56.320 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ 2021-07-26T15:39:56.323 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:56.344 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.051) 0:00:08.343 *********** 2021-07-26T15:39:56.361 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-07-26T15:39:56.363 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:56.386 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.041) 0:00:08.385 *********** 2021-07-26T15:39:56.414 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:56.437 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.051) 0:00:08.436 *********** 2021-07-26T15:39:56.455 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-07-26T15:39:56.457 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:56.479 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.042) 0:00:08.479 *********** 2021-07-26T15:39:56.517 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-07-26T15:39:56.518 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:56.540 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.060) 0:00:08.540 *********** 2021-07-26T15:39:56.619 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-07-26T15:39:56.621 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:39:56.643 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.102) 0:00:08.642 *********** 2021-07-26T15:39:56.660 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-07-26T15:39:56.662 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:39:56.687 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.041) 0:00:08.684 *********** 2021-07-26T15:39:56.829 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:39:56.857 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:39:56 +0000 (0:00:00.172) 0:00:08.856 *********** 2021-07-26T15:39:56.961 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-07-26T15:39:56.963 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-07-26T15:39:57.108 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-07-26T15:39:57.121 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-07-26T15:39:57.247 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-07-26T15:39:57.270 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-07-26T15:39:57.395 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-07-26T15:39:57.417 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-07-26T15:39:57.543 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-07-26T15:39:57.554 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-07-26T15:39:57.690 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-07-26T15:39:57.713 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-07-26T15:39:57.838 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-07-26T15:39:57.860 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-07-26T15:39:57.985 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-07-26T15:39:58.007 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-07-26T15:39:58.122 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-07-26T15:39:58.155 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-07-26T15:39:58.270 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-07-26T15:39:58.302 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-07-26T15:39:58.417 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-07-26T15:39:58.439 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-07-26T15:39:58.553 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-07-26T15:39:58.587 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-07-26T15:39:58.691 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-07-26T15:39:58.734 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-07-26T15:39:58.849 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-07-26T15:39:58.881 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-07-26T15:39:58.986 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-07-26T15:39:59.029 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-07-26T15:39:59.134 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-07-26T15:39:59.166 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-07-26T15:39:59.281 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-07-26T15:39:59.313 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-07-26T15:39:59.418 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-07-26T15:39:59.461 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-07-26T15:39:59.566 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-07-26T15:39:59.612 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1118} 2021-07-26T15:39:59.707 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-07-26T15:39:59.782 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-07-26T15:39:59.856 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-07-26T15:39:59.935 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-07-26T15:40:00.006 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-07-26T15:40:00.068 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1121} 2021-07-26T15:40:00.141 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-07-26T15:40:00.226 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-07-26T15:40:00.289 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-07-26T15:40:00.374 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-07-26T15:40:00.430 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-07-26T15:40:00.526 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-07-26T15:40:00.594 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-07-26T15:40:00.668 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-07-26T15:40:00.732 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-07-26T15:40:00.825 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-07-26T15:40:00.868 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-07-26T15:40:00.962 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-07-26T15:40:01.016 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-07-26T15:40:01.121 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-07-26T15:40:01.164 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-07-26T15:40:01.259 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-07-26T15:40:01.323 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-07-26T15:40:01.407 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-07-26T15:40:01.461 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-07-26T15:40:01.565 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-07-26T15:40:01.597 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-07-26T15:40:01.715 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-07-26T15:40:01.738 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-07-26T15:40:01.856 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1133} 2021-07-26T15:40:01.888 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-07-26T15:40:02.004 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-07-26T15:40:02.026 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-07-26T15:40:02.141 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-07-26T15:40:02.173 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-07-26T15:40:02.289 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-07-26T15:40:02.323 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:40:02.442 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-07-26T15:40:02.462 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-07-26T15:40:02.589 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:40:02.611 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-07-26T15:40:02.727 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-07-26T15:40:02.770 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-07-26T15:40:02.772 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:02.880 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-07-26T15:40:02.902 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-07-26T15:40:03.038 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-07-26T15:40:03.050 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-07-26T15:40:03.196 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-07-26T15:40:03.208 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-07-26T15:40:03.335 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-07-26T15:40:03.356 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-07-26T15:40:03.482 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-07-26T15:40:03.494 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:40:03.631 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-07-26T15:40:03.643 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-07-26T15:40:03.781 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:40:03.793 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-07-26T15:40:03.929 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-07-26T15:40:03.930 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-07-26T15:40:04.071 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-07-26T15:40:04.083 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-07-26T15:40:04.223 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1150} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-07-26T15:40:04.363 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-07-26T15:40:04.374 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-07-26T15:40:04.519 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-07-26T15:40:04.534 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-07-26T15:40:04.673 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-07-26T15:40:04.695 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-07-26T15:40:04.822 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-07-26T15:40:04.843 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-07-26T15:40:04.970 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-07-26T15:40:04.983 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-07-26T15:40:05.110 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-07-26T15:40:05.122 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-07-26T15:40:05.260 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-07-26T15:40:05.263 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-07-26T15:40:05.398 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-07-26T15:40:05.409 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-07-26T15:40:05.548 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-07-26T15:40:05.558 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-07-26T15:40:05.696 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-07-26T15:40:05.707 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-07-26T15:40:05.832 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-07-26T15:40:05.854 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-07-26T15:40:05.979 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:40:06.002 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-07-26T15:40:06.128 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-07-26T15:40:06.149 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-07-26T15:40:06.276 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-07-26T15:40:06.299 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-07-26T15:40:06.429 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-07-26T15:40:06.441 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-07-26T15:40:06.566 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-07-26T15:40:06.592 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-07-26T15:40:06.718 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-07-26T15:40:06.730 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-07-26T15:40:06.858 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-07-26T15:40:06.882 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-07-26T15:40:07.000 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-07-26T15:40:07.022 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-07-26T15:40:07.141 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-07-26T15:40:07.171 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-07-26T15:40:07.287 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-07-26T15:40:07.311 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-07-26T15:40:07.426 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-07-26T15:40:07.458 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-07-26T15:40:07.574 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-07-26T15:40:07.608 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-07-26T15:40:07.715 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-07-26T15:40:07.768 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-07-26T15:40:07.869 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-07-26T15:40:07.924 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-07-26T15:40:08.009 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-07-26T15:40:08.072 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-07-26T15:40:08.146 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-07-26T15:40:08.209 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-07-26T15:40:08.293 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-07-26T15:40:08.357 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-07-26T15:40:08.432 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-07-26T15:40:08.506 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-07-26T15:40:08.582 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-07-26T15:40:08.643 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-07-26T15:40:08.718 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-07-26T15:40:08.792 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-07-26T15:40:08.866 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-07-26T15:40:08.936 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-07-26T15:40:09.013 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-07-26T15:40:09.077 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-07-26T15:40:09.154 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-07-26T15:40:09.229 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1183, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1183} 2021-07-26T15:40:09.292 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-07-26T15:40:09.366 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1184} 2021-07-26T15:40:09.452 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-07-26T15:40:09.516 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-07-26T15:40:09.579 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-07-26T15:40:09.665 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-07-26T15:40:09.730 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-07-26T15:40:09.813 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-07-26T15:40:10.012 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-07-26T15:40:10.027 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-07-26T15:40:10.105 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-07-26T15:40:10.171 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-07-26T15:40:10.245 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-07-26T15:40:10.315 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-07-26T15:40:10.399 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-07-26T15:40:10.462 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-07-26T15:40:10.547 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-07-26T15:40:10.601 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-07-26T15:40:10.696 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-07-26T15:40:10.738 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-07-26T15:40:10.844 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-07-26T15:40:10.887 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-07-26T15:40:10.986 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-07-26T15:40:11.039 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-07-26T15:40:11.135 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-07-26T15:40:11.177 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-07-26T15:40:11.284 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-07-26T15:40:11.327 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-07-26T15:40:11.423 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-07-26T15:40:11.470 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:40:11.574 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-07-26T15:40:11.607 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-07-26T15:40:11.722 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-07-26T15:40:11.754 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-07-26T15:40:11.865 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-07-26T15:40:11.897 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-07-26T15:40:12.001 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-07-26T15:40:12.047 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-07-26T15:40:12.151 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-07-26T15:40:12.197 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-07-26T15:40:12.301 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-07-26T15:40:12.346 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-07-26T15:40:12.447 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-07-26T15:40:12.506 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-07-26T15:40:12.598 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-07-26T15:40:12.652 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-07-26T15:40:12.738 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-07-26T15:40:12.804 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-07-26T15:40:12.890 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-07-26T15:40:12.950 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-07-26T15:40:13.037 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-07-26T15:40:13.101 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-07-26T15:40:13.186 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-07-26T15:40:13.240 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-07-26T15:40:13.326 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-07-26T15:40:13.390 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-07-26T15:40:13.477 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-07-26T15:40:13.530 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-07-26T15:40:13.626 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-07-26T15:40:13.690 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-07-26T15:40:13.773 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-07-26T15:40:13.827 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-07-26T15:40:13.912 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-07-26T15:40:13.978 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-07-26T15:40:14.062 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-07-26T15:40:14.119 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-07-26T15:40:14.213 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-07-26T15:40:14.266 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-07-26T15:40:14.355 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-07-26T15:40:14.410 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-07-26T15:40:14.508 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-07-26T15:40:14.553 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-07-26T15:40:14.660 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-07-26T15:40:14.703 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-07-26T15:40:14.811 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-07-26T15:40:14.865 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-07-26T15:40:14.976 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-07-26T15:40:15.009 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-07-26T15:40:15.128 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-07-26T15:40:15.162 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-07-26T15:40:15.272 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-07-26T15:40:15.314 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-07-26T15:40:15.423 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-07-26T15:40:15.462 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-07-26T15:40:15.557 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-07-26T15:40:15.600 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-07-26T15:40:15.706 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-07-26T15:40:15.750 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-07-26T15:40:15.856 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-07-26T15:40:15.889 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-07-26T15:40:15.995 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-07-26T15:40:16.038 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-07-26T15:40:16.146 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-07-26T15:40:16.191 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-07-26T15:40:16.309 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1230, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1230} 2021-07-26T15:40:16.339 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-07-26T15:40:16.448 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/hmunjulu", "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "move_home": false, "name": "hmunjulu", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-07-26T15:40:16.491 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-07-26T15:40:16.600 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-07-26T15:40:16.634 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-07-26T15:40:16.739 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-07-26T15:40:16.773 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-07-26T15:40:16.878 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-07-26T15:40:16.922 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-07-26T15:40:17.030 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-07-26T15:40:17.177 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-07-26T15:40:17.326 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-07-26T15:40:17.411 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-07-26T15:40:17.915 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "name": "dachary", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-07-26T15:40:17.960 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-07-26T15:40:18.376 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "name": "amctagga", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-07-26T15:40:18.449 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-07-26T15:40:18.848 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "name": "kevinz", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-07-26T15:40:18.970 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-07-26T15:40:19.396 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-07-26T15:40:19.516 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-07-26T15:40:19.858 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10107, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-07-26T15:40:19.934 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-07-26T15:40:20.342 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-07-26T15:40:20.405 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10108, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10107} 2021-07-26T15:40:20.896 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-07-26T15:40:20.949 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10109, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "name": "lflores", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10108} 2021-07-26T15:40:21.451 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-07-26T15:40:21.483 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10110, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10109} 2021-07-26T15:40:21.866 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-07-26T15:40:22.023 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10111, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10110} 2021-07-26T15:40:22.316 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-07-26T15:40:22.558 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10112, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "name": "luisrico", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10111} 2021-07-26T15:40:22.870 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-07-26T15:40:22.998 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10113, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "name": "matan", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10112} 2021-07-26T15:40:23.397 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-07-26T15:40:23.599 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10114, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10113} 2021-07-26T15:40:23.919 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-07-26T15:40:24.140 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10115, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10114} 2021-07-26T15:40:24.458 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-07-26T15:40:24.621 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:24 +0000 (0:00:27.763) 0:00:36.620 *********** 2021-07-26T15:40:24.696 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** TASK [Create all admin users with sudo access.] ******************************** changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10116, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10115} 2021-07-26T15:40:24.727 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:24 +0000 (0:00:00.105) 0:00:36.726 *********** 2021-07-26T15:40:24.816 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-07-26T15:40:24.818 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-07-26T15:40:24.820 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-07-26T15:40:24.822 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-07-26T15:40:24.824 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-07-26T15:40:24.827 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1 2021-07-26T15:40:24.827 INFO:teuthology.task.ansible.out:eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-07-26T15:40:24.829 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-07-26T15:40:24.830 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-07-26T15:40:24.832 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-07-26T15:40:24.834 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-07-26T15:40:24.836 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-07-26T15:40:24.838 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-07-26T15:40:24.840 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0 2021-07-26T15:40:24.841 INFO:teuthology.task.ansible.out:fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-07-26T15:40:24.842 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-07-26T15:40:24.844 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}]}, "changed": false} 2021-07-26T15:40:24.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:24 +0000 (0:00:00.150) 0:00:36.877 *********** 2021-07-26T15:40:25.196 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-07-26T15:40:25.197 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10117, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10116} 2021-07-26T15:40:25.393 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:25 +0000 (0:00:00.515) 0:00:37.393 *********** 2021-07-26T15:40:25.502 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-07-26T15:40:25.528 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:25 +0000 (0:00:00.134) 0:00:37.527 *********** 2021-07-26T15:40:25.655 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-07-26T15:40:25.657 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@fedora 2021-07-26T15:40:25.659 INFO:teuthology.task.ansible.out:rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-07-26T15:40:25.661 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop K 2021-07-26T15:40:25.663 INFO:teuthology.task.ansible.out:D0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9 2021-07-26T15:40:25.664 INFO:teuthology.task.ansible.out:df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99 2021-07-26T15:40:25.665 INFO:teuthology.task.ansible.out:bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9 2021-07-26T15:40:25.667 INFO:teuthology.task.ansible.out:b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", " 2021-07-26T15:40:25.668 INFO:teuthology.task.ansible.out:ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 2021-07-26T15:40:25.670 INFO:teuthology.task.ansible.out:f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": 2021-07-26T15:40:25.673 INFO:teuthology.task.ansible.out:"alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon 2021-07-26T15:40:25.674 INFO:teuthology.task.ansible.out:", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"nam 2021-07-26T15:40:25.676 INFO:teuthology.task.ansible.out:e": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449 2021-07-26T15:40:25.678 INFO:teuthology.task.ansible.out:ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn 2021-07-26T15:40:25.680 INFO:teuthology.task.ansible.out:": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185 2021-07-26T15:40:25.681 INFO:teuthology.task.ansible.out:052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}]}, "changed": false} 2021-07-26T15:40:25.709 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:25 +0000 (0:00:00.179) 0:00:37.707 *********** 2021-07-26T15:40:26.301 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-07-26T15:40:26.303 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"after": "fa3530b6c8007ac148c609947f616c9ce81a7370", "attempts": 1, "before": "fa3530b6c8007ac148c609947f616c9ce81a7370", "changed": false, "remote_url_changed": false} 2021-07-26T15:40:26.327 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:26 +0000 (0:00:00.619) 0:00:38.326 *********** 2021-07-26T15:40:26.567 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-07-26T15:40:26.568 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-07-26T15:40:26.704 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-07-26T15:40:26.706 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:26.729 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-07-26T15:40:26.731 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"after": "fa3530b6c8007ac148c609947f616c9ce81a7370", "attempts": 1, "before": "fa3530b6c8007ac148c609947f616c9ce81a7370", "changed": false, "remote_url_changed": false} 2021-07-26T15:40:26.753 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:26 +0000 (0:00:00.425) 0:00:38.752 *********** 2021-07-26T15:40:26.844 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-07-26T15:40:26.847 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-07-26T15:40:26.973 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-07-26T15:40:26.975 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-07-26T15:40:27.007 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-07-26T15:40:27.125 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-07-26T15:40:27.146 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-07-26T15:40:27.265 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-07-26T15:40:27.267 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-07-26T15:40:27.288 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-07-26T15:40:27.403 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-07-26T15:40:27.442 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZ 2021-07-26T15:40:27.444 INFO:teuthology.task.ansible.out:tIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-07-26T15:40:27.527 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-07-26T15:40:27.570 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-07-26T15:40:27.656 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-07-26T15:40:27.667 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.710 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+ 2021-07-26T15:40:27.712 INFO:teuthology.task.ansible.out:o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-07-26T15:40:27.816 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-07-26T15:40:27.818 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-07-26T15:40:27.841 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-07-26T15:40:27.969 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-07-26T15:40:27.970 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-07-26T15:40:27.980 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.982 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:27.992 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCgaz5AsLB+hPwnHjlf6vktlUQ8iWsKA+hViok+j+uCm0U/iho7O7Qd8E/3tp9yBx10Wkvuz1mmf6v2AO7Qa8+SE1QQPmA+4xLp4xXCqlUGFjnzm/7uQcQZtlWdfBHzQ9jVyPAgUpnGVUtW8PhW0txe8MEtecOO2C3Snx0yuTOx6O11jNvT938QjOeRQWw3X2YFUtMIOiwEhKtqstBIGXlMdaQKfvdlbA9MjyYy6VfK1x8lVcu8umUf/z56YmMkC2iO117/obhdu1XsU9SmjM51wHMOUCXSVqH8E3BWu0yohy4QmZDkdFihyYa+hoS9dOqGC91dFaQc46xrdmV4wqg1 jcaratza@MacBook-Pro\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-07-26T15:40:28.110 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-07-26T15:40:28.121 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-07-26T15:40:28.132 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.254 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-07-26T15:40:28.258 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-07-26T15:40:28.263 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMor 2021-07-26T15:40:28.264 INFO:teuthology.task.ansible.out:bnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-07-26T15:40:28.396 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-07-26T15:40:28.396 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemer 2021-07-26T15:40:28.399 INFO:teuthology.task.ansible.out:son", "validate_certs": true} 2021-07-26T15:40:28.416 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.430 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:28.548 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-07-26T15:40:28.550 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-07-26T15:40:28.571 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-07-26T15:40:28.699 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-07-26T15:40:28.743 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtS 2021-07-26T15:40:28.745 INFO:teuthology.task.ansible.out:oAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-07-26T15:40:28.858 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-07-26T15:40:28.876 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-07-26T15:40:29.011 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-07-26T15:40:29.028 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": 2021-07-26T15:40:29.034 INFO:teuthology.task.ansible.out:null, "state": "present", "user": "davidz", "validate_certs": true} 2021-07-26T15:40:29.147 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-07-26T15:40:29.149 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-07-26T15:40:29.287 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNK 2021-07-26T15:40:29.289 INFO:teuthology.task.ansible.out:bQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-07-26T15:40:29.415 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-07-26T15:40:29.417 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2021-07-26T15:40:29.544 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9 2021-07-26T15:40:29.549 INFO:teuthology.task.ansible.out:CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-07-26T15:40:29.566 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-07-26T15:40:29.674 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBY 2021-07-26T15:40:29.676 INFO:teuthology.task.ansible.out:B0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-07-26T15:40:29.689 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-07-26T15:40:29.691 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-07-26T15:40:29.802 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-07-26T15:40:29.813 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-07-26T15:40:29.946 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-07-26T15:40:29.963 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-07-26T15:40:30.087 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7 2021-07-26T15:40:30.089 INFO:teuthology.task.ansible.out:gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-07-26T15:40:30.105 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-07-26T15:40:30.243 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-07-26T15:40:30.249 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-07-26T15:40:30.361 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-07-26T15:40:30.389 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-07-26T15:40:30.508 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-07-26T15:40:30.510 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-07-26T15:40:30.518 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-07-26T15:40:30.648 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-07-26T15:40:30.671 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-07-26T15:40:30.799 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-07-26T15:40:30.812 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-07-26T15:40:30.938 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-07-26T15:40:30.950 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQv 2021-07-26T15:40:30.952 INFO:teuthology.task.ansible.out:UxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-07-26T15:40:31.067 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-07-26T15:40:31.089 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2021-07-26T15:40:31.387 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-07-26T15:40:31.398 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-07-26T15:40:31.536 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg 2021-07-26T15:40:31.538 INFO:teuthology.task.ansible.out:/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-07-26T15:40:31.670 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-07-26T15:40:31.678 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-07-26T15:40:31.809 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQ 2021-07-26T15:40:31.815 INFO:teuthology.task.ansible.out:xLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-07-26T15:40:31.947 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:40:31.958 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-07-26T15:40:31.960 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-07-26T15:40:32.076 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-07-26T15:40:32.100 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-07-26T15:40:32.102 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-07-26T15:40:32.206 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-07-26T15:40:32.216 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-07-26T15:40:32.359 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-07-26T15:40:32.361 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1 2021-07-26T15:40:32.363 INFO:teuthology.task.ansible.out:OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-07-26T15:40:32.497 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-07-26T15:40:32.508 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyK 2021-07-26T15:40:32.513 INFO:teuthology.task.ansible.out:z2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-07-26T15:40:32.636 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-07-26T15:40:32.637 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-07-26T15:40:32.638 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:40:32.767 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-07-26T15:40:32.769 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-07-26T15:40:32.771 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-07-26T15:40:32.899 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-07-26T15:40:32.900 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-07-26T15:40:33.038 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-07-26T15:40:33.050 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtV 2021-07-26T15:40:33.052 INFO:teuthology.task.ansible.out:TFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:40:33.170 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-07-26T15:40:33.192 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjE 2021-07-26T15:40:33.194 INFO:teuthology.task.ansible.out:fdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+d 2021-07-26T15:40:33.196 INFO:teuthology.task.ansible.out:TzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-07-26T15:40:33.303 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-07-26T15:40:33.325 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-07-26T15:40:33.443 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-07-26T15:40:33.455 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-07-26T15:40:33.573 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-07-26T15:40:33.575 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-07-26T15:40:33.583 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-07-26T15:40:33.701 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-07-26T15:40:33.723 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-07-26T15:40:33.838 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-07-26T15:40:33.849 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-07-26T15:40:33.976 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-07-26T15:40:33.978 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-07-26T15:40:33.988 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home 2021-07-26T15:40:33.990 INFO:teuthology.task.ansible.out:/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-07-26T15:40:34.103 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-07-26T15:40:34.126 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-07-26T15:40:34.244 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-07-26T15:40:34.287 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-07-26T15:40:34.385 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-07-26T15:40:34.387 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-07-26T15:40:34.417 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": " 2021-07-26T15:40:34.419 INFO:teuthology.task.ansible.out:gabrioux", "validate_certs": true} 2021-07-26T15:40:34.512 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-07-26T15:40:34.555 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-07-26T15:40:34.649 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-07-26T15:40:34.693 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-07-26T15:40:34.783 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-07-26T15:40:34.826 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kk 2021-07-26T15:40:34.828 INFO:teuthology.task.ansible.out:ke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-07-26T15:40:34.913 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:40:34.970 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-07-26T15:40:35.051 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-07-26T15:40:35.103 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-07-26T15:40:35.190 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-07-26T15:40:35.255 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-07-26T15:40:35.320 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-07-26T15:40:35.384 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-07-26T15:40:35.457 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-07-26T15:40:35.542 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-07-26T15:40:35.594 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-07-26T15:40:35.696 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-07-26T15:40:35.742 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-07-26T15:40:35.837 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-07-26T15:40:35.916 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-07-26T15:40:35.970 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-07-26T15:40:36.074 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-07-26T15:40:36.097 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-07-26T15:40:36.206 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-07-26T15:40:36.249 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-07-26T15:40:36.352 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-07-26T15:40:36.386 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-07-26T15:40:36.492 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-07-26T15:40:36.531 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-07-26T15:40:36.639 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-07-26T15:40:36.677 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-07-26T15:40:36.780 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-07-26T15:40:36.840 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-07-26T15:40:36.923 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-07-26T15:40:36.987 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-07-26T15:40:37.065 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-07-26T15:40:37.138 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-07-26T15:40:37.216 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-07-26T15:40:37.283 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-07-26T15:40:37.366 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-07-26T15:40:37.377 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-07-26T15:40:37.420 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-07-26T15:40:37.487 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-07-26T15:40:37.587 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-07-26T15:40:37.639 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-07-26T15:40:37.724 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-07-26T15:40:37.779 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-07-26T15:40:37.876 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1 2021-07-26T15:40:37.878 INFO:teuthology.task.ansible.out:lXTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-07-26T15:40:37.912 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-07-26T15:40:38.013 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-07-26T15:40:38.046 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-07-26T15:40:38.061 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-07-26T15:40:38.154 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-07-26T15:40:38.180 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-07-26T15:40:38.182 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-07-26T15:40:38.295 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-07-26T15:40:38.317 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-07-26T15:40:38.426 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2021-07-26T15:40:38.458 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-07-26T15:40:38.565 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.locald 2021-07-26T15:40:38.567 INFO:teuthology.task.ansible.out:omain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2021-07-26T15:40:38.596 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-07-26T15:40:38.702 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq 2021-07-26T15:40:38.704 INFO:teuthology.task.ansible.out:2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-07-26T15:40:38.724 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-07-26T15:40:38.829 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-07-26T15:40:38.861 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-07-26T15:40:38.966 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-07-26T15:40:38.988 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-07-26T15:40:39.116 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-07-26T15:40:39.118 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-07-26T15:40:39.256 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qL 2021-07-26T15:40:39.258 INFO:teuthology.task.ansible.out:jbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.local", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-07-26T15:40:39.389 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-07-26T15:40:39.400 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-07-26T15:40:39.526 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-07-26T15:40:39.538 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-07-26T15:40:39.658 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-07-26T15:40:39.669 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-07-26T15:40:39.798 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-07-26T15:40:39.809 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loc 2021-07-26T15:40:39.812 INFO:teuthology.task.ansible.out:al", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-07-26T15:40:39.937 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-07-26T15:40:39.975 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-07-26T15:40:40.068 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-07-26T15:40:40.104 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-07-26T15:40:40.211 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-07-26T15:40:40.213 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-07-26T15:40:40.275 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-07-26T15:40:40.343 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-07-26T15:40:40.407 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-07-26T15:40:40.472 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-07-26T15:40:40.526 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-07-26T15:40:40.613 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-07-26T15:40:40.689 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-07-26T15:40:40.754 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-07-26T15:40:40.843 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/ 2021-07-26T15:40:41.233 INFO:teuthology.task.ansible.out:yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovp 2021-07-26T15:40:41.235 INFO:teuthology.task.ansible.out:n": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "us 2021-07-26T15:40:41.237 INFO:teuthology.task.ansible.out:er": "zdover", "validate_certs": true} ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1 2021-07-26T15:40:41.238 INFO:teuthology.task.ansible.out:EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-07-26T15:40:41.347 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-07-26T15:40:41.359 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-07-26T15:40:41.498 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-07-26T15:40:41.500 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-07-26T15:40:41.647 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-07-26T15:40:41.659 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-07-26T15:40:41.786 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-07-26T15:40:41.828 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-07-26T15:40:41.925 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-07-26T15:40:41.980 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-07-26T15:40:42.079 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-07-26T15:40:42.210 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-07-26T15:40:42.266 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-07-26T15:40:42.355 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-07-26T15:40:42.416 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-07-26T15:40:42.488 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-07-26T15:40:42.554 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-07-26T15:40:42.637 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-07-26T15:40:42.697 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-07-26T15:40:42.772 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-07-26T15:40:42.864 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-07-26T15:40:42.921 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-07-26T15:40:43.006 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-07-26T15:40:43.054 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-07-26T15:40:43.058 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-07-26T15:40:43.153 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-07-26T15:40:43.224 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-07-26T15:40:43.290 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-07-26T15:40:43.354 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-07-26T15:40:43.417 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-07-26T15:40:43.486 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-07-26T15:40:43.550 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-07-26T15:40:43.626 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-07-26T15:40:43.696 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjL 2021-07-26T15:40:43.698 INFO:teuthology.task.ansible.out:d+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-07-26T15:40:43.760 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-07-26T15:40:43.837 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-07-26T15:40:43.899 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-07-26T15:40:43.967 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-07-26T15:40:44.041 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-07-26T15:40:44.098 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-07-26T15:40:44.173 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-07-26T15:40:44.238 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-07-26T15:40:44.302 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-07-26T15:40:44.376 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-07-26T15:40:44.442 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-07-26T15:40:44.518 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-07-26T15:40:44.566 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-07-26T15:40:44.666 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-07-26T15:40:44.699 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-07-26T15:40:44.794 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-07-26T15:40:44.839 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-07-26T15:40:44.934 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-07-26T15:40:44.978 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-07-26T15:40:45.064 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-07-26T15:40:45.108 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-07-26T15:40:45.194 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-07-26T15:40:45.239 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-07-26T15:40:45.334 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQKiUAlB8dxudAY60M7jnIJvs9yb2pNaT+BVv1Vk1kMs0XjPjcw9cyT3DtQ1xGLF367phRi/cfQbXOYbHG+uyBzQ4EEnBFvziktWRx4mfeWYxKjkjbfkVfpKPsxztqCbwm6+NYzMxGK2cExN7jUHnghHAjfA0IUpVVg9peBD3kUveLwS+UxuJAnuj+G4480LS6GDyLrhFEXU7uOIIlW4S9oLnU6vJL6GAzwyLE4ijTA8Ek03SJ01Ey/gpU9AqnQNp9u12l/7sJely6sI9pAuIzmS8Ht324hexxSWN5sFjXgLvLfFK83ziDBdrFBr0WXnWsFdRpHs2CwSq1JTkByqbN hmunjulu@hmunjulu.remote.csb", "key_options": null, "keyfile": "/home/hmunjulu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hmunjulu", "validate_certs": true} 2021-07-26T15:40:45.366 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-07-26T15:40:45.368 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-07-26T15:40:45.472 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-07-26T15:40:45.494 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-07-26T15:40:45.613 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev", "key_options": null, "keyfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-07-26T15:40:45.624 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-07-26T15:40:45.731 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-07-26T15:40:45.766 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-07-26T15:40:45.878 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-07-26T15:40:45.914 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-07-26T15:40:46.010 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", " 2021-07-26T15:40:46.016 INFO:teuthology.task.ansible.out:key_options": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-07-26T15:40:46.041 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-07-26T15:40:46.175 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDr6H7hmtGCUrO3GppgMHwbmA4XT/Vipz/uLG/N8h6ZxtaLQKpCefRpdKcFlOdDwxkTmT5q9vmXQ8nl95lTGq+eeMxl4ho104ZD9e9AIYmgYqFy7/qNP8gkqduIPlypLL9m5rElTcGd7zqfMqgljMvAmnXLtZNJlIuFtszVU5WPI1QCwfQ3t5aHF6j66bpVoN9uWItVGB1LApQz9TtViWsQ9Hl8X4YauJToO+TkuSX+H/OGH7ZC6CPOzNZb3b3vF/jLMnTzXl86PJs1se4DjKkRGLVCVbr2WhLwQeZ8TEn3Hg1Gn5X8zNM5cTo6U8SnXBAe9ZYbuyfvghrNLdlZpmN+8l0/l5zC3z+N+sEzklXwHw4MQLF+KSloVFd9NN/kyenufTZAyp8VxllZ9TgdC+CPORIWyzmu1elOtYo7LNuE6CIh/Zm9B54SO6hVHhVoOCqe/dIyjeHJA0WKIZblK1XZEvWuu0E2T3jhxfe1GICyTukeB8WoBQH9DZ1yzMPt59E= nia@redhat.com", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-07-26T15:40:46.204 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-07-26T15:40:46.329 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-07-26T15:40:46.332 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-07-26T15:40:46.486 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-07-26T15:40:46.493 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-07-26T15:40:46.632 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-07-26T15:40:46.643 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-07-26T15:40:46.765 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-07-26T15:40:46.789 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-07-26T15:40:46.936 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path" 2021-07-26T15:40:46.938 INFO:teuthology.task.ansible.out:: null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-07-26T15:40:47.084 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-07-26T15:40:47.127 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-07-26T15:40:47.229 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-07-26T15:40:47.267 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-07-26T15:40:47.355 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-07-26T15:40:47.422 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-07-26T15:40:47.495 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-07-26T15:40:47.559 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-07-26T15:40:47.626 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-07-26T15:40:47.703 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-07-26T15:40:47.918 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAICYMwYvykHtnVhhJwcKaiRh9oMpJkqvEA7OAbHPYOv6W matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-07-26T15:40:47.941 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:47 +0000 (0:00:21.187) 0:00:59.940 *********** 2021-07-26T15:40:47.953 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-07-26T15:40:48.056 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-07-26T15:40:48.077 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:48.079 INFO:teuthology.task.ansible.out:TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-07-26T15:40:48.080 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.092 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr 2021-07-26T15:40:48.094 INFO:teuthology.task.ansible.out:+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.103 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.118 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.131 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.199 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-07-26T15:40:48.201 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-07-26T15:40:48.289 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-07-26T15:40:48.303 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.322 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.333 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi067.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-07-26T15:40:48.435 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:48 +0000 (0:00:00.492) 0:01:00.432 *********** 2021-07-26T15:40:48.451 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-07-26T15:40:48.453 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-07-26T15:40:48.518 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.530 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.544 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.577 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-07-26T15:40:48.586 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.599 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.601 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.602 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.602 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (ite 2021-07-26T15:40:48.604 INFO:teuthology.task.ansible.out:m={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.614 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.616 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.630 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.631 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.643 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.654 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.665 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.677 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.688 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.702 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.712 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.723 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.735 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZ 2021-07-26T15:40:48.737 INFO:teuthology.task.ansible.out:I6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.748 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.760 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.772 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.786 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.805 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.814 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.817 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.826 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.828 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.839 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.845 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.857 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.867 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.879 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.894 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.896 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71' 2021-07-26T15:40:48.897 INFO:teuthology.task.ansible.out:}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.907 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.909 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.919 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.921 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.932 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.943 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.945 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.959 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.961 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.971 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.972 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.986 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:48.996 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.008 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.020 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.032 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} ok: [smithi067.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGc 2021-07-26T15:40:49.034 INFO:teuthology.task.ansible.out:ahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.048 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.058 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.075 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": 2021-07-26T15:40:49.080 INFO:teuthology.task.ansible.out:"oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcA 2021-07-26T15:40:49.082 INFO:teuthology.task.ansible.out:TNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\ndavid@ubuntu-2004 sz2UXQopIP7TJ3t/XtOylw 515687a2ace008dbc318525cb273afed0887aa03ae9ca9b0933ca4792ef4addc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.087 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.107 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3 2021-07-26T15:40:49.120 INFO:teuthology.task.ansible.out:f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6Yt 2021-07-26T15:40:49.129 INFO:teuthology.task.ansible.out:QJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee 2021-07-26T15:40:49.131 INFO:teuthology.task.ansible.out:15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.137 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.fr 2021-07-26T15:40:49.143 INFO:teuthology.task.ansible.out:ont.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.155 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma 2021-07-26T15:40:49.158 INFO:teuthology.task.ansible.out:@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.169 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": 2021-07-26T15:40:49.173 INFO:teuthology.task.ansible.out: "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.193 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.195 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.206 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ra 2021-07-26T15:40:49.208 INFO:teuthology.task.ansible.out:kesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.218 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.219 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.230 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.231 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.243 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.245 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.256 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.259 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.274 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.290 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.299 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.316 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.316 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.317 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.317 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.318 INFO:teuthology.task.ansible.out:skipping: [smi 2021-07-26T15:40:49.320 INFO:teuthology.task.ansible.out:thi087.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.331 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.334 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.359 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.362 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.362 INFO:teuthology.task.ansible.out:skipping: 2021-07-26T15:40:49.364 INFO:teuthology.task.ansible.out:[smithi087.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.375 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.377 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.394 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.413 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.417 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was Fal 2021-07-26T15:40:49.421 INFO:teuthology.task.ansible.out:se"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_lo 2021-07-26T15:40:49.426 INFO:teuthology.task.ansible.out:op_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.487 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacro 2021-07-26T15:40:49.492 INFO:teuthology.task.ansible.out:ix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.496 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.497 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.500 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'na 2021-07-26T15:40:49.503 INFO:teuthology.task.ansible.out:me': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a 2021-07-26T15:40:49.505 INFO:teuthology.task.ansible.out:1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.509 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:49.511 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.512 INFO:teuthology.task.ansible.out: skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.514 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.524 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.526 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.540 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.542 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.554 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.557 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skip 2021-07-26T15:40:49.561 INFO:teuthology.task.ansible.out:ping: [smithi087.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.573 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.574 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.585 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.590 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.607 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.608 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.632 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:49 +0000 (0:00:01.198) 0:01:01.631 *********** 2021-07-26T15:40:49.639 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.641 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.642 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc97 2021-07-26T15:40:49.644 INFO:teuthology.task.ansible.out:9ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.655 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.666 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.669 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.678 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.680 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.690 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.706 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} TASK [Filter the revoked_users list] ******************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.731 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:49 +0000 (0:00:00.099) 0:01:01.730 *********** 2021-07-26T15:40:49.739 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.741 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.741 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.753 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.758 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.795 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name 2021-07-26T15:40:49.797 INFO:teuthology.task.ansible.out:": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.816 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.818 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.829 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.840 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.841 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.852 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.889 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible 2021-07-26T15:40:49.891 INFO:teuthology.task.ansible.out:_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.900 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.902 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.914 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.923 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.935 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.935 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat +vB2tfopNqiNnGugVmX3ew f9f6878bb5e6bb2353fa8da7d76e2d621e9fbf89a4c7583d7265cb984e231a99"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.946 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.948 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi087.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-07-26T15:40:49.960 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.971 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.972 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.983 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:49.995 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:50.018 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matanb@main 5ZJUAUM7LCpjmIkH+Ntl6g 27de66609fee4975af229f411a1f49f589a4c64b958d8913d3f5eff128a37afa"}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:50.021 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:50.029 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:50.041 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:50.091 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:50 +0000 (0:00:00.358) 0:01:02.089 *********** 2021-07-26T15:40:50.102 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi087.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-07-26T15:40:50.159 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:50.182 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:50 +0000 (0:00:00.091) 0:01:02.181 *********** 2021-07-26T15:40:50.246 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-07-26T15:40:50.249 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-07-26T15:40:50.369 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-07-26T15:40:50.402 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-07-26T15:40:50.509 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-07-26T15:40:50.546 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-07-26T15:40:50.638 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-07-26T15:40:50.685 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-07-26T15:40:50.772 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-07-26T15:40:50.815 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-07-26T15:40:50.912 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-07-26T15:40:50.957 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-07-26T15:40:51.046 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-07-26T15:40:51.089 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-07-26T15:40:51.171 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-07-26T15:40:51.234 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-07-26T15:40:51.315 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-07-26T15:40:51.378 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-07-26T15:40:51.454 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-07-26T15:40:51.517 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-07-26T15:40:51.592 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-07-26T15:40:51.648 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-07-26T15:40:51.724 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-07-26T15:40:51.791 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-07-26T15:40:51.854 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-07-26T15:40:51.930 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-07-26T15:40:51.994 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-07-26T15:40:52.073 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-07-26T15:40:52.118 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-07-26T15:40:52.205 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-07-26T15:40:52.250 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-07-26T15:40:52.350 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-07-26T15:40:52.397 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-07-26T15:40:52.484 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-07-26T15:40:52.517 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-07-26T15:40:52.635 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-07-26T15:40:52.671 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-07-26T15:40:52.774 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-07-26T15:40:52.817 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-07-26T15:40:52.908 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-07-26T15:40:52.962 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-07-26T15:40:53.041 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-07-26T15:40:53.095 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-07-26T15:40:53.188 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-07-26T15:40:53.253 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-07-26T15:40:53.322 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-07-26T15:40:53.396 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-07-26T15:40:53.472 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-07-26T15:40:53.536 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-07-26T15:40:53.622 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-07-26T15:40:53.691 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-07-26T15:40:53.772 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-07-26T15:40:53.821 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-07-26T15:40:53.897 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-07-26T15:40:53.975 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-07-26T15:40:54.042 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-07-26T15:40:54.097 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-07-26T15:40:54.181 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-07-26T15:40:54.238 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-07-26T15:40:54.337 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-07-26T15:40:54.376 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-07-26T15:40:54.462 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-07-26T15:40:54.514 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-07-26T15:40:54.605 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-07-26T15:40:54.669 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-07-26T15:40:54.744 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-07-26T15:40:54.815 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-07-26T15:40:54.883 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-07-26T15:40:54.959 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-07-26T15:40:55.015 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-07-26T15:40:55.089 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-07-26T15:40:55.152 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-07-26T15:40:55.301 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-07-26T15:40:55.453 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-07-26T15:40:55.556 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-07-26T15:40:55.578 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-07-26T15:40:55.699 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-07-26T15:40:55.842 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-07-26T15:40:55.978 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-07-26T15:40:56.086 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jdillaman", "name": "jdillaman", "remove": false, "state": "absent"} 2021-07-26T15:40:56.110 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-07-26T15:40:56.251 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-07-26T15:40:56.264 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-07-26T15:40:56.415 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-07-26T15:40:56.466 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-07-26T15:40:56.606 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-07-26T15:40:56.670 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-07-26T15:40:56.769 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-07-26T15:40:56.829 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-07-26T15:40:56.904 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-07-26T15:40:56.968 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-07-26T15:40:57.041 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-07-26T15:40:57.094 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:06.905) 0:01:09.087 *********** 2021-07-26T15:40:57.122 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-07-26T15:40:57.269 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-07-26T15:40:57.423 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-07-26T15:40:57.556 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-07-26T15:40:57.558 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "checksum": "6b66beacdb1c95b0ac86e1041f3914cfa0c50311", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e34309bf71492baa6798d79247cca3d0", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314057.1768622-10542-240996000119803/source", "state": "file", "uid": 0} 2021-07-26T15:40:57.587 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.498) 0:01:09.585 *********** 2021-07-26T15:40:57.602 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** ok: [smithi067.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-07-26T15:40:57.680 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi087.front.sepia.ceph.com] => { "msg": "Host smithi087.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-07-26T15:40:57.703 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.116) 0:01:09.702 *********** 2021-07-26T15:40:57.720 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-07-26T15:40:57.722 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-07-26T15:40:57.766 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.063) 0:01:09.765 *********** 2021-07-26T15:40:57.797 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-07-26T15:40:57.825 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.057) 0:01:09.823 *********** 2021-07-26T15:40:57.897 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:57.924 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:57 +0000 (0:00:00.097) 0:01:09.920 *********** 2021-07-26T15:40:57.994 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-07-26T15:40:57.996 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.017 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.096) 0:01:10.016 *********** 2021-07-26T15:40:58.082 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-07-26T15:40:58.083 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.113 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.095) 0:01:10.112 *********** 2021-07-26T15:40:58.188 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.211 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.098) 0:01:10.210 *********** 2021-07-26T15:40:58.218 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-07-26T15:40:58.221 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "checksum": "6b66beacdb1c95b0ac86e1041f3914cfa0c50311", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "e34309bf71492baa6798d79247cca3d0", "mode": "0644", "owner": "root", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314057.8561215-10645-6360662301045/source", "state": "file", "uid": 0} 2021-07-26T15:40:58.246 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.033) 0:01:10.244 *********** 2021-07-26T15:40:58.287 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-07-26T15:40:58.288 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.313 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.067) 0:01:10.312 *********** 2021-07-26T15:40:58.339 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi067.front.sepia.ceph.com] => { "msg": "Host smithi067.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-07-26T15:40:58.378 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.064) 0:01:10.377 *********** 2021-07-26T15:40:58.405 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.441 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.057) 0:01:10.435 *********** 2021-07-26T15:40:58.490 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** ok: [smithi067.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-07-26T15:40:58.527 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.086) 0:01:10.522 *********** 2021-07-26T15:40:58.529 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-07-26T15:40:58.530 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.572 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.049) 0:01:10.571 *********** 2021-07-26T15:40:58.608 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-07-26T15:40:58.611 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.647 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.073) 0:01:10.645 *********** 2021-07-26T15:40:58.667 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:58.669 INFO:teuthology.task.ansible.out:TASK [common : Set entitlements_path] ****************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.697 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.050) 0:01:10.696 *********** 2021-07-26T15:40:58.727 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-07-26T15:40:58.730 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.753 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.056) 0:01:10.752 *********** 2021-07-26T15:40:58.771 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-07-26T15:40:58.773 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:58.797 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.044) 0:01:10.796 *********** 2021-07-26T15:40:58.827 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.851 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.053) 0:01:10.850 *********** 2021-07-26T15:40:58.870 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-07-26T15:40:58.872 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.897 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.045) 0:01:10.896 *********** 2021-07-26T15:40:58.927 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:58.969 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:58 +0000 (0:00:00.070) 0:01:10.967 *********** 2021-07-26T15:40:58.987 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.018 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.046) 0:01:11.013 *********** 2021-07-26T15:40:59.050 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.075 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.060) 0:01:11.074 *********** 2021-07-26T15:40:59.093 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-07-26T15:40:59.096 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.131 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.055) 0:01:11.130 *********** 2021-07-26T15:40:59.165 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.191 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.059) 0:01:11.190 *********** 2021-07-26T15:40:59.208 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-07-26T15:40:59.210 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:59.237 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.043) 0:01:11.233 *********** 2021-07-26T15:40:59.263 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.288 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.054) 0:01:11.288 *********** 2021-07-26T15:40:59.290 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:59.318 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.361 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.072) 0:01:11.360 *********** 2021-07-26T15:40:59.390 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.418 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.053) 0:01:11.414 *********** 2021-07-26T15:40:59.446 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:59.472 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.056) 0:01:11.470 *********** 2021-07-26T15:40:59.501 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [smithi067.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:59.503 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:40:59.526 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.055) 0:01:11.525 *********** 2021-07-26T15:40:59.558 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-07-26T15:40:59.560 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.585 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.059) 0:01:11.584 *********** 2021-07-26T15:40:59.607 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.635 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.048) 0:01:11.633 *********** 2021-07-26T15:40:59.665 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-07-26T15:40:59.667 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.695 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.057) 0:01:11.691 *********** 2021-07-26T15:40:59.753 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-07-26T15:40:59.755 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.788 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.096) 0:01:11.787 *********** 2021-07-26T15:40:59.798 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-07-26T15:40:59.800 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.827 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.039) 0:01:11.827 *********** 2021-07-26T15:40:59.830 INFO:teuthology.task.ansible.out: 2021-07-26T15:40:59.870 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.894 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.066) 0:01:11.893 *********** 2021-07-26T15:40:59.916 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:40:59.946 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:40:59 +0000 (0:00:00.047) 0:01:11.940 *********** 2021-07-26T15:40:59.972 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-07-26T15:40:59.975 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:41:00.025 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.067) 0:01:12.008 *********** 2021-07-26T15:41:00.042 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:41:00.085 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.072) 0:01:12.081 *********** 2021-07-26T15:41:00.100 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-07-26T15:41:00.102 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.128 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.046) 0:01:12.127 *********** 2021-07-26T15:41:00.158 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.188 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.058) 0:01:12.186 *********** 2021-07-26T15:41:00.204 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-07-26T15:41:00.206 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:41:00.240 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.050) 0:01:12.236 *********** 2021-07-26T15:41:00.259 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-07-26T15:41:00.261 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.286 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.048) 0:01:12.285 *********** 2021-07-26T15:41:00.322 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.351 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.063) 0:01:12.349 *********** 2021-07-26T15:41:00.369 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:00.372 INFO:teuthology.task.ansible.out:TASK [common : Store list of enabled repos] ************************************ 2021-07-26T15:41:00.374 INFO:teuthology.task.ansible.out: skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.405 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.053) 0:01:12.402 *********** 2021-07-26T15:41:00.433 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-07-26T15:41:00.435 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.459 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.055) 0:01:12.458 *********** 2021-07-26T15:41:00.476 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-07-26T15:41:00.478 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.502 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.043) 0:01:12.501 *********** 2021-07-26T15:41:00.573 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.597 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.094) 0:01:12.596 *********** 2021-07-26T15:41:00.605 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-07-26T15:41:00.610 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.636 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.039) 0:01:12.635 *********** 2021-07-26T15:41:00.665 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-07-26T15:41:00.668 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.692 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.056) 0:01:12.691 *********** 2021-07-26T15:41:00.710 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-07-26T15:41:00.712 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.749 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.057) 0:01:12.748 *********** 2021-07-26T15:41:00.768 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:41:00.793 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.044) 0:01:12.793 *********** 2021-07-26T15:41:00.845 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:41:00.873 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.079) 0:01:12.872 *********** 2021-07-26T15:41:00.879 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-07-26T15:41:00.880 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.906 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.033) 0:01:12.906 *********** 2021-07-26T15:41:00.945 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-07-26T15:41:00.947 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:00.971 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:00 +0000 (0:00:00.063) 0:01:12.969 *********** 2021-07-26T15:41:00.978 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-07-26T15:41:00.980 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.011 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.038) 0:01:13.008 *********** 2021-07-26T15:41:01.054 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.079 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.069) 0:01:13.079 *********** 2021-07-26T15:41:01.099 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.136 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.055) 0:01:13.134 *********** 2021-07-26T15:41:01.159 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.186 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.050) 0:01:13.185 *********** 2021-07-26T15:41:01.235 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-07-26T15:41:01.237 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.264 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.077) 0:01:13.263 *********** 2021-07-26T15:41:01.293 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-07-26T15:41:01.295 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.325 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.061) 0:01:13.324 *********** 2021-07-26T15:41:01.344 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-07-26T15:41:01.346 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.391 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.065) 0:01:13.390 *********** 2021-07-26T15:41:01.427 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-07-26T15:41:01.429 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.457 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.066) 0:01:13.457 *********** 2021-07-26T15:41:01.475 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-07-26T15:41:01.478 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.501 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.043) 0:01:13.500 *********** 2021-07-26T15:41:01.553 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-07-26T15:41:01.555 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.579 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.078) 0:01:13.578 *********** 2021-07-26T15:41:01.586 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-07-26T15:41:01.589 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:41:01.613 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.034) 0:01:13.612 *********** 2021-07-26T15:41:01.685 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.714 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.100) 0:01:13.713 *********** 2021-07-26T15:41:01.776 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.014242", "end": "2021-07-26 15:41:01.449154", "rc": 0, "start": "2021-07-26 15:41:01.434912", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-07-26T15:41:01.800 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.086) 0:01:13.799 *********** 2021-07-26T15:41:01.808 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.837 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.037) 0:01:13.836 *********** 2021-07-26T15:41:01.907 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.930 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.093) 0:01:13.929 *********** 2021-07-26T15:41:01.936 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-07-26T15:41:01.938 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:01.966 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:01 +0000 (0:00:00.032) 0:01:13.962 *********** 2021-07-26T15:41:02.005 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.032 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.068) 0:01:14.031 *********** 2021-07-26T15:41:02.064 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.090 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.058) 0:01:14.089 *********** 2021-07-26T15:41:02.192 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* skipping: [smithi067.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.226 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.135) 0:01:14.225 *********** 2021-07-26T15:41:02.335 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.368 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.142) 0:01:14.367 *********** 2021-07-26T15:41:02.654 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.038338", "end": "2021-07-26 15:41:02.331339", "rc": 0, "start": "2021-07-26 15:41:02.293001", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-07-26T15:41:02.692 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.313) 0:01:14.681 *********** 2021-07-26T15:41:02.757 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-07-26T15:41:02.759 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.782 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.099) 0:01:14.780 *********** 2021-07-26T15:41:02.813 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [smithi087.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:41:02.880 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:02.911 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:02 +0000 (0:00:00.127) 0:01:14.908 *********** 2021-07-26T15:41:03.036 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [smithi087.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:41:03.210 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:41:03.220 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "name": "sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit sleep.target is masked.\"", "LoadState": "masked", "Names": "sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:41:03.403 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:41:03.437 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.528) 0:01:15.437 *********** 2021-07-26T15:41:03.448 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "name": "suspend.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "suspend.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "suspend.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit suspend.target is masked.\"", "LoadState": "masked", "Names": "suspend.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:41:03.562 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.591 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.153) 0:01:15.590 *********** 2021-07-26T15:41:03.621 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [smithi067.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "name": "hibernate.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hibernate.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hibernate.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hibernate.target is masked.\"", "LoadState": "masked", "Names": "hibernate.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:41:03.681 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.717 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.126) 0:01:15.717 *********** 2021-07-26T15:41:03.719 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:03.798 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.822 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.104) 0:01:15.821 *********** 2021-07-26T15:41:03.832 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** ok: [smithi067.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "name": "hybrid-sleep.target", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "AllowIsolate": "no", "AssertResult": "no", "AssertTimestampMonotonic": "0", "CanIsolate": "no", "CanReload": "no", "CanStart": "no", "CanStop": "yes", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "DefaultDependencies": "yes", "Description": "hybrid-sleep.target", "FailureAction": "none", "FragmentPath": "/dev/null", "Id": "hybrid-sleep.target", "IgnoreOnIsolate": "no", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "LoadError": "org.freedesktop.systemd1.UnitMasked \"Unit hybrid-sleep.target is masked.\"", "LoadState": "masked", "Names": "hybrid-sleep.target", "NeedDaemonReload": "no", "OnFailureJobMode": "replace", "Perpetual": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StateChangeTimestampMonotonic": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "Transient": "no", "UnitFileState": "masked"}} 2021-07-26T15:41:03.882 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.059) 0:01:15.881 *********** 2021-07-26T15:41:03.922 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:03.943 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:03 +0000 (0:00:00.056) 0:01:15.938 *********** 2021-07-26T15:41:03.979 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.005 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.065) 0:01:16.003 *********** 2021-07-26T15:41:04.047 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.084 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.070) 0:01:16.074 *********** 2021-07-26T15:41:04.118 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-07-26T15:41:04.120 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.151 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.076) 0:01:16.150 *********** 2021-07-26T15:41:04.234 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-07-26T15:41:04.235 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.264 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.113) 0:01:16.264 *********** 2021-07-26T15:41:04.334 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.358 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.092) 0:01:16.356 *********** 2021-07-26T15:41:04.427 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.450 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.092) 0:01:16.449 *********** 2021-07-26T15:41:04.823 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.217408", "end": "2021-07-26 15:41:04.506099", "rc": 0, "start": "2021-07-26 15:41:04.288691", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:04.844 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.393) 0:01:16.843 *********** 2021-07-26T15:41:04.862 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.631144", "end": "2021-07-26 15:41:04.524199", "rc": 0, "start": "2021-07-26 15:41:03.893055", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:04.887 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.042) 0:01:16.886 *********** 2021-07-26T15:41:04.922 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.944 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.056) 0:01:16.943 *********** 2021-07-26T15:41:04.964 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:04.993 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:04 +0000 (0:00:00.049) 0:01:16.992 *********** 2021-07-26T15:41:05.252 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-07-26T15:41:05.254 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.116812", "end": "2021-07-26 15:41:04.936637", "rc": 0, "start": "2021-07-26 15:41:04.819825", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:05.277 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.284) 0:01:17.276 *********** 2021-07-26T15:41:05.279 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:05.296 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.108395", "end": "2021-07-26 15:41:04.963808", "rc": 0, "start": "2021-07-26 15:41:04.855413", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:05.328 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:05 +0000 (0:00:00.049) 0:01:17.326 *********** 2021-07-26T15:41:09.052 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-07-26T15:41:09.053 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:41:09.076 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:09 +0000 (0:00:03.748) 0:01:21.075 *********** 2021-07-26T15:41:09.282 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:41:09.310 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:09 +0000 (0:00:00.231) 0:01:21.307 *********** 2021-07-26T15:41:09.797 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:41:09.822 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:09 +0000 (0:00:00.513) 0:01:21.821 *********** 2021-07-26T15:41:09.894 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:09.918 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:09 +0000 (0:00:00.096) 0:01:21.917 *********** 2021-07-26T15:41:10.040 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-07-26T15:41:10.042 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:41:10.065 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:10 +0000 (0:00:00.147) 0:01:22.065 *********** 2021-07-26T15:41:10.146 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-07-26T15:41:10.148 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:10.170 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:10 +0000 (0:00:00.104) 0:01:22.169 *********** 2021-07-26T15:41:10.652 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-07-26T15:41:10.653 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-07-26T15:41:10.677 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:10 +0000 (0:00:00.506) 0:01:22.676 *********** 2021-07-26T15:41:10.699 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:10 +0000 (0:00:00.021) 0:01:22.698 *********** 2021-07-26T15:41:11.408 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-07-26T15:41:11.410 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:41:11.430 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:11 +0000 (0:00:00.731) 0:01:23.430 *********** 2021-07-26T15:41:11.443 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:41:11.475 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:11 +0000 (0:00:00.043) 0:01:23.473 *********** 2021-07-26T15:41:11.855 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-07-26T15:41:11.857 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-07-26T15:41:11.898 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-07-26T15:41:12.192 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-07-26T15:41:12.214 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-07-26T15:41:12.482 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-07-26T15:41:12.510 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:12 +0000 (0:00:01.034) 0:01:24.508 *********** 2021-07-26T15:41:12.515 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-07-26T15:41:12.546 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:12 +0000 (0:00:00.037) 0:01:24.545 *********** 2021-07-26T15:41:12.647 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-07-26T15:41:12.649 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:41:12.676 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:12 +0000 (0:00:00.129) 0:01:24.675 *********** 2021-07-26T15:41:12.686 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:41:12.714 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:12 +0000 (0:00:00.038) 0:01:24.713 *********** 2021-07-26T15:41:13.061 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:13.063 INFO:teuthology.task.ansible.out:TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-07-26T15:41:13.063 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-07-26T15:41:13.112 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-07-26T15:41:13.366 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-07-26T15:41:13.410 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-07-26T15:41:13.722 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314073.3838654-12685-263629553361201/source", "state": "file", "uid": 0} 2021-07-26T15:41:13.750 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:13 +0000 (0:00:01.034) 0:01:25.748 *********** 2021-07-26T15:41:13.758 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": true, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "md5sum": "fae049f2bb3feda9c19a2dc30bce838a", "mode": "0755", "owner": "root", "size": 3612, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314073.4236944-12688-96604337617111/source", "state": "file", "uid": 0} 2021-07-26T15:41:13.808 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:13 +0000 (0:00:00.049) 0:01:25.797 *********** 2021-07-26T15:41:13.832 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:41:13.860 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:13 +0000 (0:00:00.058) 0:01:25.856 *********** 2021-07-26T15:41:13.877 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:41:13.902 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:13 +0000 (0:00:00.044) 0:01:25.901 *********** 2021-07-26T15:41:13.930 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:13.958 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:13 +0000 (0:00:00.054) 0:01:25.956 *********** 2021-07-26T15:41:13.974 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:14.000 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:13 +0000 (0:00:00.043) 0:01:25.999 *********** 2021-07-26T15:41:14.029 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-07-26T15:41:14.031 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:41:14.066 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:14 +0000 (0:00:00.065) 0:01:26.065 *********** 2021-07-26T15:41:14.094 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:41:14.121 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:14 +0000 (0:00:00.053) 0:01:26.118 *********** 2021-07-26T15:41:14.174 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:14.196 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:14.207 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:14.208 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:14.237 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:14 +0000 (0:00:00.113) 0:01:26.232 *********** 2021-07-26T15:41:14.243 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:14.254 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:14.291 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:14 +0000 (0:00:00.052) 0:01:26.284 *********** 2021-07-26T15:41:14.314 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-07-26T15:41:14.316 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:14.358 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:14 +0000 (0:00:00.064) 0:01:26.349 *********** 2021-07-26T15:41:14.370 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:14.394 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:14 +0000 (0:00:00.044) 0:01:26.394 *********** 2021-07-26T15:41:15.077 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:41:15.107 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:15 +0000 (0:00:00.712) 0:01:27.106 *********** 2021-07-26T15:41:15.156 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:41:15.181 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:15 +0000 (0:00:00.073) 0:01:27.180 *********** 2021-07-26T15:41:15.501 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-07-26T15:41:15.503 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-07-26T15:41:15.526 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:15 +0000 (0:00:00.345) 0:01:27.525 *********** 2021-07-26T15:41:15.586 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-07-26T15:41:15.610 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:15 +0000 (0:00:00.084) 0:01:27.610 *********** 2021-07-26T15:41:15.933 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-07-26T15:41:15.935 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-07-26T15:41:15.961 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:15 +0000 (0:00:00.349) 0:01:27.960 *********** 2021-07-26T15:41:16.012 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-07-26T15:41:16.041 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:16 +0000 (0:00:00.074) 0:01:28.034 *********** 2021-07-26T15:41:16.161 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-07-26T15:41:16.162 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-07-26T15:41:16.229 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-07-26T15:41:16.297 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-07-26T15:41:16.325 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:16 +0000 (0:00:00.289) 0:01:28.324 *********** 2021-07-26T15:41:16.353 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-07-26T15:41:16.391 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:16 +0000 (0:00:00.066) 0:01:28.390 *********** 2021-07-26T15:41:16.398 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-07-26T15:41:16.400 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:16.425 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:16 +0000 (0:00:00.033) 0:01:28.424 *********** 2021-07-26T15:41:16.463 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:16.492 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:16 +0000 (0:00:00.067) 0:01:28.491 *********** 2021-07-26T15:41:16.503 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-07-26T15:41:16.504 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:41:16.533 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:16 +0000 (0:00:00.038) 0:01:28.530 *********** 2021-07-26T15:41:16.560 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-07-26T15:41:16.591 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:16 +0000 (0:00:00.056) 0:01:28.587 *********** 2021-07-26T15:41:16.608 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-07-26T15:41:16.610 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:16.633 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:16 +0000 (0:00:00.046) 0:01:28.633 *********** 2021-07-26T15:41:16.662 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:16.693 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:16 +0000 (0:00:00.056) 0:01:28.689 *********** 2021-07-26T15:41:17.064 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-07-26T15:41:17.066 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-07-26T15:41:17.090 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.399) 0:01:29.089 *********** 2021-07-26T15:41:17.101 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-07-26T15:41:17.125 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.033) 0:01:29.123 *********** 2021-07-26T15:41:17.352 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-07-26T15:41:17.354 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:39:39 UTC", "ActiveEnterTimestampMonotonic": "15981445", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "remote-fs.target basic.target system.slice nss-lookup.target systemd-journald.socket time-sync.target local-fs.target systemd-tmpfiles-setup.service network.target sysinit.target -.mount var-run.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:39:39 UTC", "AssertTimestampMonotonic": "15980051", "Before": "shutdown.target plymouth-quit.service getty@tty1.service xdm.service multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:39:39 UTC", "Co 2021-07-26T15:41:17.355 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "15980050", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "892", "ExecMainStartTimestamp": "Mon 2021-07-26 15:39:39 UTC", "ExecMainStartTimestampMonotonic": "15981283", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:39:39 UTC] ; stop_time=[n/a] ; pid=892 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-07-26 15:39:39 UTC] ; stop_time=[n/a] ; pid=892 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-07-26T15:41:17.357 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:39:39 UTC", "InactiveExitTimestampMonotonic": "15981445", "InvocationID": "3d1c7eb5d5134f4bb96b8399d48fd3b1", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "892", "MemoryAccounting": "yes", "MemoryCurrent": "1331200", "MemoryD 2021-07-26T15:41:17.359 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:39:39 UTC", "StateChangeTimestampMonotonic": "15981445", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-07-26T15:41:17.360 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38333", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:41:17.388 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.262) 0:01:29.386 *********** 2021-07-26T15:41:17.410 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:39:35 UTC", "ActiveEnterTimestampMonotonic": "14722715", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "var-run.mount systemd-journald.socket local-fs.target time-sync.target system.slice sysinit.target nss-lookup.target systemd-tmpfiles-setup.service remote-fs.target network.target basic.target -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:39:35 UTC", "AssertTimestampMonotonic": "14708267", "Before": "getty@tty1.service shutdown.target multi-user.target xdm.service plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:39:35 UTC", "Co 2021-07-26T15:41:17.411 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "14708266", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "875", "ExecMainStartTimestamp": "Mon 2021-07-26 15:39:35 UTC", "ExecMainStartTimestampMonotonic": "14722589", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:39:35 UTC] ; stop_time=[n/a] ; pid=875 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Mon 2021-07-26 15:39:35 UTC] ; stop_time=[n/a] ; pid=875 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-07-26T15:41:17.413 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:39:35 UTC", "InactiveExitTimestampMonotonic": "14722715", "InvocationID": "6129628097d14afabd0ae8d12f01c25f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127778", "LimitNPROCSoft": "127778", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127778", "LimitSIGPENDINGSoft": "127778", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "875", "MemoryAccounting": "yes", "MemoryCurrent": "1314816", "MemoryD 2021-07-26T15:41:17.417 INFO:teuthology.task.ansible.out:enyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:39:35 UTC", "StateChangeTimestampMonotonic": "14722715", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no" 2021-07-26T15:41:17.418 INFO:teuthology.task.ansible.out:, "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38333", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:41:17.445 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.058) 0:01:29.444 *********** 2021-07-26T15:41:17.466 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:17.516 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.071) 0:01:29.515 *********** 2021-07-26T15:41:17.543 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:17.559 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.042) 0:01:29.558 *********** 2021-07-26T15:41:17.588 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:17.613 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.054) 0:01:29.612 *********** 2021-07-26T15:41:17.640 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:17.657 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.044) 0:01:29.657 *********** 2021-07-26T15:41:17.685 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-07-26T15:41:17.687 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:17.712 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.054) 0:01:29.712 *********** 2021-07-26T15:41:17.745 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:17.770 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.057) 0:01:29.769 *********** 2021-07-26T15:41:17.794 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:17.816 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.045) 0:01:29.815 *********** 2021-07-26T15:41:17.845 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:17.875 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.059) 0:01:29.875 *********** 2021-07-26T15:41:17.893 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:17.918 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.042) 0:01:29.918 *********** 2021-07-26T15:41:17.948 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:17.986 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:17 +0000 (0:00:00.067) 0:01:29.985 *********** 2021-07-26T15:41:18.004 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-07-26T15:41:18.006 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:18.049 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.062) 0:01:30.048 *********** 2021-07-26T15:41:18.081 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:18.100 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.048) 0:01:30.097 *********** 2021-07-26T15:41:18.122 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-07-26T15:41:18.124 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:18.153 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.054) 0:01:30.152 *********** 2021-07-26T15:41:18.181 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:18.208 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.053) 0:01:30.205 *********** 2021-07-26T15:41:18.232 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:18.267 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.051) 0:01:30.257 *********** 2021-07-26T15:41:18.303 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:18.330 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.071) 0:01:30.328 *********** 2021-07-26T15:41:18.363 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:18.378 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.047) 0:01:30.376 *********** 2021-07-26T15:41:18.420 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:18.447 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.068) 0:01:30.444 *********** 2021-07-26T15:41:18.471 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:18.492 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.043) 0:01:30.488 *********** 2021-07-26T15:41:18.530 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:18.564 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.075) 0:01:30.563 *********** 2021-07-26T15:41:18.572 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-07-26T15:41:18.573 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:41:18.600 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.036) 0:01:30.600 *********** 2021-07-26T15:41:18.640 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-07-26T15:41:18.672 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.071) 0:01:30.671 *********** 2021-07-26T15:41:18.690 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-07-26T15:41:18.693 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-07-26T15:41:18.718 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.046) 0:01:30.718 *********** 2021-07-26T15:41:18.749 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "no_recommended_packages": ["collectl"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-07-26T15:41:18.777 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.058) 0:01:30.776 *********** 2021-07-26T15:41:18.805 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-07-26T15:41:18.806 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-07-26T15:41:18.832 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.053) 0:01:30.830 *********** 2021-07-26T15:41:18.860 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-07-26T15:41:18.885 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.054) 0:01:30.884 *********** 2021-07-26T15:41:18.913 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-07-26T15:41:18.943 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.057) 0:01:30.942 *********** 2021-07-26T15:41:18.961 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-07-26T15:41:18.989 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:18 +0000 (0:00:00.044) 0:01:30.986 *********** 2021-07-26T15:41:19.081 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-07-26T15:41:19.083 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:41:19.106 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:19 +0000 (0:00:00.118) 0:01:31.105 *********** 2021-07-26T15:41:19.139 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-07-26T15:41:19.164 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:19 +0000 (0:00:00.057) 0:01:31.162 *********** 2021-07-26T15:41:19.298 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-07-26T15:41:19.323 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:19 +0000 (0:00:00.159) 0:01:31.322 *********** 2021-07-26T15:41:19.363 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-07-26T15:41:19.386 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:19 +0000 (0:00:00.063) 0:01:31.386 *********** 2021-07-26T15:41:19.405 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-07-26T15:41:19.407 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:19.438 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:19 +0000 (0:00:00.047) 0:01:31.433 *********** 2021-07-26T15:41:19.465 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:19.497 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:19 +0000 (0:00:00.061) 0:01:31.495 *********** 2021-07-26T15:41:19.518 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:19.544 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:19 +0000 (0:00:00.048) 0:01:31.543 *********** 2021-07-26T15:41:19.574 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:19.598 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:19 +0000 (0:00:00.053) 0:01:31.596 *********** 2021-07-26T15:41:19.756 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-07-26T15:41:19.758 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-07-26T15:41:19.782 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:19 +0000 (0:00:00.183) 0:01:31.780 *********** 2021-07-26T15:41:19.811 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-07-26T15:41:19.850 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:19 +0000 (0:00:00.053) 0:01:31.834 *********** 2021-07-26T15:41:20.269 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-07-26T15:41:20.292 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:20 +0000 (0:00:00.456) 0:01:32.291 *********** 2021-07-26T15:41:20.311 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-07-26T15:41:20.347 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:20 +0000 (0:00:00.055) 0:01:32.347 *********** 2021-07-26T15:41:20.349 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:20.377 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-07-26T15:41:20.379 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi087"}, "changed": false} 2021-07-26T15:41:20.402 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:20 +0000 (0:00:00.054) 0:01:32.402 *********** 2021-07-26T15:41:20.444 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi067"}, "changed": false} 2021-07-26T15:41:20.469 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:20 +0000 (0:00:00.066) 0:01:32.468 *********** 2021-07-26T15:41:21.288 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ changed: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi087.front.sepia.ceph.com", "ansible_hostname": "smithi087", "ansible_nodename": "smithi087"}, "changed": true, "name": "smithi087"} 2021-07-26T15:41:21.315 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:21 +0000 (0:00:00.845) 0:01:33.314 *********** 2021-07-26T15:41:21.343 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi067.front.sepia.ceph.com", "ansible_hostname": "smithi067", "ansible_nodename": "smithi067"}, "changed": true, "name": "smithi067"} 2021-07-26T15:41:21.370 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:21 +0000 (0:00:00.055) 0:01:33.369 *********** 2021-07-26T15:41:21.694 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-07-26T15:41:21.717 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:21 +0000 (0:00:00.347) 0:01:33.717 *********** 2021-07-26T15:41:21.768 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-07-26T15:41:21.801 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:21 +0000 (0:00:00.077) 0:01:33.794 *********** 2021-07-26T15:41:22.100 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-07-26T15:41:22.102 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-07-26T15:41:22.126 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:22 +0000 (0:00:00.331) 0:01:34.125 *********** 2021-07-26T15:41:22.178 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-07-26T15:41:22.203 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:22 +0000 (0:00:00.075) 0:01:34.201 *********** 2021-07-26T15:41:22.615 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-07-26T15:41:22.617 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-07-26T15:41:22.639 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:22 +0000 (0:00:00.437) 0:01:34.638 *********** 2021-07-26T15:41:22.641 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:22.690 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-07-26T15:41:22.714 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:22 +0000 (0:00:00.075) 0:01:34.713 *********** 2021-07-26T15:41:22.721 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-07-26T15:41:22.723 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:22.746 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:22 +0000 (0:00:00.032) 0:01:34.746 *********** 2021-07-26T15:41:22.787 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:22.820 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:22 +0000 (0:00:00.073) 0:01:34.819 *********** 2021-07-26T15:41:22.836 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-07-26T15:41:22.839 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:22.867 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:22 +0000 (0:00:00.047) 0:01:34.866 *********** 2021-07-26T15:41:22.920 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:22.952 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:22 +0000 (0:00:00.078) 0:01:34.945 *********** 2021-07-26T15:41:22.958 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:22.981 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:22 +0000 (0:00:00.035) 0:01:34.981 *********** 2021-07-26T15:41:23.031 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.046 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.064) 0:01:35.045 *********** 2021-07-26T15:41:23.055 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.082 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.035) 0:01:35.080 *********** 2021-07-26T15:41:23.113 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.139 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.057) 0:01:35.138 *********** 2021-07-26T15:41:23.156 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-07-26T15:41:23.158 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.181 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.042) 0:01:35.180 *********** 2021-07-26T15:41:23.209 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.233 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.051) 0:01:35.232 *********** 2021-07-26T15:41:23.252 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:41:23.254 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.285 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.051) 0:01:35.284 *********** 2021-07-26T15:41:23.305 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.331 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.045) 0:01:35.330 *********** 2021-07-26T15:41:23.360 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-07-26T15:41:23.362 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.386 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.055) 0:01:35.385 *********** 2021-07-26T15:41:23.404 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.433 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.046) 0:01:35.432 *********** 2021-07-26T15:41:23.461 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-07-26T15:41:23.463 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.487 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.054) 0:01:35.486 *********** 2021-07-26T15:41:23.507 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.537 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.050) 0:01:35.536 *********** 2021-07-26T15:41:23.566 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:41:23.567 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.592 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.054) 0:01:35.591 *********** 2021-07-26T15:41:23.609 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.638 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.043) 0:01:35.634 *********** 2021-07-26T15:41:23.676 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-07-26T15:41:23.678 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.703 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.067) 0:01:35.702 *********** 2021-07-26T15:41:23.724 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.749 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.045) 0:01:35.748 *********** 2021-07-26T15:41:23.779 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-07-26T15:41:23.781 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.806 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.057) 0:01:35.805 *********** 2021-07-26T15:41:23.824 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:23.850 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.043) 0:01:35.849 *********** 2021-07-26T15:41:23.878 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-07-26T15:41:23.904 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.053) 0:01:35.902 *********** 2021-07-26T15:41:23.947 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:23 +0000 (0:00:00.042) 0:01:35.944 *********** 2021-07-26T15:41:23.977 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-07-26T15:41:24.004 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.057) 0:01:36.002 *********** 2021-07-26T15:41:24.065 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.057) 0:01:36.060 *********** 2021-07-26T15:41:24.080 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-07-26T15:41:24.107 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.045) 0:01:36.106 *********** 2021-07-26T15:41:24.185 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.078) 0:01:36.184 *********** 2021-07-26T15:41:24.195 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.218 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.033) 0:01:36.217 *********** 2021-07-26T15:41:24.251 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.279 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.060) 0:01:36.278 *********** 2021-07-26T15:41:24.297 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.309 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.338 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.055) 0:01:36.333 *********** 2021-07-26T15:41:24.353 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.364 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.392 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.057) 0:01:36.391 *********** 2021-07-26T15:41:24.433 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.458 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.066) 0:01:36.457 *********** 2021-07-26T15:41:24.476 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.516 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.058) 0:01:36.515 *********** 2021-07-26T15:41:24.534 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:41:24.536 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.562 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.045) 0:01:36.561 *********** 2021-07-26T15:41:24.591 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.615 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.053) 0:01:36.614 *********** 2021-07-26T15:41:24.644 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:24.645 INFO:teuthology.task.ansible.out:TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-07-26T15:41:24.646 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.672 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.057) 0:01:36.672 *********** 2021-07-26T15:41:24.676 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:24.695 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.733 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.059) 0:01:36.731 *********** 2021-07-26T15:41:24.751 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.781 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.047) 0:01:36.779 *********** 2021-07-26T15:41:24.801 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.838 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.055) 0:01:36.835 *********** 2021-07-26T15:41:24.860 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.884 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.047) 0:01:36.883 *********** 2021-07-26T15:41:24.916 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.941 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.057) 0:01:36.940 *********** 2021-07-26T15:41:24.962 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:24.986 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:24 +0000 (0:00:00.045) 0:01:36.985 *********** 2021-07-26T15:41:24.988 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:25.020 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.048 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.061) 0:01:37.047 *********** 2021-07-26T15:41:25.068 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-07-26T15:41:25.070 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.097 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.048) 0:01:37.096 *********** 2021-07-26T15:41:25.125 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.156 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.058) 0:01:37.154 *********** 2021-07-26T15:41:25.173 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:41:25.176 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.198 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.043) 0:01:37.197 *********** 2021-07-26T15:41:25.237 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.261 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.063) 0:01:37.261 *********** 2021-07-26T15:41:25.279 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:41:25.281 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.303 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.041) 0:01:37.303 *********** 2021-07-26T15:41:25.342 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.365 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.061) 0:01:37.364 *********** 2021-07-26T15:41:25.387 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.413 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.045) 0:01:37.409 *********** 2021-07-26T15:41:25.439 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.465 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.055) 0:01:37.465 *********** 2021-07-26T15:41:25.483 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.510 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.042) 0:01:37.507 *********** 2021-07-26T15:41:25.540 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.569 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.061) 0:01:37.568 *********** 2021-07-26T15:41:25.587 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:41:25.589 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.618 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.047) 0:01:37.616 *********** 2021-07-26T15:41:25.642 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.667 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.050) 0:01:37.666 *********** 2021-07-26T15:41:25.706 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-07-26T15:41:25.708 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.735 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.067) 0:01:37.734 *********** 2021-07-26T15:41:25.737 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:25.754 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.779 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.044) 0:01:37.779 *********** 2021-07-26T15:41:25.813 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.848 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.065) 0:01:37.844 *********** 2021-07-26T15:41:25.866 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.896 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.051) 0:01:37.895 *********** 2021-07-26T15:41:25.920 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.948 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.051) 0:01:37.947 *********** 2021-07-26T15:41:25.969 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:25.970 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:25.998 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:25 +0000 (0:00:00.050) 0:01:37.997 *********** 2021-07-26T15:41:26.027 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:26.052 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.054) 0:01:38.051 *********** 2021-07-26T15:41:26.071 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:26.100 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.044) 0:01:38.096 *********** 2021-07-26T15:41:26.127 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:26.157 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.058) 0:01:38.154 *********** 2021-07-26T15:41:26.172 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:26.198 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.042) 0:01:38.197 *********** 2021-07-26T15:41:26.226 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:26.251 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.053) 0:01:38.250 *********** 2021-07-26T15:41:26.268 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:26.296 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.042) 0:01:38.293 *********** 2021-07-26T15:41:26.322 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-07-26T15:41:26.324 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:26.348 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.053) 0:01:38.347 *********** 2021-07-26T15:41:26.371 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:26.394 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.046) 0:01:38.393 *********** 2021-07-26T15:41:26.423 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-07-26T15:41:26.425 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:26.448 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.054) 0:01:38.447 *********** 2021-07-26T15:41:26.478 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:26.499 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.051) 0:01:38.499 *********** 2021-07-26T15:41:26.646 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005451", "end": "2021-07-26 15:41:26.320976", "rc": 0, "start": "2021-07-26 15:41:26.315525", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:26.673 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.173) 0:01:38.672 *********** 2021-07-26T15:41:26.702 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.003563", "end": "2021-07-26 15:41:26.390727", "rc": 0, "start": "2021-07-26 15:41:26.387164", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:26.739 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.061) 0:01:38.734 *********** 2021-07-26T15:41:26.755 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-07-26T15:41:26.782 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.047) 0:01:38.781 *********** 2021-07-26T15:41:26.830 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:26 +0000 (0:00:00.045) 0:01:38.827 *********** 2021-07-26T15:41:27.199 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-07-26T15:41:27.201 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-07-26T15:41:27.234 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:27 +0000 (0:00:00.406) 0:01:39.233 *********** 2021-07-26T15:41:27.277 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-07-26T15:41:27.320 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:27 +0000 (0:00:00.083) 0:01:39.317 *********** 2021-07-26T15:41:27.330 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:27.358 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:27 +0000 (0:00:00.039) 0:01:39.357 *********** 2021-07-26T15:41:27.413 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:41:27.452 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:27 +0000 (0:00:00.093) 0:01:39.451 *********** 2021-07-26T15:41:28.812 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* ok: [smithi087.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-07-26T15:41:28.836 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-07-26T15:41:29.770 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-07-26T15:41:29.794 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:29 +0000 (0:00:02.336) 0:01:41.788 *********** 2021-07-26T15:41:29.822 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-07-26T15:41:29.860 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:29 +0000 (0:00:00.071) 0:01:41.860 *********** 2021-07-26T15:41:30.514 INFO:teuthology.task.ansible.out: 2021-07-26T15:41:30.516 INFO:teuthology.task.ansible.out:TASK [testnode : Install python-apt] ******************************************* ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:41:30.541 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:30 +0000 (0:00:00.680) 0:01:42.540 *********** 2021-07-26T15:41:30.582 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:41:30.608 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:30 +0000 (0:00:00.067) 0:01:42.607 *********** 2021-07-26T15:41:30.752 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-07-26T15:41:30.789 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:30 +0000 (0:00:00.179) 0:01:42.787 *********** 2021-07-26T15:41:30.858 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:30 +0000 (0:00:00.069) 0:01:42.857 *********** 2021-07-26T15:41:31.177 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** [WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.033732", "end": "2021-07-26 15:41:30.842269", "rc": 0, "start": "2021-07-26 15:41:30.808537", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:31.202 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:31 +0000 (0:00:00.344) 0:01:43.201 *********** 2021-07-26T15:41:31.315 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.090629", "end": "2021-07-26 15:41:30.995780", "rc": 0, "start": "2021-07-26 15:41:30.905151", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:41:31.347 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:31 +0000 (0:00:00.141) 0:01:43.343 *********** 2021-07-26T15:41:33.523 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-07-26T15:41:33.525 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:41:33.547 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:33 +0000 (0:00:02.202) 0:01:45.545 *********** 2021-07-26T15:41:33.737 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:41:33.762 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:33 +0000 (0:00:00.215) 0:01:45.761 *********** 2021-07-26T15:41:44.598 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-07-26T15:41:44.601 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r 2021-07-26T15:41:44.602 INFO:teuthology.task.ansible.out:\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-07-26T15:41:44.604 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:41:44.627 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:44 +0000 (0:00:10.865) 0:01:56.626 *********** 2021-07-26T15:41:45.410 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.\nAfter this operation, 62.7 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r 2021-07-26T15:41:45.413 INFO:teuthology.task.ansible.out:\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-utils (1:4.2-3ubuntu6.14) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...\r\nRemoving librbd1 (15.2.8-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.8-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 154 not upgraded.", "After this operation, 62.7 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Re 2021-07-26T15:41:45.416 INFO:teuthology.task.ansible.out:ading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Removing qemu-system-x86 (1:4.2-3ubuntu6.14) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.14) ...", "Removing qemu-utils (1:4.2-3ubuntu6.14) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.14) ...", "Removing librbd1 (15.2.8-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.8-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:41:45.450 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:41:45 +0000 (0:00:00.814) 0:01:57.441 *********** 2021-07-26T15:42:09.288 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:42:09.293 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.\nNeed to get 3866 kB of archives.\nAfter this operation, 42.0 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]\n 2021-07-26T15:42:09.297 INFO:teuthology.task.ansible.out:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB]\nFetched 3866 kB in 1s (4075 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../archives/apt_2.0.6_amd64.deb ...\r\nUnpacking apt (2.0.6 2021-07-26T15:42:09.299 INFO:teuthology.task.ansible.out:) over (2.0.4) ...\r\nSetting up apt (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.6_amd64.deb ...\r\nUnpacking apt-utils (2.0.6) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.4) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer re 2021-07-26T15:42:09.301 INFO:teuthology.task.ansible.out:quired:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.", "Need to get 3866 kB of archives.", "After this operation, 42.0 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB] 2021-07-26T15:42:09.302 INFO:teuthology.task.ansible.out:", "Fetched 3866 kB in 1s (4075 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading d 2021-07-26T15:42:09.303 INFO:teuthology.task.ansible.out:atabase ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.6_amd64.deb ...", "Unpacking apt (2.0.6) over (2.0.4) ...", "Setting up apt (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading dat 2021-07-26T15:42:09.304 INFO:teuthology.task.ansible.out:abase ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.6_amd64.deb ...", "Unpacking apt-utils (2.0.6) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.4) ...", "Setting up apache2-data (2.4.41-4ubuntu3.4) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.4) ...", "Setting up apache2 (2.4.41-4ubuntu3.4) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:42:09.331 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:09 +0000 (0:00:23.888) 0:02:21.329 *********** 2021-07-26T15:42:09.418 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:09.441 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:09 +0000 (0:00:00.109) 0:02:21.439 *********** 2021-07-26T15:42:11.215 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* changed: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good\n gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1\n libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0\n libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0\n libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0\n libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla\n libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0\n libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf\n qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following additional packages will be installed:\n apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0\nSuggested packages:\n apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser\n apt-doc aptitude | synaptic | wajig\nThe following packages will be upgraded:\n apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0\n7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.\nNeed to get 3866 kB of archives.\nAfter this operation, 42.0 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]\nGet:3 http:/ 2021-07-26T15:42:11.223 INFO:teuthology.task.ansible.out:/archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB]\nFetched 3866 kB in 1s (4126 kB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...\r\nUnpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...\r\nSetting up libapt-pkg6.0:amd64 (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.) 2021-07-26T15:42:11.229 INFO:teuthology.task.ansible.out:\r\nPreparing to unpack .../archives/apt_2.0.6_amd64.deb ...\r\nUnpacking apt (2.0.6) over (2.0.4) ...\r\nSetting up apt (2.0.6) ...\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../apt-utils_2.0.6_amd64.deb ...\r\nUnpacking apt-utils (2.0.6) over (2.0.4) ...\r\nPreparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...\r\nUnpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nPreparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...\r\nUnpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...\r\nSetting up apt-utils (2.0.6) ...\r\nSetting up apache2-bin (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-data (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2-utils (2.4.41-4ubuntu3.4) ...\r\nSetting up apache2 (2.4.41-4ubuntu3.4) ...\r\nProcessing triggers for ufw (0.36-6) ...\r\nProcessing triggers for systemd (245.4-4ubuntu3.4) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state inform 2021-07-26T15:42:11.234 INFO:teuthology.task.ansible.out:ation...", "The following packages were automatically installed and are no longer required:", " cpu-checker gstreamer1.0-plugins-base gstreamer1.0-plugins-good", " gstreamer1.0-x ipxe-qemu ipxe-qemu-256k-compat-efi-roms libaa1", " libboost-iostreams1.71.0 libboost-thread1.71.0 libbrlapi0.7 libcacard0", " libcdparanoia0 libdv4 libgbm1 libgstreamer-plugins-base1.0-0", " libgstreamer-plugins-good1.0-0 libgudev-1.0-0 libiscsi7 liborc-0.4-0", " libpmem1 libshout3 libslirp0 libspice-server1 libtag1v5 libtag1v5-vanilla", " libusbredirparser1 libv4l-0 libv4lconvert0 libvirglrenderer1 libvisual-0.4-0", " libvte-2.91-0 libvte-2.91-common libwayland-server0 msr-tools ovmf", " qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following additional packages will be installed:", " apache2-bin apache2-data apache2-utils apt-utils libapt-pkg6.0", "Suggested packages:", " apache2-doc apache2-suexec-pristine | apache2-suexec-custom www-browser", " apt-doc aptitude | synaptic | wajig", "The following packages will be upgraded:", " apache2 apache2-bin apache2-data apache2-utils apt apt-utils libapt-pkg6.0", "7 upgraded, 0 newly installed, 0 to remove and 147 not upgraded.", "Need to get 3866 kB of archives.", "After this operation, 42.0 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libapt-pkg6.0 amd64 2.0.6 [835 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt amd64 2.0.6 [1296 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apt-utils amd64 2.0.6 [216 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2 amd64 2.4.41-4ubuntu3.4 [95.5 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-bin amd64 2.4.41-4ubuntu3.4 [1180 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 apache2-data all 2.4.41-4ubuntu3.4 [159 kB]", "Get:7 http://archive.ubuntu 2021-07-26T15:42:11.238 INFO:teuthology.task.ansible.out:.com/ubuntu focal-updates/main amd64 apache2-utils amd64 2.4.41-4ubuntu3.4 [84.0 kB]", "Fetched 3866 kB in 1s (4126 kB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../libapt-pkg6.0_2.0.6_amd64.deb ...", "Unpacking libapt-pkg6.0:amd64 (2.0.6) over (2.0.4) ...", "Setting up libapt-pkg6.0:amd64 (2.0.6) ...", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../archives/apt_2.0.6_amd64.deb ...", "Unpacking apt (2.0.6) over (2.0.4) ...", "Setting up apt (2.0.6) ...", "(Reading database ... ", "( 2021-07-26T15:42:11.239 INFO:teuthology.task.ansible.out:Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading databa 2021-07-26T15:42:11.246 INFO:teuthology.task.ansible.out:se ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../apt-utils_2.0.6_amd64.deb ...", "Unpacking apt-utils (2.0.6) over (2.0.4) ...", "Preparing to unpack .../apache2_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2 (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-bin_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-bin (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-data_2.4.41-4ubuntu3.4_all.deb ...", "Unpacking apache2-data (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Preparing to unpack .../apache2-utils_2.4.41-4ubuntu3.4_amd64.deb ...", "Unpacking apache2-utils (2.4.41-4ubuntu3.4) over (2.4.41-4ubuntu3.1) ...", "Setting up apt-utils (2.0.6) ...", "Setting up apache2-bin (2.4.41-4ubuntu3.4) ...", "Setting up apache2-data (2.4.41-4ubuntu3.4) ...", "Setting up apache2-utils (2.4.41-4ubuntu3.4) ...", "Setting up apache2 (2.4.41-4ubuntu3.4) ...", "Processing triggers for ufw (0.36-6) ...", "Processing triggers for systemd (245.4-4ubuntu3.4) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ..."]} 2021-07-26T15:42:11.266 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:01.824) 0:02:23.263 *********** 2021-07-26T15:42:11.343 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-07-26T15:42:11.345 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:11.367 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:11 +0000 (0:00:00.102) 0:02:23.366 *********** 2021-07-26T15:42:23.092 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:42:23.093 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-07-26T15:42:23.100 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.17 [6738 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]\nFetched 18.8 MB in 1s (14.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-07-26T15:42:23.102 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.17) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-07-26T15:42:23.104 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]", "Fetched 18.8 MB in 1s (14.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb . 2021-07-26T15:42:23.116 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.17) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.17) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing 2021-07-26T15:42:23.118 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-07-26T15:42:23.121 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:23 +0000 (0:00:11.753) 0:02:35.120 *********** 2021-07-26T15:42:23.849 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:42:23.872 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:23 +0000 (0:00:00.751) 0:02:35.871 *********** 2021-07-26T15:42:24.594 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-07-26T15:42:24.596 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:42:24.620 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:24 +0000 (0:00:00.747) 0:02:36.619 *********** 2021-07-26T15:42:24.821 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-07-26T15:42:24.846 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:24 +0000 (0:00:00.223) 0:02:36.843 *********** 2021-07-26T15:42:24.965 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:25.000 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:24 +0000 (0:00:00.155) 0:02:36.999 *********** 2021-07-26T15:42:25.196 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-07-26T15:42:25.221 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.219) 0:02:37.218 *********** 2021-07-26T15:42:25.429 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:42:25.430 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data\n qemu-system-gui qemu-utils\nSuggested packages:\n git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk\n gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\nThe following packages will be upgraded:\n git qemu-system-data qemu-system-gui\n3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.\nNeed to get 18.8 MB of archives.\nAfter this operation, 62.7 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]\nGet:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]\nGet:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x 2021-07-26T15:42:25.433 INFO:teuthology.task.ansible.out:86 amd64 1:4.2-3ubuntu6.17 [6738 kB]\nGet:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]\nFetched 18.8 MB in 1s (14.1 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138039 files and directories currently installed.)\r\nPreparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...\r\nUnpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...\r\nSelecting previously unselected package librados2.\r\nPreparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...\r\nUnpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nPreparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...\r\nUnpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nPreparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-gui:amd64 2021-07-26T15:42:25.435 INFO:teuthology.task.ansible.out: (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.17) ...\r\nSetting up librados2 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up git (1:2.25.1-1ubuntu3.1) ...\r\nSetting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...\r\nSetting up qemu-system-data (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.17) ...\r\nProcessing triggers for hicolor-icon-theme (0.17-2) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.2) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for mime-support (3.64ubuntu1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-data", " qemu-system-gui qemu-utils", "Suggested packages:", " git-daemon-run | git-daemon-sysvinit git-doc git-el git-email git-gui gitk", " gitweb git-cvs git-mediawiki git-svn samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "The following packages will be upgraded:", " git qemu-system-data qemu-system-gui", "3 upgraded, 6 newly installed, 0 to remove and 144 not upgraded.", "Need to get 18.8 MB of archives.", "After this operation, 62.7 MB of additional disk space will be used.", "Get:1 http://archive. 2021-07-26T15:42:25.436 INFO:teuthology.task.ansible.out:ubuntu.com/ubuntu focal-updates/main amd64 git amd64 1:2.25.1-1ubuntu3.1 [4557 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.13-0ubuntu0.20.04.1 [3212 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.13-0ubuntu0.20.04.1 [1623 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.17 [54.4 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.17 [1055 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-data all 1:4.2-3ubuntu6.17 [563 kB]", "Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-gui amd64 1:4.2-3ubuntu6.17 [41.2 kB]", "Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.17 [6738 kB]", "Get:9 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.17 [973 kB]", "Fetched 18.8 MB in 1s (14.1 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138039 files and directories currently installed.)", "Preparing to unpack .../0-git_1%3a2.25.1-1ubuntu3.1_amd64.deb ...", "Unpacking git (1:2.25.1-1ubuntu3.1) over (1:2.25.1-1ubuntu3) ...", "Selecting previously unselected package librados2.", "Preparing to unpack .../1-librados2_15.2.13-0ubuntu0.20.04.1_amd64.deb . 2021-07-26T15:42:25.438 INFO:teuthology.task.ansible.out:..", "Unpacking librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../2-librbd1_15.2.13-0ubuntu0.20.04.1_amd64.deb ...", "Unpacking librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../3-qemu-block-extra_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../4-qemu-system-common_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.17) ...", "Preparing to unpack .../5-qemu-system-data_1%3a4.2-3ubuntu6.17_all.deb ...", "Unpacking qemu-system-data (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Preparing to unpack .../6-qemu-system-gui_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) over (1:4.2-3ubuntu6.14) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../7-qemu-system-x86_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../8-qemu-utils_1%3a4.2-3ubuntu6.17_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.17) ...", "Setting up librados2 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-gui:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up git (1:2.25.1-1ubuntu3.1) ...", "Setting up librbd1 (15.2.13-0ubuntu0.20.04.1) ...", "Setting up qemu-system-data (1:4.2-3ubuntu6.17) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.17) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.17) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.17) ...", "Processing triggers for hicolor-icon-theme (0.17-2) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.2) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing 2021-07-26T15:42:25.440 INFO:teuthology.task.ansible.out: triggers for mime-support (3.64ubuntu1) ..."]} 2021-07-26T15:42:25.457 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.238) 0:02:37.456 *********** 2021-07-26T15:42:25.640 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-07-26T15:42:25.642 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-07-26T15:42:25.665 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.208) 0:02:37.665 *********** 2021-07-26T15:42:25.891 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-07-26T15:42:25.893 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-07-26T15:42:25.917 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:25 +0000 (0:00:00.250) 0:02:37.915 *********** 2021-07-26T15:42:26.106 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:26.129 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.212) 0:02:38.128 *********** 2021-07-26T15:42:26.188 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-07-26T15:42:26.190 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:42:26.216 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.086) 0:02:38.215 *********** 2021-07-26T15:42:26.445 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-07-26T15:42:26.446 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:42:01 UTC", "ActiveEnterTimestampMonotonic": "158585543", "ActiveExitTimestamp": "Mon 2021-07-26 15:42:01 UTC", "ActiveExitTimestampMonotonic": "158502579", "ActiveState": "active", "After": "system.slice -.mount basic.target nss-lookup.target remote-fs.target network.target sysinit.target systemd-tmpfiles-setup.service systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:42:01 UTC", "AssertTimestampMonotonic": "158555200", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:42:01 UTC", "ConditionTimestampMonotonic": "158555199", "ConfigurationDirec 2021-07-26T15:42:26.448 INFO:teuthology.task.ansible.out:toryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6519", "ExecMainStartTimestamp": "Mon 2021-07-26 15:42:01 UTC", "ExecMainStartTimestampMonotonic": "158585516", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPrior 2021-07-26T15:42:26.450 INFO:teuthology.task.ansible.out:ity": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-07-26 15:42:01 UTC", "InactiveEnterTimestampMonotonic": "158553718", "InactiveExitTimestamp": "Mon 2021-07-26 15:42:01 UTC", "InactiveExitTimestampMonotonic": "158557648", "InvocationID": "ed35861d4a6341c78624d709a3180468", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6519", "MemoryAccounting": "yes", "MemoryCurrent": "6881280", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemoryS 2021-07-26T15:42:26.451 INFO:teuthology.task.ansible.out:wapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:42:01 UTC", "StateChangeTimestampMonotonic": "158585543", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", " 2021-07-26T15:42:26.453 INFO:teuthology.task.ansible.out:TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:42:26.472 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.256) 0:02:38.471 *********** 2021-07-26T15:42:26.553 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-07-26T15:42:26.555 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.580 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.107) 0:02:38.579 *********** 2021-07-26T15:42:26.662 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.688 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.107) 0:02:38.686 *********** 2021-07-26T15:42:26.759 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.784 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.097) 0:02:38.783 *********** 2021-07-26T15:42:26.868 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-07-26T15:42:26.870 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:26.907 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.122) 0:02:38.906 *********** 2021-07-26T15:42:26.968 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-07-26T15:42:26.970 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:42:26.992 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:26 +0000 (0:00:00.085) 0:02:38.992 *********** 2021-07-26T15:42:27.000 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:42:27.002 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:27.026 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.033) 0:02:39.025 *********** 2021-07-26T15:42:27.145 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-07-26T15:42:27.147 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:27.169 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.142) 0:02:39.168 *********** 2021-07-26T15:42:27.197 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-07-26T15:42:27.200 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-07-26T15:42:27.224 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.055) 0:02:39.224 *********** 2021-07-26T15:42:27.264 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-07-26T15:42:27.266 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:27.289 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.064) 0:02:39.288 *********** 2021-07-26T15:42:27.317 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:27.347 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.057) 0:02:39.346 *********** 2021-07-26T15:42:27.375 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:42:27.377 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:27.400 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.053) 0:02:39.399 *********** 2021-07-26T15:42:27.470 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:27.471 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:27.495 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.094) 0:02:39.494 *********** 2021-07-26T15:42:27.544 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-07-26T15:42:27.546 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-07-26T15:42:27.569 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.074) 0:02:39.569 *********** 2021-07-26T15:42:27.576 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-07-26T15:42:27.578 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:27.604 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.033) 0:02:39.603 *********** 2021-07-26T15:42:27.685 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:42:27.688 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:27.710 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.106) 0:02:39.709 *********** 2021-07-26T15:42:27.804 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:27.828 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.118) 0:02:39.828 *********** 2021-07-26T15:42:27.915 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:27.938 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:27 +0000 (0:00:00.109) 0:02:39.937 *********** 2021-07-26T15:42:28.013 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-07-26T15:42:28.016 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-07-26T15:42:28.048 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.109) 0:02:40.047 *********** 2021-07-26T15:42:28.058 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:42:28.060 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:28.087 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.036) 0:02:40.083 *********** 2021-07-26T15:42:28.159 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:28.160 INFO:teuthology.task.ansible.out:TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:28.186 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.099) 0:02:40.183 *********** 2021-07-26T15:42:28.254 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:28.280 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.093) 0:02:40.277 *********** 2021-07-26T15:42:28.294 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-07-26T15:42:28.296 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-07-26T15:42:28.331 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.052) 0:02:40.329 *********** 2021-07-26T15:42:28.362 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:28.394 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.063) 0:02:40.393 *********** 2021-07-26T15:42:28.472 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-07-26T15:42:28.474 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:28.496 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.102) 0:02:40.496 *********** 2021-07-26T15:42:28.549 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-07-26T15:42:28.550 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:28.575 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.079) 0:02:40.575 *********** 2021-07-26T15:42:28.587 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:28.610 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.034) 0:02:40.609 *********** 2021-07-26T15:42:28.707 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:28.730 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.119) 0:02:40.729 *********** 2021-07-26T15:42:28.810 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:42:28.812 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:28.836 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.105) 0:02:40.835 *********** 2021-07-26T15:42:28.910 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:42:03 UTC", "ActiveEnterTimestampMonotonic": "162200840", "ActiveExitTimestamp": "Mon 2021-07-26 15:42:03 UTC", "ActiveExitTimestampMonotonic": "162114366", "ActiveState": "active", "After": "nss-lookup.target basic.target -.mount system.slice network.target systemd-tmpfiles-setup.service remote-fs.target sysinit.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:42:03 UTC", "AssertTimestampMonotonic": "162166149", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021- 2021-07-26T15:42:28.911 INFO:teuthology.task.ansible.out:07-26 15:42:03 UTC", "ConditionTimestampMonotonic": "162166148", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "6531", "ExecMainStartTimestamp": "Mon 2021-07-26 15:42:03 UTC", "ExecMainStartTimestampMonotonic": "162200822", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOR 2021-07-26T15:42:28.913 INFO:teuthology.task.ansible.out:eadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestamp": "Mon 2021-07-26 15:42:03 UTC", "InactiveEnterTimestampMonotonic": "162164675", "InactiveExitTimestamp": "Mon 2021-07-26 15:42:03 UTC", "InactiveExitTimestampMonotonic": "162168637", "InvocationID": "882332ae9db64cfcbe14c2636e484cc3", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127778", "LimitNPROCSoft": "127778", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127778", "LimitSIGPENDINGSoft": "127778", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "6531", "MemoryAccounting": "yes", "MemoryCurrent": "6852608", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit 2021-07-26T15:42:28.915 INFO:teuthology.task.ansible.out:": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:42:03 UTC", "StateChangeTimestampMonotonic": "162200840", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefi 2021-07-26T15:42:28.916 INFO:teuthology.task.ansible.out:x": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:42:28.935 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.099) 0:02:40.934 *********** 2021-07-26T15:42:28.942 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:42:28.945 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:28.972 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:28 +0000 (0:00:00.034) 0:02:40.968 *********** 2021-07-26T15:42:29.018 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-07-26T15:42:29.020 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.042 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.073) 0:02:41.042 *********** 2021-07-26T15:42:29.049 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:42:29.051 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.079 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.035) 0:02:41.077 *********** 2021-07-26T15:42:29.117 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-07-26T15:42:29.119 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.146 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.068) 0:02:41.145 *********** 2021-07-26T15:42:29.165 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:42:29.166 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.191 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.044) 0:02:41.190 *********** 2021-07-26T15:42:29.219 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-07-26T15:42:29.221 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.245 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.053) 0:02:41.244 *********** 2021-07-26T15:42:29.273 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.299 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.054) 0:02:41.299 *********** 2021-07-26T15:42:29.317 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-07-26T15:42:29.319 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.345 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.044) 0:02:41.343 *********** 2021-07-26T15:42:29.372 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-07-26T15:42:29.375 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.398 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.054) 0:02:41.397 *********** 2021-07-26T15:42:29.416 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-07-26T15:42:29.418 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.442 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.044) 0:02:41.442 *********** 2021-07-26T15:42:29.514 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-07-26T15:42:29.514 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.538 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.095) 0:02:41.537 *********** 2021-07-26T15:42:29.588 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-07-26T15:42:29.590 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-07-26T15:42:29.615 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.077) 0:02:41.614 *********** 2021-07-26T15:42:29.634 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-07-26T15:42:29.636 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.659 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.043) 0:02:41.658 *********** 2021-07-26T15:42:29.751 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-07-26T15:42:29.753 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.775 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.116) 0:02:41.774 *********** 2021-07-26T15:42:29.844 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:29.846 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.868 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.092) 0:02:41.867 *********** 2021-07-26T15:42:29.947 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:29.976 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:29 +0000 (0:00:00.108) 0:02:41.975 *********** 2021-07-26T15:42:30.004 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-07-26T15:42:30.006 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-07-26T15:42:30.031 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.054) 0:02:42.030 *********** 2021-07-26T15:42:30.051 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-07-26T15:42:30.053 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.079 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.047) 0:02:42.078 *********** 2021-07-26T15:42:30.108 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-07-26T15:42:30.110 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.135 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.055) 0:02:42.134 *********** 2021-07-26T15:42:30.153 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-07-26T15:42:30.155 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.181 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.045) 0:02:42.180 *********** 2021-07-26T15:42:30.264 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.287 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.106) 0:02:42.287 *********** 2021-07-26T15:42:30.359 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:42:30.361 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.382 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.094) 0:02:42.381 *********** 2021-07-26T15:42:30.452 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.475 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.093) 0:02:42.475 *********** 2021-07-26T15:42:30.525 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-07-26T15:42:30.526 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-07-26T15:42:30.549 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.073) 0:02:42.549 *********** 2021-07-26T15:42:30.566 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-07-26T15:42:30.568 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.591 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.041) 0:02:42.590 *********** 2021-07-26T15:42:30.679 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.702 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.108) 0:02:42.699 *********** 2021-07-26T15:42:30.772 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.798 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.098) 0:02:42.798 *********** 2021-07-26T15:42:30.880 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:30.911 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.112) 0:02:42.910 *********** 2021-07-26T15:42:30.941 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-07-26T15:42:30.970 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:30 +0000 (0:00:00.058) 0:02:42.968 *********** 2021-07-26T15:42:30.988 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:42:30.990 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.015 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.046) 0:02:43.015 *********** 2021-07-26T15:42:31.087 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:31.089 INFO:teuthology.task.ansible.out:TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.113 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.097) 0:02:43.112 *********** 2021-07-26T15:42:31.208 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.237 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.124) 0:02:43.236 *********** 2021-07-26T15:42:31.332 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-07-26T15:42:31.334 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.359 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.121) 0:02:43.358 *********** 2021-07-26T15:42:31.360 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:31.389 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-07-26T15:42:31.416 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.056) 0:02:43.415 *********** 2021-07-26T15:42:31.435 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-07-26T15:42:31.438 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.463 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.047) 0:02:43.462 *********** 2021-07-26T15:42:31.544 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.568 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.104) 0:02:43.567 *********** 2021-07-26T15:42:31.606 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-07-26T15:42:31.608 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:31.632 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.064) 0:02:43.631 *********** 2021-07-26T15:42:31.650 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.675 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.042) 0:02:43.674 *********** 2021-07-26T15:42:31.714 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-07-26T15:42:31.715 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.740 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.064) 0:02:43.738 *********** 2021-07-26T15:42:31.812 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-07-26T15:42:31.814 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.841 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.101) 0:02:43.840 *********** 2021-07-26T15:42:31.871 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-07-26T15:42:31.872 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-07-26T15:42:31.896 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.055) 0:02:43.895 *********** 2021-07-26T15:42:31.916 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-07-26T15:42:31.917 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:31.943 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:31 +0000 (0:00:00.046) 0:02:43.942 *********** 2021-07-26T15:42:32.026 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:32.028 INFO:teuthology.task.ansible.out:TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.052 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.108) 0:02:44.051 *********** 2021-07-26T15:42:32.129 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.151 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.100) 0:02:44.151 *********** 2021-07-26T15:42:32.226 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-07-26T15:42:32.247 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.094) 0:02:44.246 *********** 2021-07-26T15:42:32.297 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-07-26T15:42:32.299 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-07-26T15:42:32.328 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.081) 0:02:44.327 *********** 2021-07-26T15:42:32.349 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-07-26T15:42:32.351 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.362 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.404 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.419 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.423 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.452 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.454 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} skipping: [smithi087.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.454 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.456 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi087.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.457 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.483 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.155) 0:02:44.482 *********** 2021-07-26T15:42:32.491 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.525 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.040) 0:02:44.523 *********** 2021-07-26T15:42:32.804 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-07-26T15:42:32.807 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.007501", "end": "2021-07-26 15:42:32.778400", "rc": 0, "start": "2021-07-26 15:42:32.770899", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock"]} 2021-07-26T15:42:32.832 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.307) 0:02:44.831 *********** 2021-07-26T15:42:32.905 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-07-26T15:42:32.907 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:32.932 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.097) 0:02:44.929 *********** 2021-07-26T15:42:32.974 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:32 +0000 (0:00:00.042) 0:02:44.972 *********** 2021-07-26T15:42:33.044 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-07-26T15:42:33.046 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:33.070 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.096) 0:02:45.068 *********** 2021-07-26T15:42:33.138 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-07-26T15:42:33.140 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:33.164 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.094) 0:02:45.163 *********** 2021-07-26T15:42:33.329 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-07-26T15:42:33.353 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.189) 0:02:45.352 *********** 2021-07-26T15:42:33.740 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-07-26T15:42:33.742 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-07-26T15:42:33.764 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.411) 0:02:45.763 *********** 2021-07-26T15:42:33.889 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-07-26T15:42:33.891 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:42:33.914 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.149) 0:02:45.913 *********** 2021-07-26T15:42:33.956 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-07-26T15:42:33.958 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:33.983 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:33 +0000 (0:00:00.069) 0:02:45.982 *********** 2021-07-26T15:42:33.992 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-07-26T15:42:33.994 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.020 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.036) 0:02:46.019 *********** 2021-07-26T15:42:34.058 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-07-26T15:42:34.060 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.083 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.063) 0:02:46.082 *********** 2021-07-26T15:42:34.121 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:42:34.123 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item={'block_used': 13859361, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235747, 'size_available': 926661619712, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235747, "block_size": 4096, "block_total": 240095108, "block_used": 13859361, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661619712, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-07-26T15:42:34.147 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.064) 0:02:46.147 *********** 2021-07-26T15:42:34.165 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-07-26T15:42:34.167 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.191 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.043) 0:02:46.190 *********** 2021-07-26T15:42:34.291 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.324 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.132) 0:02:46.323 *********** 2021-07-26T15:42:34.400 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009497", "end": "2021-07-26 15:42:34.073218", "rc": 0, "start": "2021-07-26 15:42:34.063721", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:34.424 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.100) 0:02:46.423 *********** 2021-07-26T15:42:34.432 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-07-26T15:42:34.434 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.461 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.035) 0:02:46.459 *********** 2021-07-26T15:42:34.512 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-07-26T15:42:34.514 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'block_used': 13859361, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235747, 'size_available': 926661619712, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235747, "block_size": 4096, "block_total": 240095108, "block_used": 13859361, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661619712, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.544 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.083) 0:02:46.542 *********** 2021-07-26T15:42:34.551 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.579 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.035) 0:02:46.578 *********** 2021-07-26T15:42:34.611 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-07-26T15:42:34.637 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.057) 0:02:46.636 *********** 2021-07-26T15:42:34.681 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-07-26T15:42:34.719 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.076) 0:02:46.712 *********** 2021-07-26T15:42:34.753 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:34.756 INFO:teuthology.task.ansible.out:TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.811 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi067.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.813 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.834 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.845 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.869 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.880 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-07-26T15:42:34.891 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.893 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.904 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.915 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.926 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.928 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.938 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-07-26T15:42:34.971 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:34 +0000 (0:00:00.255) 0:02:46.968 *********** 2021-07-26T15:42:35.219 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-07-26T15:42:35.221 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.006599", "end": "2021-07-26 15:42:35.197527", "rc": 0, "start": "2021-07-26 15:42:35.190928", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_b6f3efab84b70e18e86ec271a07564aeb4ed3bac/virtualenv/bin/teuthology-lock"]} 2021-07-26T15:42:35.245 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:35 +0000 (0:00:00.276) 0:02:47.244 *********** 2021-07-26T15:42:35.327 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-07-26T15:42:35.328 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:35.353 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:35 +0000 (0:00:00.107) 0:02:47.352 *********** 2021-07-26T15:42:35.443 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:35.470 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:35 +0000 (0:00:00.113) 0:02:47.465 *********** 2021-07-26T15:42:35.536 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-07-26T15:42:35.537 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:35.565 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:35 +0000 (0:00:00.099) 0:02:47.564 *********** 2021-07-26T15:42:36.275 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-07-26T15:42:36.277 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:42:36.299 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.733) 0:02:48.298 *********** 2021-07-26T15:42:36.379 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:36.404 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.104) 0:02:48.403 *********** 2021-07-26T15:42:36.487 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-07-26T15:42:36.488 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcLAtkIWVRKApwBt0JqWzDlhgb6ztvmXGr'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.601907", "end": "2021-07-26 15:42:36.153954", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcLAtkIWVRKApwBt0JqWzDlhgb6ztvmXGr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:34.552047", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:36.499 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:36.500 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi067.front.sepia.ceph.com] => (item={'block_used': 13859354, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235754, 'size_available': 926661648384, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235754, "block_size": 4096, "block_total": 240095108, "block_used": 13859354, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661648384, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}} 2021-07-26T15:42:36.503 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:36.519 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:42:36.540 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.136) 0:02:48.539 *********** 2021-07-26T15:42:36.745 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-07-26T15:42:36.747 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009281", "end": "2021-07-26 15:42:36.442321", "rc": 0, "start": "2021-07-26 15:42:36.433040", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:36.770 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.230) 0:02:48.769 *********** 2021-07-26T15:42:36.862 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi067.front.sepia.ceph.com] => (item={'block_used': 13859354, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235754, 'size_available': 926661648384, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235754, "block_size": 4096, "block_total": 240095108, "block_used": 13859354, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661648384, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:36.888 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.117) 0:02:48.887 *********** 2021-07-26T15:42:36.958 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-07-26T15:42:36.981 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:36 +0000 (0:00:00.093) 0:02:48.980 *********** 2021-07-26T15:42:37.075 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:37.793 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcWrT2g2DGmrlsXqmGQ4nz1roTO114NCde'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.147564", "end": "2021-07-26 15:42:37.462446", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcWrT2g2DGmrlsXqmGQ4nz1roTO114NCde"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:36.314882", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:37.806 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP', 'wwn-0x5000c500918e7eca'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1', 'wwn-0x5000c500918e7eca-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918e7eca', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LGPP', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP", "wwn-0x5000c500918e7eca"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1", "wwn-0x5000c500918e7eca-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGPP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e7eca"}}, 2021-07-26T15:42:37.809 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-07-26T15:42:38.771 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vfLHUXz24oCskR4zkEuM9uiyJ3L1em4OB'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.561740", "end": "2021-07-26 15:42:38.458183", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vfLHUXz24oCskR4zkEuM9uiyJ3L1em4OB"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:36.896443", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:38.783 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:38.794 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:39.067 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-PnpvXY-g3z2-ZQ1o-i5eo-BOda-Rlhb-39m1kL', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN', 'nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.135000", "end": "2021-07-26 15:42:38.736069", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-PnpvXY-g3z2-ZQ1o-i5eo-BOda-Rlhb-39m1kL", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN", "nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:37.601069", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-07-26T15:42:39.069 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:39.079 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:39.080 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:40.038 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vxkZaE8UaBjKfHn0d9JZ3gm6b3r5S8cOh'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.115828", "end": "2021-07-26 15:42:39.716482", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vxkZaE8UaBjKfHn0d9JZ3gm6b3r5S8cOh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:38.600654", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:40.040 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W31M', 'wwn-0x5000c50087b8c354'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W31M-part1', 'wwn-0x5000c50087b8c354-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087b8c354', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4W31M', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W31M", "wwn-0x5000c50087b8c354"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W31M-part1", "wwn-0x5000c50087b8c354-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W31M", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b8c354"}}, 2021-07-26T15:42:40.041 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-07-26T15:42:40.378 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcVRFogrncZ3lTfv65d2ulQSmp1TdNc7gz'], 'uuids': ['07f6cca5-6e17-4919-abbe-596455f1e887']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.157177", "end": "2021-07-26 15:42:40.041056", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcVRFogrncZ3lTfv65d2ulQSmp1TdNc7gz"], "labels": [], "masters": [], "uuids": ["07f6cca5-6e17-4919-abbe-596455f1e887"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:38.883879", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:40.379 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:40.391 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:41.319 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Ivx3HS-hQ2L-eRhf-Gd1n-E9pY-TlBt-D98Mef', 'nvme-INTEL_SSDPEDMD400G4_CVFT53440042400BGN', 'nvme-nvme.8086-43564654353334343030343234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.143131", "end": "2021-07-26 15:42:40.999000", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Ivx3HS-hQ2L-eRhf-Gd1n-E9pY-TlBt-D98Mef", "nvme-INTEL_SSDPEDMD400G4_CVFT53440042400BGN", "nvme-nvme.8086-43564654353334343030343234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:39.855869", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-07-26T15:42:41.321 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:41.332 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:41.658 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcyVS4ND7YbXLOwx2FCN6kXEWJ7J94hYDb'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.129696", "end": "2021-07-26 15:42:41.321074", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcyVS4ND7YbXLOwx2FCN6kXEWJ7J94hYDb"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:40.191378", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-d 2021-07-26T15:42:41.660 INFO:teuthology.task.ansible.out:eadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.613 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vwX1HMUBTpp3qsTq4oeNAZH8KzDARzlOr'], 'uuids': ['757da582-1120-4b9d-8066-a2900e255b5f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.147714", "end": "2021-07-26 15:42:42.299936", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vwX1HMUBTpp3qsTq4oeNAZH8KzDARzlOr"], "labels": [], "masters": [], "uuids": ["757da582-1120-4b9d-8066-a2900e255b5f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:41.152222", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:42.625 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.626 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:42.912 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcH31f6NgumFnfv3JRovfXj5dXhzK7VjWf'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.117747", "end": "2021-07-26 15:42:42.579438", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcH31f6NgumFnfv3JRovfXj5dXhzK7VjWf"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:41.461691", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:42.950 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:42 +0000 (0:00:05.969) 0:02:54.950 *********** 2021-07-26T15:42:43.033 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-07-26T15:42:43.035 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.347 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcLAtkIWVRKApwBt0JqWzDlhgb6ztvmXGr'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.172659", "end": "2021-07-26 15:42:43.010494", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcLAtkIWVRKApwBt0JqWzDlhgb6ztvmXGr"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:42.837835", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.167634 s, 688 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.167634 s, 688 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:43.348 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.360 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.664 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcWrT2g2DGmrlsXqmGQ4nz1roTO114NCde'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.166523", "end": "2021-07-26 15:42:43.332886", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcWrT2g2DGmrlsXqmGQ4nz1roTO114NCde"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:43.166363", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.161605 s, 714 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.161605 s, 714 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:43.675 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP', 'wwn-0x5000c500918e7eca'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1', 'wwn-0x5000c500918e7eca-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c500918e7eca', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5LGPP', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP", "wwn-0x5000c500918e7eca"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5LGPP-part1", "wwn-0x5000c500918e7eca-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5LGPP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e7eca"}}, 2021-07-26T15:42:43.677 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.867 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-PnpvXY-g3z2-ZQ1o-i5eo-BOda-Rlhb-39m1kL', 'nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN', 'nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.057556", "end": "2021-07-26 15:42:43.535302", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-PnpvXY-g3z2-ZQ1o-i5eo-BOda-Rlhb-39m1kL", "nvme-INTEL_SSDPEDMD400G4_PHFT620400NQ400BGN", "nvme-nvme.8086-504846543632303430304e5134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:43.477746", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0526771 s, 2.2 GB/s", "std 2021-07-26T15:42:43.869 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0526771 s, 2.2 GB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:43.878 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.879 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-07-26T15:42:43.879 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vZ6HGWya4qSwdh1beqGjcaeeDcTZuDC1O'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.113336", "end": "2021-07-26 15:42:43.558520", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vZ6HGWya4qSwdh1beqGjcaeeDcTZuDC1O"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:42.445184", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:43.881 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:43.892 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-07-26T15:42:43.894 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:44.165 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-07-26T15:42:44.167 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcVRFogrncZ3lTfv65d2ulQSmp1TdNc7gz'], 'uuids': ['07f6cca5-6e17-4919-abbe-596455f1e887']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.159993", "end": "2021-07-26 15:42:43.838918", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcVRFogrncZ3lTfv65d2ulQSmp1TdNc7gz"], "labels": [], "masters": [], "uuids": ["07f6cca5-6e17-4919-abbe-596455f1e887"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:43.678925", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155672 s, 741 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155672 s, 741 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:44.180 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:44.192 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:44.486 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcyVS4ND7YbXLOwx2FCN6kXEWJ7J94hYDb'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.166939", "end": "2021-07-26 15:42:44.156069", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcyVS4ND7YbXLOwx2FCN6kXEWJ7J94hYDb"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:43.989130", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.162071 s, 712 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.162071 s, 712 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:44.499 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:44.790 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcH31f6NgumFnfv3JRovfXj5dXhzK7VjWf'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.164444", "end": "2021-07-26 15:42:44.457325", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-JgGwpufooWGZ0Rbe0TN4GSkJJz8jYzzcH31f6NgumFnfv3JRovfXj5dXhzK7VjWf"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:44.292881", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159695 s, 722 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159695 s, 722 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:44.824 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:44 +0000 (0:00:01.873) 0:02:56.823 *********** 2021-07-26T15:42:45.135 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-07-26T15:42:45.137 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.130306", "end": "2021-07-26 15:42:44.764302", "rc": 0, "start": "2021-07-26 15:42:44.633996", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:45.161 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:45 +0000 (0:00:00.337) 0:02:57.160 *********** 2021-07-26T15:42:45.168 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-07-26T15:42:45.170 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vlgSqLMaL50Nwp8rVemwOGRo2hJTD4MkD'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.118846", "end": "2021-07-26 15:42:44.834286", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vlgSqLMaL50Nwp8rVemwOGRo2hJTD4MkD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:43.715440", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-07-26T15:42:45.206 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:45 +0000 (0:00:00.045) 0:02:57.206 *********** 2021-07-26T15:42:45.297 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-07-26T15:42:45.298 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:45.393 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-07-26T15:42:45.395 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.087554", "end": "2021-07-26 15:42:45.060902", "rc": 0, "start": "2021-07-26 15:42:44.973348", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:45.421 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:45 +0000 (0:00:00.214) 0:02:57.420 *********** 2021-07-26T15:42:45.501 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-07-26T15:42:45.568 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:45 +0000 (0:00:00.147) 0:02:57.567 *********** 2021-07-26T15:42:45.596 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:45.598 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vfLHUXz24oCskR4zkEuM9uiyJ3L1em4OB'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.163928", "end": "2021-07-26 15:42:45.280585", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vfLHUXz24oCskR4zkEuM9uiyJ3L1em4OB"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:45.116657", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.158855 s, 726 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.158855 s, 726 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:45.625 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:45 +0000 (0:00:00.056) 0:02:57.624 *********** 2021-07-26T15:42:45.633 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:45.634 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:45.657 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-07-26T15:42:45.658 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:45.681 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:45 +0000 (0:00:00.055) 0:02:57.680 *********** 2021-07-26T15:42:45.707 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-07-26T15:42:45.709 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:45.733 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:45 +0000 (0:00:00.052) 0:02:57.732 *********** 2021-07-26T15:42:45.760 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-07-26T15:42:45.762 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:45.785 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:45 +0000 (0:00:00.050) 0:02:57.783 *********** 2021-07-26T15:42:45.917 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-07-26T15:42:45.919 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vxkZaE8UaBjKfHn0d9JZ3gm6b3r5S8cOh'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.170109", "end": "2021-07-26 15:42:45.602100", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vxkZaE8UaBjKfHn0d9JZ3gm6b3r5S8cOh"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:45.431991", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.165212 s, 698 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.165212 s, 698 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:45.920 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-07-26T15:42:45.920 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:45.922 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W31M', 'wwn-0x5000c50087b8c354'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W31M-part1', 'wwn-0x5000c50087b8c354-part1'], 'uuids': ['765c9454-acf9-4ab1-8c0e-444ef075a2c6']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50087b8c354', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W4W31M', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W31M", "wwn-0x5000c50087b8c354"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W31M-part1", "wwn-0x5000c50087b8c354-part1"], "labels": [], "masters": [], "uuids": ["765c9454-acf9-4ab1-8c0e-444ef075a2c6"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W31M", "size": "931.51 GB", " 2021-07-26T15:42:45.924 INFO:teuthology.task.ansible.out:support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b8c354"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:45.945 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:45 +0000 (0:00:00.161) 0:02:57.945 *********** 2021-07-26T15:42:45.996 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi087.front.sepia.ceph.com] => (item={'block_used': 13859361, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235747, 'size_available': 926661619712, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235747, "block_size": 4096, "block_total": 240095108, "block_used": 13859361, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661619712, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.020 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:00.074) 0:02:58.019 *********** 2021-07-26T15:42:46.048 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-07-26T15:42:46.050 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.071 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:00.051) 0:02:58.070 *********** 2021-07-26T15:42:46.098 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:46.099 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.122 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:00.050) 0:02:58.121 *********** 2021-07-26T15:42:46.131 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-07-26T15:42:46.134 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-Ivx3HS-hQ2L-eRhf-Gd1n-E9pY-TlBt-D98Mef', 'nvme-INTEL_SSDPEDMD400G4_CVFT53440042400BGN', 'nvme-nvme.8086-43564654353334343030343234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.054615", "end": "2021-07-26 15:42:45.796815", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Ivx3HS-hQ2L-eRhf-Gd1n-E9pY-TlBt-D98Mef", "nvme-INTEL_SSDPEDMD400G4_CVFT53440042400BGN", "nvme-nvme.8086-43564654353334343030343234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:45.742200", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.049572 s, 2.3 GB/s", "stde 2021-07-26T15:42:46.140 INFO:teuthology.task.ansible.out:rr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.049572 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.145 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.147 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.178 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:00.052) 0:02:58.174 *********** 2021-07-26T15:42:46.204 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-07-26T15:42:46.205 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.228 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:00.052) 0:02:58.227 *********** 2021-07-26T15:42:46.256 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.280 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:00.052) 0:02:58.279 *********** 2021-07-26T15:42:46.309 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.331 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:46 +0000 (0:00:00.051) 0:02:58.331 *********** 2021-07-26T15:42:46.434 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vwX1HMUBTpp3qsTq4oeNAZH8KzDARzlOr'], 'uuids': ['757da582-1120-4b9d-8066-a2900e255b5f']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.157942", "end": "2021-07-26 15:42:46.111045", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vwX1HMUBTpp3qsTq4oeNAZH8KzDARzlOr"], "labels": [], "masters": [], "uuids": ["757da582-1120-4b9d-8066-a2900e255b5f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:45.953103", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.153329 s, 752 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.153329 s, 752 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:46.436 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.447 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:46.749 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vZ6HGWya4qSwdh1beqGjcaeeDcTZuDC1O'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.178393", "end": "2021-07-26 15:42:46.436722", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vZ6HGWya4qSwdh1beqGjcaeeDcTZuDC1O"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:46.258329", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.17335 s, 665 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.17335 s, 665 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:46.761 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:47.064 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vlgSqLMaL50Nwp8rVemwOGRo2hJTD4MkD'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.160890", "end": "2021-07-26 15:42:46.741214", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-0PbISvfvMMaiTsluQ2RDbyxj75RRX41vlgSqLMaL50Nwp8rVemwOGRo2hJTD4MkD"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-07-26 15:42:46.580324", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155953 s, 740 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155953 s, 740 MB/s"], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:47.098 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.766) 0:02:59.097 *********** 2021-07-26T15:42:47.182 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-07-26T15:42:47.210 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.110) 0:02:59.208 *********** 2021-07-26T15:42:47.405 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-07-26T15:42:47.407 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.154422", "end": "2021-07-26 15:42:47.083096", "rc": 0, "start": "2021-07-26 15:42:46.928674", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:47.432 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.222) 0:02:59.430 *********** 2021-07-26T15:42:47.664 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.094041", "end": "2021-07-26 15:42:47.351601", "rc": 0, "start": "2021-07-26 15:42:47.257560", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:42:47.688 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.256) 0:02:59.687 *********** 2021-07-26T15:42:47.716 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-07-26T15:42:47.757 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.068) 0:02:59.755 *********** 2021-07-26T15:42:47.783 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-07-26T15:42:47.785 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:47.809 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.052) 0:02:59.808 *********** 2021-07-26T15:42:47.839 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:47.862 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.053) 0:02:59.861 *********** 2021-07-26T15:42:47.893 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:47.918 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.056) 0:02:59.918 *********** 2021-07-26T15:42:47.927 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-07-26T15:42:47.929 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:47.950 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:47.974 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:47 +0000 (0:00:00.055) 0:02:59.973 *********** 2021-07-26T15:42:48.107 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-07-26T15:42:48.109 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-07-26T15:42:48.131 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:48 +0000 (0:00:00.157) 0:03:00.130 *********** 2021-07-26T15:42:48.170 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-07-26T15:42:48.172 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'block_used': 13859354, 'uuid': '765c9454-acf9-4ab1-8c0e-444ef075a2c6', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226235754, 'size_available': 926661648384, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 150120, 'block_size': 4096, 'inode_available': 60904856}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226235754, "block_size": 4096, "block_total": 240095108, "block_used": 13859354, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60904856, "inode_total": 61054976, "inode_used": 150120, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926661648384, "size_total": 983429562368, "uuid": "765c9454-acf9-4ab1-8c0e-444ef075a2c6"}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:48.202 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:48 +0000 (0:00:00.070) 0:03:00.201 *********** 2021-07-26T15:42:48.248 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:48.280 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:48 +0000 (0:00:00.077) 0:03:00.279 *********** 2021-07-26T15:42:48.310 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-07-26T15:42:48.312 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : set_fact] ***************************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:48.341 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:48 +0000 (0:00:00.061) 0:03:00.341 *********** 2021-07-26T15:42:48.380 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:48.382 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:48.416 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:48 +0000 (0:00:00.074) 0:03:00.415 *********** 2021-07-26T15:42:48.456 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-07-26T15:42:48.458 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:48.499 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:48 +0000 (0:00:00.082) 0:03:00.497 *********** 2021-07-26T15:42:48.530 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-07-26T15:42:48.532 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:48.554 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:48 +0000 (0:00:00.055) 0:03:00.553 *********** 2021-07-26T15:42:48.582 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-07-26T15:42:48.585 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:48.607 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:48 +0000 (0:00:00.052) 0:03:00.606 *********** 2021-07-26T15:42:48.702 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:49.083 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:49.158 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-07-26T15:42:49.189 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:49 +0000 (0:00:00.582) 0:03:01.188 *********** 2021-07-26T15:42:49.454 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:49.480 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:49 +0000 (0:00:00.291) 0:03:01.479 *********** 2021-07-26T15:42:49.636 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-07-26T15:42:49.637 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:49.665 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:49 +0000 (0:00:00.184) 0:03:01.664 *********** 2021-07-26T15:42:49.832 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-07-26T15:42:49.834 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:49.977 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:50.022 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-07-26T15:42:50.024 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:50.119 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:50.244 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:50.256 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:50.286 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:50 +0000 (0:00:00.621) 0:03:02.285 *********** 2021-07-26T15:42:50.316 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-07-26T15:42:50.317 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:50.352 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:50 +0000 (0:00:00.064) 0:03:02.350 *********** 2021-07-26T15:42:50.391 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-07-26T15:42:50.394 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:50.425 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:50 +0000 (0:00:00.069) 0:03:02.419 *********** 2021-07-26T15:42:50.447 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:50.566 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-07-26T15:42:50.568 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:42:50.591 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:50 +0000 (0:00:00.170) 0:03:02.589 *********** 2021-07-26T15:42:50.628 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-07-26T15:42:50.630 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-07-26T15:42:50.656 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:50 +0000 (0:00:00.065) 0:03:02.655 *********** 2021-07-26T15:42:50.874 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:51.220 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi087.front.sepia.ceph.com] => {"changed": true} 2021-07-26T15:42:51.247 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:51 +0000 (0:00:00.590) 0:03:03.246 *********** 2021-07-26T15:42:51.288 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-07-26T15:42:51.290 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-07-26T15:42:51.321 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:51 +0000 (0:00:00.074) 0:03:03.320 *********** 2021-07-26T15:42:51.473 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-07-26T15:42:51.475 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-07-26T15:42:51.501 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:51 +0000 (0:00:00.180) 0:03:03.501 *********** 2021-07-26T15:42:51.661 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-07-26T15:42:51.663 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:51.802 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-07-26T15:42:51.804 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-07-26T15:42:51.804 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-07-26T15:42:51.805 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:51.834 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:51 +0000 (0:00:00.332) 0:03:03.833 *********** 2021-07-26T15:42:51.862 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-07-26T15:42:51.864 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:51.886 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:51 +0000 (0:00:00.052) 0:03:03.885 *********** 2021-07-26T15:42:51.915 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:51.939 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:51 +0000 (0:00:00.052) 0:03:03.938 *********** 2021-07-26T15:42:51.947 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-07-26T15:42:51.948 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:51.971 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-07-26T15:42:51.972 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:51.999 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:51 +0000 (0:00:00.060) 0:03:03.998 *********** 2021-07-26T15:42:52.027 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-07-26T15:42:52.029 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:52.052 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:52 +0000 (0:00:00.053) 0:03:04.052 *********** 2021-07-26T15:42:52.083 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-07-26T15:42:52.092 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:52.123 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:52 +0000 (0:00:00.070) 0:03:04.122 *********** 2021-07-26T15:42:52.164 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:52.191 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:52 +0000 (0:00:00.068) 0:03:04.191 *********** 2021-07-26T15:42:52.214 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-07-26T15:42:52.218 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:42:52.249 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:52 +0000 (0:00:00.056) 0:03:04.247 *********** 2021-07-26T15:42:52.261 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-07-26T15:42:52.263 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:52.289 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:52 +0000 (0:00:00.041) 0:03:04.289 *********** 2021-07-26T15:42:52.415 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-07-26T15:42:52.417 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:42:52.441 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:52 +0000 (0:00:00.151) 0:03:04.440 *********** 2021-07-26T15:42:52.449 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-07-26T15:42:52.452 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:42:52.480 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:52 +0000 (0:00:00.039) 0:03:04.479 *********** 2021-07-26T15:42:52.520 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-07-26T15:42:52.522 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-07-26T15:42:52.546 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:52 +0000 (0:00:00.064) 0:03:04.544 *********** 2021-07-26T15:42:52.819 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-07-26T15:42:52.820 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-07-26T15:42:52.855 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:52 +0000 (0:00:00.309) 0:03:04.854 *********** 2021-07-26T15:42:53.236 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-07-26T15:42:53.269 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:53 +0000 (0:00:00.413) 0:03:05.267 *********** 2021-07-26T15:42:53.812 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-07-26T15:42:53.814 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true} 2021-07-26T15:42:53.838 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:53 +0000 (0:00:00.569) 0:03:05.837 *********** 2021-07-26T15:42:53.940 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-07-26T15:42:53.942 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:42:53.966 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:53 +0000 (0:00:00.127) 0:03:05.964 *********** 2021-07-26T15:42:54.078 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-07-26T15:42:54.079 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-07-26T15:42:54.103 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:54 +0000 (0:00:00.138) 0:03:06.102 *********** 2021-07-26T15:42:54.132 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-07-26T15:42:54.134 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:54.157 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:54 +0000 (0:00:00.053) 0:03:06.156 *********** 2021-07-26T15:42:54.184 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-07-26T15:42:54.186 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:54.210 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:54 +0000 (0:00:00.053) 0:03:06.209 *********** 2021-07-26T15:42:54.251 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.140512", "end": "2021-07-26 15:42:53.927376", "rc": 0, "start": "2021-07-26 15:42:53.786864", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-07-26T15:42:54.277 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:54 +0000 (0:00:00.064) 0:03:06.274 *********** 2021-07-26T15:42:54.302 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:54 +0000 (0:00:00.026) 0:03:06.300 *********** 2021-07-26T15:42:54.310 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:54.338 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:54 +0000 (0:00:00.035) 0:03:06.336 *********** 2021-07-26T15:42:54.346 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-07-26T15:42:54.348 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:54.374 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:54 +0000 (0:00:00.036) 0:03:06.373 *********** 2021-07-26T15:42:54.403 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:54.426 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:54 +0000 (0:00:00.051) 0:03:06.425 *********** 2021-07-26T15:42:54.512 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:42:54.551 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:54 +0000 (0:00:00.124) 0:03:06.550 *********** 2021-07-26T15:42:54.718 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:42:54.742 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:54 +0000 (0:00:00.190) 0:03:06.741 *********** 2021-07-26T15:42:55.098 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:42:55.191 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:55 +0000 (0:00:00.380) 0:03:07.122 *********** TASK [testnode : Upload CPAN config for the teuthology user.] ****************** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} Monday 26 July 2021 15:42:55 +0000 (0:00:00.041) 0:03:07.163 *********** TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:55.199 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:55 +0000 (0:00:00.034) 0:03:07.198 *********** 2021-07-26T15:42:55.536 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-07-26T15:42:55.538 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-07-26T15:42:55.564 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:55 +0000 (0:00:00.365) 0:03:07.563 *********** 2021-07-26T15:42:55.571 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-07-26T15:42:55.573 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-07-26T15:42:55.599 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:55 +0000 (0:00:00.035) 0:03:07.599 *********** 2021-07-26T15:42:55.639 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:55.665 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:55 +0000 (0:00:00.063) 0:03:07.662 *********** 2021-07-26T15:42:55.886 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-07-26T15:42:55.887 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:39:36 UTC", "ActiveEnterTimestampMonotonic": "13382120", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target system.slice systemd-journald.socket systemd-tmpfiles-setup.service basic.target -.mount network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:39:36 UTC", "AssertTimestampMonotonic": "13191678", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:39:36 UTC", "ConditionTimestampMonotonic": "13191677", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-07-26T15:42:55.889 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "830", "ExecMainStartTimestamp": "Mon 2021-07-26 15:39:36 UTC", "ExecMainStartTimestampMonotonic": "13382107", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:39:36 UTC", "InactiveExitTimestampMonotonic": "13192541", "InvocationID": "5b6efdff927a42b9a02e66fd387d20e0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-07-26T15:42:55.891 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127777", "LimitNPROCSoft": "127777", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "830", "MemoryAccounting": "yes", "MemoryCurrent": "3469312", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "Requi 2021-07-26T15:42:55.892 INFO:teuthology.task.ansible.out:resMountsFor": "/var/tmp /tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:39:36 UTC", "StateChangeTimestampMonotonic": "13382120", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:42:55.913 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:55 +0000 (0:00:00.250) 0:03:07.912 *********** 2021-07-26T15:42:55.941 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-07-26T15:42:55.977 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:55 +0000 (0:00:00.063) 0:03:07.976 *********** 2021-07-26T15:42:56.016 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-07-26T15:42:56.050 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:56 +0000 (0:00:00.070) 0:03:08.046 *********** 2021-07-26T15:42:56.081 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:56.112 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:56 +0000 (0:00:00.063) 0:03:08.110 *********** 2021-07-26T15:42:56.244 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:42:56.276 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:56 +0000 (0:00:00.165) 0:03:08.276 *********** 2021-07-26T15:42:56.548 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.124199", "end": "2021-07-26 15:42:56.522893", "rc": 0, "start": "2021-07-26 15:42:56.398694", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-07-26T15:42:56.572 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:56 +0000 (0:00:00.295) 0:03:08.572 *********** 2021-07-26T15:42:56.601 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-07-26T15:42:56.602 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:56.625 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:56 +0000 (0:00:00.052) 0:03:08.624 *********** 2021-07-26T15:42:56.654 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-07-26T15:42:56.657 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:56.678 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:56 +0000 (0:00:00.053) 0:03:08.677 *********** 2021-07-26T15:42:57.216 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-07-26T15:42:57.217 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:42:57.246 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:57 +0000 (0:00:00.562) 0:03:09.240 *********** 2021-07-26T15:42:57.268 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:57.293 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:57 +0000 (0:00:00.050) 0:03:09.290 *********** 2021-07-26T15:42:57.362 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:42:57.387 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:57 +0000 (0:00:00.095) 0:03:09.386 *********** 2021-07-26T15:42:57.426 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-07-26T15:42:57.428 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:57.455 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:57 +0000 (0:00:00.068) 0:03:09.454 *********** 2021-07-26T15:42:57.473 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:42:57.498 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:57 +0000 (0:00:00.043) 0:03:09.498 *********** 2021-07-26T15:42:57.826 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-07-26T15:42:57.828 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-07-26T15:42:57.852 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:57 +0000 (0:00:00.353) 0:03:09.851 *********** 2021-07-26T15:42:57.885 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:57.904 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:57 +0000 (0:00:00.052) 0:03:09.903 *********** 2021-07-26T15:42:57.946 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-07-26T15:42:57.975 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:57 +0000 (0:00:00.070) 0:03:09.974 *********** 2021-07-26T15:42:58.136 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:39:34 UTC", "ActiveEnterTimestampMonotonic": "13620397", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target sysinit.target systemd-tmpfiles-setup.service -.mount network.target systemd-journald.socket system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:39:34 UTC", "AssertTimestampMonotonic": "13492018", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:39:34 UTC", "ConditionTimestampMonotonic": "13492016", "ConfigurationDirectoryMode 2021-07-26T15:42:58.138 INFO:teuthology.task.ansible.out:": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "832", "ExecMainStartTimestamp": "Mon 2021-07-26 15:39:34 UTC", "ExecMainStartTimestampMonotonic": "13620382", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:39:34 UTC", "InactiveExitTimestampMonotonic": "13493237", "InvocationID": "3b1bccd0a0974c75b481b96f49967c1e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": " 2021-07-26T15:42:58.140 INFO:teuthology.task.ansible.out:15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127778", "LimitNPROCSoft": "127778", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127778", "LimitSIGPENDINGSoft": "127778", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "832", "MemoryAccounting": "yes", "MemoryCurrent": "3588096", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit" 2021-07-26T15:42:58.143 INFO:teuthology.task.ansible.out:: "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:39:34 UTC", "StateChangeTimestampMonotonic": "13620397", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38333", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:42:58.163 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:58 +0000 (0:00:00.188) 0:03:10.162 *********** 2021-07-26T15:42:58.192 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-07-26T15:42:58.217 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:58 +0000 (0:00:00.054) 0:03:10.216 *********** 2021-07-26T15:42:58.257 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:42:58.262 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-07-26T15:42:58.282 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:58 +0000 (0:00:00.065) 0:03:10.281 *********** 2021-07-26T15:42:58.284 INFO:teuthology.task.ansible.out: 2021-07-26T15:42:58.322 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-07-26T15:42:58.325 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:58.351 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:58 +0000 (0:00:00.068) 0:03:10.350 *********** 2021-07-26T15:42:59.469 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:42:59.492 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:59 +0000 (0:00:01.140) 0:03:11.491 *********** 2021-07-26T15:42:59.532 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:42:59.557 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:59 +0000 (0:00:00.065) 0:03:11.557 *********** 2021-07-26T15:42:59.758 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-07-26T15:42:59.781 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:42:59 +0000 (0:00:00.223) 0:03:11.780 *********** 2021-07-26T15:43:00.235 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-07-26T15:43:00.237 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-07-26T15:43:00.261 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:00 +0000 (0:00:00.478) 0:03:12.259 *********** 2021-07-26T15:43:00.324 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-07-26T15:43:00.356 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:00 +0000 (0:00:00.095) 0:03:12.355 *********** 2021-07-26T15:43:00.855 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-07-26T15:43:00.856 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"changed": false} 2021-07-26T15:43:00.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:00 +0000 (0:00:00.522) 0:03:12.877 *********** 2021-07-26T15:43:00.906 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-07-26T15:43:00.929 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:00 +0000 (0:00:00.051) 0:03:12.928 *********** 2021-07-26T15:43:01.118 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1627313724.1129055, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1627313724.1089053, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1627313724.1089053, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-07-26T15:43:01.144 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:01 +0000 (0:00:00.215) 0:03:13.143 *********** 2021-07-26T15:43:01.612 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-07-26T15:43:01.636 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:01 +0000 (0:00:00.491) 0:03:13.635 *********** 2021-07-26T15:43:01.664 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-07-26T15:43:01.688 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:01 +0000 (0:00:00.051) 0:03:13.687 *********** 2021-07-26T15:43:01.715 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:01.738 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:01 +0000 (0:00:00.050) 0:03:13.738 *********** 2021-07-26T15:43:01.923 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-07-26T15:43:01.925 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-07-26T15:43:01.948 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:01 +0000 (0:00:00.209) 0:03:13.947 *********** 2021-07-26T15:43:02.130 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-07-26T15:43:02.132 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-07-26T15:43:02.161 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.212) 0:03:14.160 *********** 2021-07-26T15:43:02.189 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-07-26T15:43:02.191 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.216 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.054) 0:03:14.215 *********** 2021-07-26T15:43:02.255 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi087.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.267 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.278 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.280 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.307 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.091) 0:03:14.306 *********** 2021-07-26T15:43:02.315 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-07-26T15:43:02.325 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.8.0)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-07-26T15:43:02.352 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.044) 0:03:14.351 *********** 2021-07-26T15:43:02.368 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.373 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.375 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi087.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.401 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.049) 0:03:14.400 *********** 2021-07-26T15:43:02.429 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-07-26T15:43:02.431 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.456 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.054) 0:03:14.455 *********** 2021-07-26T15:43:02.485 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.518 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.062) 0:03:14.517 *********** 2021-07-26T15:43:02.546 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-07-26T15:43:02.549 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.575 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.057) 0:03:14.575 *********** 2021-07-26T15:43:02.606 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-07-26T15:43:02.608 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.642 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.065) 0:03:14.640 *********** 2021-07-26T15:43:02.673 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.709 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.068) 0:03:14.708 *********** 2021-07-26T15:43:02.741 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-07-26T15:43:02.743 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.780 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.069) 0:03:14.778 *********** 2021-07-26T15:43:02.810 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.835 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.055) 0:03:14.834 *********** 2021-07-26T15:43:02.853 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* ok: [smithi067.front.sepia.ceph.com] => {"changed": false} 2021-07-26T15:43:02.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.043) 0:03:14.878 *********** 2021-07-26T15:43:02.891 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:02.914 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.035) 0:03:14.913 *********** 2021-07-26T15:43:02.922 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-07-26T15:43:02.923 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-07-26T15:43:02.949 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:02 +0000 (0:00:00.035) 0:03:14.948 *********** 2021-07-26T15:43:03.113 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-07-26T15:43:03.115 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010385", "end": "2021-07-26 15:43:03.080211", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-07-26 15:43:03.069826", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:43:03.136 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-07-26T15:43:03.137 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1627313733.8696947, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1627313733.8656945, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 105181, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1627313733.8656945, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1956422440", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-07-26T15:43:03.160 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.211) 0:03:15.160 *********** 2021-07-26T15:43:03.276 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi087.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006183", "end": "2021-07-26 15:43:03.241987", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-07-26 15:43:03.235804", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:43:03.338 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-07-26T15:43:03.340 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-07-26T15:43:03.362 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.201) 0:03:15.361 *********** 2021-07-26T15:43:03.391 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-07-26T15:43:03.393 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-07-26T15:43:03.422 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.059) 0:03:15.421 *********** 2021-07-26T15:43:03.440 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-07-26T15:43:03.442 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005514", "end": "2021-07-26 15:43:03.406686", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-07-26 15:43:03.401172", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-07-26T15:43:03.452 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:03.477 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.054) 0:03:15.476 *********** 2021-07-26T15:43:03.621 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-07-26T15:43:03.623 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.023816", "end": "2021-07-26 15:43:03.581650", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-07-26 15:43:03.557834", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:43:03.654 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.177) 0:03:15.653 *********** 2021-07-26T15:43:03.662 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-07-26T15:43:03.663 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-07-26T15:43:03.688 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.033) 0:03:15.687 *********** 2021-07-26T15:43:03.696 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-07-26T15:43:03.733 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.045) 0:03:15.732 *********** 2021-07-26T15:43:03.764 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-07-26T15:43:03.766 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:03.856 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-07-26T15:43:03.858 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-07-26T15:43:03.879 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.146) 0:03:15.878 *********** 2021-07-26T15:43:03.907 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-07-26T15:43:03.909 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:03.931 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:03 +0000 (0:00:00.051) 0:03:15.930 *********** 2021-07-26T15:43:03.970 INFO:teuthology.task.ansible.out: 2021-07-26T15:43:03.972 INFO:teuthology.task.ansible.out:TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi067.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-07-26T15:43:03.984 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-07-26T15:43:03.986 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.022 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:04 +0000 (0:00:00.090) 0:03:16.021 *********** 2021-07-26T15:43:04.064 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-07-26T15:43:04.066 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.077 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.080 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi067.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.111 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:04 +0000 (0:00:00.088) 0:03:16.110 *********** 2021-07-26T15:43:04.139 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.171 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:04 +0000 (0:00:00.058) 0:03:16.168 *********** 2021-07-26T15:43:04.197 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.222 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:04 +0000 (0:00:00.053) 0:03:16.221 *********** 2021-07-26T15:43:04.249 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.283 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:04 +0000 (0:00:00.053) 0:03:16.275 *********** 2021-07-26T15:43:04.314 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.342 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:04 +0000 (0:00:00.065) 0:03:16.340 *********** 2021-07-26T15:43:04.372 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-07-26T15:43:04.376 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.398 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:04 +0000 (0:00:00.056) 0:03:16.397 *********** 2021-07-26T15:43:04.427 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-07-26T15:43:04.429 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.453 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:04 +0000 (0:00:00.054) 0:03:16.452 *********** 2021-07-26T15:43:04.480 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-07-26T15:43:04.482 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.507 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:04 +0000 (0:00:00.053) 0:03:16.506 *********** 2021-07-26T15:43:04.535 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:04.561 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:04 +0000 (0:00:00.053) 0:03:16.559 *********** 2021-07-26T15:43:04.776 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi067.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010523", "end": "2021-07-26 15:43:04.735119", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-07-26 15:43:04.724596", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:43:04.983 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.006128", "end": "2021-07-26 15:43:04.941507", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-07-26 15:43:04.935379", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:43:05.766 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005481", "end": "2021-07-26 15:43:05.148525", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-07-26 15:43:05.143044", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} ok: [smithi067.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.029223", "end": "2021-07-26 15:43:05.352976", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-07-26 15:43:05.323753", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} Monday 26 July 2021 15:43:05 +0000 (0:00:00.851) 0:03:17.410 *********** TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** Monday 26 July 2021 15:43:05 +0000 (0:00:00.058) 0:03:17.469 *********** TASK [testnode : Touch /ceph-qa-ready] ***************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ Monday 26 July 2021 15:43:05 +0000 (0:00:00.118) 0:03:17.587 *********** Monday 26 July 2021 15:43:05 +0000 (0:00:00.021) 0:03:17.609 *********** 2021-07-26T15:43:06.591 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi087.front.sepia.ceph.com] 2021-07-26T15:43:06.788 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:06 +0000 (0:00:01.178) 0:03:18.787 *********** 2021-07-26T15:43:06.806 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] 2021-07-26T15:43:06.854 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:43:06.856 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-07-26T15:43:06.888 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:06 +0000 (0:00:00.100) 0:03:18.888 *********** 2021-07-26T15:43:06.919 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:06 +0000 (0:00:00.030) 0:03:18.918 *********** 2021-07-26T15:43:06.937 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-07-26T15:43:06.963 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:06 +0000 (0:00:00.044) 0:03:18.962 *********** 2021-07-26T15:43:06.972 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:43:06.973 INFO:teuthology.task.ansible.out:skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:06.998 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:06 +0000 (0:00:00.034) 0:03:18.997 *********** 2021-07-26T15:43:07.005 INFO:teuthology.task.ansible.out:skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:07.036 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:07 +0000 (0:00:00.038) 0:03:19.035 *********** 2021-07-26T15:43:07.043 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-07-26T15:43:07.044 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-07-26T15:43:07.082 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:07 +0000 (0:00:00.045) 0:03:19.081 *********** 2021-07-26T15:43:07.090 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-07-26T15:43:07.125 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:07 +0000 (0:00:00.042) 0:03:19.124 *********** 2021-07-26T15:43:23.512 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-07-26T15:43:23.515 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 3s (14.5 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.3) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The followin 2021-07-26T15:43:23.516 INFO:teuthology.task.ansible.out:g packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 3s (14.5 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.3) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} 2021-07-26T15:43:23.538 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:23 +0000 (0:00:16.413) 0:03:35.537 *********** 2021-07-26T15:43:23.567 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi087.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:23.592 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:23 +0000 (0:00:00.052) 0:03:35.590 *********** 2021-07-26T15:43:23.628 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-07-26T15:43:23.631 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-07-26T15:43:23.654 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:23 +0000 (0:00:00.063) 0:03:35.653 *********** 2021-07-26T15:43:23.853 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** changed: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": true, "stderr": "", "stderr_lines": [], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nSuggested packages:\n aufs-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils\nThe following packages will be upgraded:\n docker.io\n1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.\nNeed to get 36.9 MB of archives.\nAfter this operation, 931 kB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]\nPreconfiguring packages ...\nFetched 36.9 MB in 2s (15.7 MB/s)\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 138111 files and directories currently installed.)\r\nPreparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...\r\nUnpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...\r\nSetting up docker.io (20.10.2-0ubuntu1~20.04.3) ...\r\nCreated symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.\r\nProcessing triggers for man-db (2.9.1-1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "Suggested packages:", " auf 2021-07-26T15:43:23.855 INFO:teuthology.task.ansible.out:s-tools btrfs-progs debootstrap docker-doc rinse zfs-fuse | zfsutils", "The following packages will be upgraded:", " docker.io", "1 upgraded, 0 newly installed, 0 to remove and 143 not upgraded.", "Need to get 36.9 MB of archives.", "After this operation, 931 kB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 docker.io amd64 20.10.2-0ubuntu1~20.04.3 [36.9 MB]", "Preconfiguring packages ...", "Fetched 36.9 MB in 2s (15.7 MB/s)", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 138111 files and directories currently installed.)", "Preparing to unpack .../docker.io_20.10.2-0ubuntu1~20.04.3_amd64.deb ...", "Unpacking docker.io (20.10.2-0ubuntu1~20.04.3) over (19.03.8-0ubuntu1.20.04.2) ...", "Setting up docker.io (20.10.2-0ubuntu1~20.04.3) ...", "Created symlink /etc/systemd/system/multi-user.target.wants/docker.service -> /lib/systemd/system/docker.service.", "Processing triggers for man-db (2.9.1-1) ..."]} TASK [container-host : Create container_mirror_cert_paths] ********************* changed: [smithi087.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com 2021-07-26T15:43:23.858 INFO:teuthology.task.ansible.out::5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:43:23.878 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:23 +0000 (0:00:00.224) 0:03:35.878 *********** 2021-07-26T15:43:23.914 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** skipping: [smithi067.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-07-26T15:43:23.934 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:23 +0000 (0:00:00.055) 0:03:35.933 *********** 2021-07-26T15:43:23.983 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** ok: [smithi067.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-07-26T15:43:24.008 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:24 +0000 (0:00:00.073) 0:03:36.007 *********** 2021-07-26T15:43:24.025 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-07-26T15:43:24.027 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:43:24.058 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:24 +0000 (0:00:00.050) 0:03:36.057 *********** 2021-07-26T15:43:24.216 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:43:24.379 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-07-26T15:43:24.407 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:24 +0000 (0:00:00.349) 0:03:36.407 *********** 2021-07-26T15:43:24.535 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-07-26T15:43:24.537 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314204.1210225-31589-139406875270639/source", "state": "file", "uid": 0} 2021-07-26T15:43:24.890 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314204.470489-31654-84279147963312/source", "state": "file", "uid": 0} 2021-07-26T15:43:24.978 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314204.5638883-31589-213038143305797/source", "state": "file", "uid": 0} 2021-07-26T15:43:25.004 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:25 +0000 (0:00:00.596) 0:03:37.003 *********** 2021-07-26T15:43:25.338 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314204.9195535-31654-22988364145145/source", "state": "file", "uid": 0} 2021-07-26T15:43:25.370 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:25 +0000 (0:00:00.365) 0:03:37.369 *********** 2021-07-26T15:43:25.761 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** ok: [smithi087.front.sepia.ceph.com] => {"cache_update_time": 1627313811, "cache_updated": false, "changed": false} 2021-07-26T15:43:25.787 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:25 +0000 (0:00:00.416) 0:03:37.785 *********** 2021-07-26T15:43:26.150 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] => {"cache_update_time": 1627313870, "cache_updated": false, "changed": false} 2021-07-26T15:43:26.178 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:26 +0000 (0:00:00.392) 0:03:38.178 *********** 2021-07-26T15:43:30.233 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-07-26T15:43:30.235 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-dpciizn4\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-dpciizn4"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-dpciizn4\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=6946f09d45f1a94dc999532ac9da55065b97b9ce8cc79226b94e56259da92a34\n Stored in directory: /tmp/pip-ephem-wheel-cache-yw_xfr1f/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=31601cdb810bfe473d588a3a8544a47dfaf5ea3bc88141c203ace1120eb9144d\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-07-26T15:43:30.237 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-dpciizn4", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=6946f09d45f1a94dc999532ac9da55065b97b9ce8cc79226b94e56259da92a34", " Stored in directory: /tmp/pip-ephem-wheel-cache-yw_xfr1f/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=31601cdb810bfe473d588a3a8544a47dfaf5ea3bc88141c203ace1120eb9144d", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-07-26T15:43:30.267 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:30 +0000 (0:00:04.083) 0:03:42.261 *********** 2021-07-26T15:43:30.458 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi087.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-07-26T15:43:30.486 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:30 +0000 (0:00:00.223) 0:03:42.485 *********** 2021-07-26T15:43:30.832 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-07-26T15:43:30.834 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-kq_2ugeg\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-kq_2ugeg"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-kq_2ugeg\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=aaf8b67d7158a86c016039ed1788a41690dcb740c4d78ff65ca85ed0403da497\n Stored in directory: /tmp/pip-ephem-wheel-cache-y84_uyod/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=31601cdb810bfe473d588a3a8544a47dfaf5ea3bc88141c203ace1120eb9144d\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-07-26T15:43:30.836 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-kq_2ugeg", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=6035 sha256=aaf8b67d7158a86c016039ed1788a41690dcb740c4d78ff65ca85ed0403da497", " Stored in directory: /tmp/pip-ephem-wheel-cache-y84_uyod/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=31601cdb810bfe473d588a3a8544a47dfaf5ea3bc88141c203ace1120eb9144d", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-07-26T15:43:30.859 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:30 +0000 (0:00:00.373) 0:03:42.858 *********** 2021-07-26T15:43:30.937 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314210.541095-406-238949511656236/source", "state": "file", "uid": 0} 2021-07-26T15:43:30.966 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:30 +0000 (0:00:00.100) 0:03:42.959 *********** 2021-07-26T15:43:31.054 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* ok: [smithi067.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-07-26T15:43:31.082 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:31 +0000 (0:00:00.120) 0:03:43.080 *********** 2021-07-26T15:43:31.202 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-07-26T15:43:31.203 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.037698", "end": "2021-07-26 15:43:31.167002", "rc": 0, "start": "2021-07-26 15:43:31.129304", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:43:31.230 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:31 +0000 (0:00:00.149) 0:03:43.229 *********** 2021-07-26T15:43:31.566 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1627314211.1563966-568-77823319348991/source", "state": "file", "uid": 0} 2021-07-26T15:43:31.598 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:31 +0000 (0:00:00.362) 0:03:43.592 *********** 2021-07-26T15:43:31.818 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.039189", "end": "2021-07-26 15:43:31.792432", "rc": 0, "start": "2021-07-26 15:43:31.753243", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-07-26T15:43:31.850 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:31 +0000 (0:00:00.250) 0:03:43.842 *********** 2021-07-26T15:43:32.977 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:43:18 UTC", "ActiveEnterTimestampMonotonic": "235436803", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice firewalld.service network-online.target systemd-journald.socket containerd.service basic.target docker.socket sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:43:17 UTC", "AssertTimestampMonotonic": "233561885", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:43:17 UTC", "ConditionTimestampMonotonic": "233561884", "Configuration 2021-07-26T15:43:32.982 INFO:teuthology.task.ansible.out:DirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.slice/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8809", "ExecMainStartTimestamp": "Mon 2021-07-26 15:43:17 UTC", "ExecMainStartTimestampMonotonic": "233562627", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:43:17 UTC] ; stop_time=[n/a] ; pid=8809 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Mon 2021-07-26 15:43:17 UTC] ; stop_time=[n/a] ; pid=8809 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[ 2021-07-26T15:43:32.983 INFO:teuthology.task.ansible.out:no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:43:17 UTC", "InactiveExitTimestampMonotonic": "233562874", "InvocationID": "b440370cd9dd4871b81897e38be8294f", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127777", "LimitSIGPENDINGSoft": "127777", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8809", "MemoryAccounting": "yes", "MemoryCurrent": "53329920", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNew 2021-07-26T15:43:32.985 INFO:teuthology.task.ansible.out:Privileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:43:18 UTC", "StateChangeTimestampMonotonic": "235436803", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "15", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "Ti 2021-07-26T15:43:32.986 INFO:teuthology.task.ansible.out:merSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:43:33.580 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestamp": "Mon 2021-07-26 15:43:19 UTC", "ActiveEnterTimestampMonotonic": "237818047", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "firewalld.service docker.socket system.slice containerd.service systemd-journald.socket basic.target network-online.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Mon 2021-07-26 15:43:17 UTC", "AssertTimestampMonotonic": "235877646", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Mon 2021-07-26 15:43:17 UTC", "ConditionTimestampMonotonic": "235877646", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup": "/system.sli 2021-07-26T15:43:33.584 INFO:teuthology.task.ansible.out:ce/docker.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-firewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8811", "ExecMainStartTimestamp": "Mon 2021-07-26 15:43:17 UTC", "ExecMainStartTimestampMonotonic": "235878513", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[Mon 2021-07-26 15:43:17 UTC] ; stop_time=[n/a] ; pid=8811 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[Mon 2021-07-26 15:43:17 UTC] ; stop_time=[n/a] ; pid=8811 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngress 2021-07-26T15:43:33.588 INFO:teuthology.task.ansible.out:Packets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Mon 2021-07-26 15:43:17 UTC", "InactiveExitTimestampMonotonic": "235878788", "InvocationID": "aa07c685f3ea476aaaa2a80652404979", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127778", "LimitSIGPENDINGSoft": "127778", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "8811", "MemoryAccounting": "yes", "MemoryCurrent": "52846592", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "contin 2021-07-26T15:43:33.590 INFO:teuthology.task.ansible.out:ue", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket sysinit.target system.slice", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Mon 2021-07-26 15:43:19 UTC", "StateChangeTimestampMonotonic": "237818047", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "16", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": " 2021-07-26T15:43:33.593 INFO:teuthology.task.ansible.out:notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "Wants": "containerd.service network 2021-07-26T15:43:33.598 INFO:teuthology.task.ansible.out:-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-07-26T15:43:33.677 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-07-26T15:43:33.679 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-07-26T15:43:33.681 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-07-26T15:43:33.701 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-07-26T15:43:33.703 INFO:teuthology.task.ansible.out:Monday 26 July 2021 15:43:33 +0000 (0:00:01.858) 0:03:45.701 *********** 2021-07-26T15:43:34.704 INFO:teuthology.task.ansible.out:ok: [smithi067.front.sepia.ceph.com] 2021-07-26T15:43:34.738 INFO:teuthology.task.ansible.out:ok: [smithi087.front.sepia.ceph.com] 2021-07-26T15:43:34.763 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Monday 26 July 2021 15:43:34 +0000 (0:00:01.061) 0:03:46.762 *********** 2021-07-26T15:43:34.957 INFO:teuthology.task.ansible.out:changed: [smithi067.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-07-26T15:43:34.978 INFO:teuthology.task.ansible.out:changed: [smithi087.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-07-26T15:43:34.981 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* 2021-07-26T15:43:34.983 INFO:teuthology.task.ansible.out:smithi067.front.sepia.ceph.com : ok=133 changed=41 unreachable=0 failed=0 skipped=187 rescued=0 ignored=0 smithi087.front.sepia.ceph.com : ok=133 changed=41 unreachable=0 failed=0 skipped=187 rescued=0 ignored=0 Monday 26 July 2021 15:43:34 +0000 (0:00:00.218) 0:03:46.981 *********** =============================================================================== Create all admin users with sudo access. ------------------------------- 27.76s testnode : Upgrade packages -------------------------------------------- 23.89s users : Update authorized_keys using the keys repo --------------------- 21.19s container-host : Install container packages ---------------------------- 16.41s testnode : Install packages -------------------------------------------- 11.75s testnode : Ensure packages are not present. ---------------------------- 10.87s Remove revoked users ---------------------------------------------------- 6.91s testnode : Zap all non-root disks --------------------------------------- 5.97s container-host : Install registries-conf-ctl ---------------------------- 4.08s common : Update apt cache ----------------------------------------------- 3.75s Gathering Facts --------------------------------------------------------- 2.35s testnode : Install apt keys --------------------------------------------- 2.34s testnode : Update apt cache. -------------------------------------------- 2.20s container-host : Restart docker service --------------------------------- 1.86s users : Update authorized_keys for each user with literal keys ---------- 1.20s Gathering Facts --------------------------------------------------------- 1.18s testnode : Install python-pip on apt based systems. --------------------- 1.14s Gathering Facts --------------------------------------------------------- 1.06s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 1.04s common : Upload megacli and cl 2021-07-26T15:43:34.984 INFO:teuthology.task.ansible.out:i64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.03s 2021-07-26T15:43:35.381 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi067.front.sepia.ceph.com'), Remote(name='ubuntu@smithi087.front.sepia.ceph.com')] 2021-07-26T15:43:35.383 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:43:35.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi067.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:43:35.436 DEBUG:teuthology.orchestra.run.smithi067:> true 2021-07-26T15:43:35.557 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-07-26T15:43:35.558 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi087.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-07-26T15:43:35.608 DEBUG:teuthology.orchestra.run.smithi087:> true 2021-07-26T15:43:35.741 INFO:teuthology.run_tasks:Running task clock... 2021-07-26T15:43:35.995 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-07-26T15:43:35.997 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-07-26T15:43:36.002 DEBUG:teuthology.orchestra.run.smithi067:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-07-26T15:43:36.057 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-07-26T15:43:36.061 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: Command line: ntpd -gq 2021-07-26T15:43:36.063 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: proto: precision = 0.112 usec (-23) 2021-07-26T15:43:36.065 INFO:teuthology.orchestra.run.smithi067.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:43:36.066 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:43:36.067 INFO:teuthology.orchestra.run.smithi067.stderr:restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:43:36.069 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:43:36.070 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: Listen and drop on 0 v6wildcard [::]:123 2021-07-26T15:43:36.072 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-07-26T15:43:36.073 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: Listen normally on 2 lo 127.0.0.1:123 2021-07-26T15:43:36.074 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: Listen normally on 3 enp3s0f1 172.21.15.67:123 2021-07-26T15:43:36.074 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: Listen normally on 4 lo [::1]:123 2021-07-26T15:43:36.074 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:feb6:fc0b%5]:123 2021-07-26T15:43:36.075 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:36 ntpd[10188]: Listening on routing socket on fd #22 for interface updates 2021-07-26T15:43:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:37 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:37 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:37.058 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:37 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:37 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:37 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:37.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:37 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:38.058 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:38 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:38.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:38 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:38.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:38 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:38.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:38 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:38.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:38 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:38.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:38 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:39.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:39.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:39.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:39.063 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:39 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:40.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:40.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:40.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:40.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:40.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:40.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:40.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:40.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:40.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:40.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:40.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:40.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:40 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:41.058 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:41.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:41.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:41.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:41.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:41.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:41.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:41.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:41.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:41.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:41.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:41 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:42.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:42.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:42.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:42.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:42.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:42.063 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:42.063 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:42.063 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:42.063 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:42.064 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:42.064 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:42.064 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:42 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:43.059 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:43.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:43.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:43.060 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:43.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:43.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:43.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:43.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:43.061 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:43.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:43.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:43.062 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:43.063 INFO:teuthology.orchestra.run.smithi067.stdout:26 Jul 15:43:43 ntpd[10188]: ntpd: time slew -0.005230 s 2021-07-26T15:43:43.063 INFO:teuthology.orchestra.run.smithi067.stdout:ntpd: time slew -0.005230s 2021-07-26T15:43:43.063 INFO:teuthology.orchestra.run.smithi067.stderr:26 Jul 15:43:43 ntpd[10188]: can't open /var/log/ntpstats/loopstats.20210726: Permission denied 2021-07-26T15:43:43.119 INFO:teuthology.orchestra.run.smithi067.stdout: remote refid st t when poll reach delay offset jitter 2021-07-26T15:43:43.119 INFO:teuthology.orchestra.run.smithi067.stdout:============================================================================== 2021-07-26T15:43:43.120 INFO:teuthology.orchestra.run.smithi067.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:43.120 INFO:teuthology.orchestra.run.smithi067.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:43.120 INFO:teuthology.orchestra.run.smithi067.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:43.120 INFO:teuthology.orchestra.run.smithi067.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:43.122 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-07-26T15:43:43.122 DEBUG:teuthology.orchestra.run.smithi087:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-07-26T15:43:43.158 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-07-26T15:43:43.158 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: Command line: ntpd -gq 2021-07-26T15:43:43.159 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: proto: precision = 0.084 usec (-23) 2021-07-26T15:43:43.159 INFO:teuthology.orchestra.run.smithi087.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:43:43.160 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-07-26T15:43:43.161 INFO:teuthology.orchestra.run.smithi087.stderr:restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:43:43.162 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: restrict ::: KOD does nothing without LIMITED. 2021-07-26T15:43:43.163 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: Listen and drop on 0 v6wildcard [::]:123 2021-07-26T15:43:43.163 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-07-26T15:43:43.163 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: Listen normally on 2 lo 127.0.0.1:123 2021-07-26T15:43:43.164 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: Listen normally on 3 enp3s0f1 172.21.15.87:123 2021-07-26T15:43:43.164 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: Listen normally on 4 lo [::1]:123 2021-07-26T15:43:43.164 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d5f5%5]:123 2021-07-26T15:43:43.164 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:43 ntpd[10182]: Listening on routing socket on fd #22 for interface updates 2021-07-26T15:43:44.159 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:44.160 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:44.160 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:44.160 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:44.160 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:44.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:44.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:44.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:44.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:44.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:44.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:44.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:44 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:46.160 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:46.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:46.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:46.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:46.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:46.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:46.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:46.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:46.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:46.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:46.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:46.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:46.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:46.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:46.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:46.164 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:46.165 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:46.166 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:46 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:48.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:48.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:48.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:48.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:48.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:48.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:48.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:48.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:48.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:48.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:48.164 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:48.164 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:48.164 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:48.164 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:48.164 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:48.165 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:48.165 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:48.165 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:48.165 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:48.166 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:48.166 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:48.166 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:48.166 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:48.166 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:48 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:50.160 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:50.160 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:50.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:50.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:50.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:50.161 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:50.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:50.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:50.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:50.162 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:50.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:50.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:50.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-07-26T15:43:50.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: can't open /var/log/ntpstats/rawstats.20210726: Permission denied 2021-07-26T15:43:50.163 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-07-26T15:43:50.164 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: can't open /var/log/ntpstats/peerstats.20210726: Permission denied 2021-07-26T15:43:50.164 INFO:teuthology.orchestra.run.smithi087.stdout:26 Jul 15:43:50 ntpd[10182]: ntpd: time slew -0.001202 s 2021-07-26T15:43:50.164 INFO:teuthology.orchestra.run.smithi087.stdout:ntpd: time slew -0.001202s 2021-07-26T15:43:50.165 INFO:teuthology.orchestra.run.smithi087.stderr:26 Jul 15:43:50 ntpd[10182]: can't open /var/log/ntpstats/loopstats.20210726: Permission denied 2021-07-26T15:43:50.216 INFO:teuthology.orchestra.run.smithi087.stdout: remote refid st t when poll reach delay offset jitter 2021-07-26T15:43:50.217 INFO:teuthology.orchestra.run.smithi087.stdout:============================================================================== 2021-07-26T15:43:50.217 INFO:teuthology.orchestra.run.smithi087.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:50.217 INFO:teuthology.orchestra.run.smithi087.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:50.218 INFO:teuthology.orchestra.run.smithi087.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:50.218 INFO:teuthology.orchestra.run.smithi087.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-07-26T15:43:50.219 INFO:teuthology.run_tasks:Running task install... 2021-07-26T15:43:50.231 DEBUG:teuthology.task.install:project ceph 2021-07-26T15:43:50.233 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}} 2021-07-26T15:43:50.233 DEBUG:teuthology.task.install:config {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'} 2021-07-26T15:43:50.234 INFO:teuthology.task.install:Using flavor: basic 2021-07-26T15:43:50.240 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-07-26T15:43:50.241 INFO:teuthology.task.install:extra packages: [] 2021-07-26T15:43:50.242 DEBUG:teuthology.orchestra.run.smithi067:> sudo lsb_release -is 2021-07-26T15:43:50.293 INFO:teuthology.orchestra.run.smithi067.stdout:Ubuntu 2021-07-26T15:43:50.299 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:43:50.300 DEBUG:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2021-07-26T15:43:50.300 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-key list | grep Ceph 2021-07-26T15:43:50.350 INFO:teuthology.orchestra.run.smithi087.stdout:Ubuntu 2021-07-26T15:43:50.355 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:43:50.356 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-key list | grep Ceph 2021-07-26T15:43:50.398 INFO:teuthology.orchestra.run.smithi067.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-07-26T15:43:50.453 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-07-26T15:43:50.459 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-07-26T15:43:50.459 INFO:teuthology.orchestra.run.smithi067.stdout:uid [ unknown] Ceph.com (release key) 2021-07-26T15:43:50.461 DEBUG:teuthology.orchestra.run.smithi067:> sudo lsb_release -is 2021-07-26T15:43:50.511 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-07-26T15:43:50.511 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph.com (release key) 2021-07-26T15:43:50.513 DEBUG:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2021-07-26T15:43:50.514 INFO:teuthology.orchestra.run.smithi067.stdout:Ubuntu 2021-07-26T15:43:50.518 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:43:50.518 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-07-26T15:43:50.519 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:43:50.519 INFO:teuthology.packaging:ref: None 2021-07-26T15:43:50.519 INFO:teuthology.packaging:tag: None 2021-07-26T15:43:50.520 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:43:50.520 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:43:50.520 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:43:50.562 INFO:teuthology.orchestra.run.smithi087.stdout:Ubuntu 2021-07-26T15:43:50.567 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:43:50.568 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-07-26T15:43:50.568 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:43:50.569 INFO:teuthology.packaging:ref: None 2021-07-26T15:43:50.569 INFO:teuthology.packaging:tag: None 2021-07-26T15:43:50.569 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:43:50.569 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:43:50.570 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:43:50.787 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default/ 2021-07-26T15:43:50.787 INFO:teuthology.task.install.deb:Package version is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:43:50.793 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default/ 2021-07-26T15:43:50.793 INFO:teuthology.task.install.deb:Package version is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:43:50.928 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:43:50.929 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-07-26T15:43:50.936 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:43:50.936 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-07-26T15:43:50.946 DEBUG:teuthology.orchestra.run.smithi067:> sudo apt-get update 2021-07-26T15:43:50.953 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2021-07-26T15:43:51.088 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:43:51.094 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:43:51.153 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal InRelease 2021-07-26T15:43:51.159 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal InRelease 2021-07-26T15:43:51.177 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-07-26T15:43:51.183 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-07-26T15:43:51.204 INFO:teuthology.orchestra.run.smithi067.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release.gpg 2021-07-26T15:43:51.206 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:43:51.208 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release.gpg 2021-07-26T15:43:51.214 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:43:51.231 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-07-26T15:43:51.232 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 Packages [15.8 kB] 2021-07-26T15:43:51.266 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main i386 Packages [3,062 B] 2021-07-26T15:43:51.267 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main i386 Packages [3,062 B] 2021-07-26T15:43:51.288 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:43:51.297 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:43:51.377 INFO:teuthology.orchestra.run.smithi067.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-07-26T15:43:51.379 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-07-26T15:43:51.743 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 26.5 kB in 1s (42.4 kB/s) 2021-07-26T15:43:51.756 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 26.5 kB in 1s (41.1 kB/s) 2021-07-26T15:43:52.512 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-07-26T15:43:52.536 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.13-213-g0f589fd5-1focal cephadm=15.2.13-213-g0f589fd5-1focal ceph-mds=15.2.13-213-g0f589fd5-1focal ceph-mgr=15.2.13-213-g0f589fd5-1focal ceph-common=15.2.13-213-g0f589fd5-1focal ceph-fuse=15.2.13-213-g0f589fd5-1focal ceph-test=15.2.13-213-g0f589fd5-1focal radosgw=15.2.13-213-g0f589fd5-1focal python3-rados=15.2.13-213-g0f589fd5-1focal python3-rgw=15.2.13-213-g0f589fd5-1focal python3-cephfs=15.2.13-213-g0f589fd5-1focal python3-rbd=15.2.13-213-g0f589fd5-1focal libcephfs2=15.2.13-213-g0f589fd5-1focal libcephfs-dev=15.2.13-213-g0f589fd5-1focal librados2=15.2.13-213-g0f589fd5-1focal librbd1=15.2.13-213-g0f589fd5-1focal rbd-fuse=15.2.13-213-g0f589fd5-1focal 2021-07-26T15:43:52.543 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2021-07-26T15:43:52.564 DEBUG:teuthology.orchestra.run.smithi067:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.13-213-g0f589fd5-1focal cephadm=15.2.13-213-g0f589fd5-1focal ceph-mds=15.2.13-213-g0f589fd5-1focal ceph-mgr=15.2.13-213-g0f589fd5-1focal ceph-common=15.2.13-213-g0f589fd5-1focal ceph-fuse=15.2.13-213-g0f589fd5-1focal ceph-test=15.2.13-213-g0f589fd5-1focal radosgw=15.2.13-213-g0f589fd5-1focal python3-rados=15.2.13-213-g0f589fd5-1focal python3-rgw=15.2.13-213-g0f589fd5-1focal python3-cephfs=15.2.13-213-g0f589fd5-1focal python3-rbd=15.2.13-213-g0f589fd5-1focal libcephfs2=15.2.13-213-g0f589fd5-1focal libcephfs-dev=15.2.13-213-g0f589fd5-1focal librados2=15.2.13-213-g0f589fd5-1focal librbd1=15.2.13-213-g0f589fd5-1focal rbd-fuse=15.2.13-213-g0f589fd5-1focal 2021-07-26T15:43:52.610 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-07-26T15:43:52.633 INFO:teuthology.orchestra.run.smithi067.stdout:Reading package lists... 2021-07-26T15:43:52.768 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-07-26T15:43:52.769 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-07-26T15:43:52.781 INFO:teuthology.orchestra.run.smithi067.stdout:Building dependency tree... 2021-07-26T15:43:52.781 INFO:teuthology.orchestra.run.smithi067.stdout:Reading state information... 2021-07-26T15:43:52.897 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2021-07-26T15:43:52.898 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-07-26T15:43:52.899 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2021-07-26T15:43:52.899 INFO:teuthology.orchestra.run.smithi087.stdout:The following additional packages will be installed: 2021-07-26T15:43:52.899 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-07-26T15:43:52.900 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-07-26T15:43:52.900 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-07-26T15:43:52.900 INFO:teuthology.orchestra.run.smithi087.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-07-26T15:43:52.900 INFO:teuthology.orchestra.run.smithi087.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-07-26T15:43:52.900 INFO:teuthology.orchestra.run.smithi087.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-07-26T15:43:52.901 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-07-26T15:43:52.901 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2021-07-26T15:43:52.901 INFO:teuthology.orchestra.run.smithi087.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2021-07-26T15:43:52.901 INFO:teuthology.orchestra.run.smithi087.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-07-26T15:43:52.901 INFO:teuthology.orchestra.run.smithi087.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-07-26T15:43:52.902 INFO:teuthology.orchestra.run.smithi087.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-07-26T15:43:52.902 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:43:52.902 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-07-26T15:43:52.902 INFO:teuthology.orchestra.run.smithi087.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-07-26T15:43:52.903 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-07-26T15:43:52.903 INFO:teuthology.orchestra.run.smithi087.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2021-07-26T15:43:52.903 INFO:teuthology.orchestra.run.smithi087.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2021-07-26T15:43:52.903 INFO:teuthology.orchestra.run.smithi087.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2021-07-26T15:43:52.903 INFO:teuthology.orchestra.run.smithi087.stdout:Suggested packages: 2021-07-26T15:43:52.904 INFO:teuthology.orchestra.run.smithi087.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-07-26T15:43:52.904 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-07-26T15:43:52.904 INFO:teuthology.orchestra.run.smithi087.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-07-26T15:43:52.904 INFO:teuthology.orchestra.run.smithi087.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-07-26T15:43:52.904 INFO:teuthology.orchestra.run.smithi087.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-07-26T15:43:52.905 INFO:teuthology.orchestra.run.smithi087.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-07-26T15:43:52.905 INFO:teuthology.orchestra.run.smithi087.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-07-26T15:43:52.905 INFO:teuthology.orchestra.run.smithi087.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-07-26T15:43:52.905 INFO:teuthology.orchestra.run.smithi087.stdout:Recommended packages: 2021-07-26T15:43:52.905 INFO:teuthology.orchestra.run.smithi087.stdout: btrfs-tools 2021-07-26T15:43:52.911 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages were automatically installed and are no longer required: 2021-07-26T15:43:52.915 INFO:teuthology.orchestra.run.smithi067.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-07-26T15:43:52.916 INFO:teuthology.orchestra.run.smithi067.stdout:Use 'sudo apt autoremove' to remove them. 2021-07-26T15:43:52.916 INFO:teuthology.orchestra.run.smithi067.stdout:The following additional packages will be installed: 2021-07-26T15:43:52.916 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-07-26T15:43:52.916 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-07-26T15:43:52.916 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon ceph-osd jq libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 2021-07-26T15:43:52.917 INFO:teuthology.orchestra.run.smithi067.stdout: libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 2021-07-26T15:43:52.917 INFO:teuthology.orchestra.run.smithi067.stdout: librdkafka1 librgw2 libxslt1.1 nvme-cli python-pastedeploy-tpl 2021-07-26T15:43:52.917 INFO:teuthology.orchestra.run.smithi067.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-blinker python3-bs4 2021-07-26T15:43:52.917 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common 2021-07-26T15:43:52.918 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cherrypy3 python3-cryptography python3-decorator python3-google-auth 2021-07-26T15:43:52.918 INFO:teuthology.orchestra.run.smithi067.stdout: python3-html5lib python3-jinja2 python3-joblib python3-jwt 2021-07-26T15:43:52.918 INFO:teuthology.orchestra.run.smithi067.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-07-26T15:43:52.918 INFO:teuthology.orchestra.run.smithi067.stdout: python3-markupsafe python3-oauthlib python3-openssl python3-packaging 2021-07-26T15:43:52.918 INFO:teuthology.orchestra.run.smithi067.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-07-26T15:43:52.919 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:43:52.919 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-07-26T15:43:52.919 INFO:teuthology.orchestra.run.smithi067.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-07-26T15:43:52.921 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2021-07-26T15:43:52.921 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2021-07-26T15:43:52.921 INFO:teuthology.orchestra.run.smithi067.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2021-07-26T15:43:52.922 INFO:teuthology.orchestra.run.smithi067.stdout: python3-websocket python3-webtest python3-werkzeug socat xmlstarlet 2021-07-26T15:43:52.922 INFO:teuthology.orchestra.run.smithi067.stdout:Suggested packages: 2021-07-26T15:43:52.922 INFO:teuthology.orchestra.run.smithi067.stdout: python3-influxdb python-attr-doc python-blinker-doc python-cryptography-doc 2021-07-26T15:43:52.922 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2021-07-26T15:43:52.922 INFO:teuthology.orchestra.run.smithi067.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-07-26T15:43:52.923 INFO:teuthology.orchestra.run.smithi067.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-07-26T15:43:52.923 INFO:teuthology.orchestra.run.smithi067.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-07-26T15:43:52.923 INFO:teuthology.orchestra.run.smithi067.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-07-26T15:43:52.924 INFO:teuthology.orchestra.run.smithi067.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-07-26T15:43:52.927 INFO:teuthology.orchestra.run.smithi067.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-07-26T15:43:52.927 INFO:teuthology.orchestra.run.smithi067.stdout:Recommended packages: 2021-07-26T15:43:52.927 INFO:teuthology.orchestra.run.smithi067.stdout: btrfs-tools 2021-07-26T15:43:52.988 INFO:teuthology.orchestra.run.smithi087.stdout:The following NEW packages will be installed: 2021-07-26T15:43:52.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-07-26T15:43:52.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-07-26T15:43:52.989 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-07-26T15:43:52.990 INFO:teuthology.orchestra.run.smithi087.stdout: ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev libcephfs2 libjq1 2021-07-26T15:43:52.990 INFO:teuthology.orchestra.run.smithi087.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2021-07-26T15:43:52.990 INFO:teuthology.orchestra.run.smithi087.stdout: liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-07-26T15:43:52.990 INFO:teuthology.orchestra.run.smithi087.stdout: libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-07-26T15:43:52.991 INFO:teuthology.orchestra.run.smithi087.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-07-26T15:43:52.991 INFO:teuthology.orchestra.run.smithi087.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-07-26T15:43:52.991 INFO:teuthology.orchestra.run.smithi087.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2021-07-26T15:43:52.991 INFO:teuthology.orchestra.run.smithi087.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2021-07-26T15:43:52.991 INFO:teuthology.orchestra.run.smithi087.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-07-26T15:43:52.992 INFO:teuthology.orchestra.run.smithi087.stdout: python3-oauthlib python3-openssl python3-packaging python3-paste 2021-07-26T15:43:52.992 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-07-26T15:43:52.992 INFO:teuthology.orchestra.run.smithi087.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:43:52.992 INFO:teuthology.orchestra.run.smithi087.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-07-26T15:43:52.993 INFO:teuthology.orchestra.run.smithi087.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-07-26T15:43:52.993 INFO:teuthology.orchestra.run.smithi087.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-07-26T15:43:52.993 INFO:teuthology.orchestra.run.smithi087.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-07-26T15:43:52.993 INFO:teuthology.orchestra.run.smithi087.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-07-26T15:43:52.993 INFO:teuthology.orchestra.run.smithi087.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-07-26T15:43:52.994 INFO:teuthology.orchestra.run.smithi087.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-07-26T15:43:52.994 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages will be upgraded: 2021-07-26T15:43:52.994 INFO:teuthology.orchestra.run.smithi087.stdout: librados2 librbd1 2021-07-26T15:43:53.006 INFO:teuthology.orchestra.run.smithi067.stdout:The following NEW packages will be installed: 2021-07-26T15:43:53.006 INFO:teuthology.orchestra.run.smithi067.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-07-26T15:43:53.007 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-cloud 2021-07-26T15:43:53.007 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mgr-diskprediction-local ceph-mgr-k8sevents ceph-mgr-modules-core 2021-07-26T15:43:53.007 INFO:teuthology.orchestra.run.smithi067.stdout: ceph-mon ceph-osd ceph-test cephadm jq libcephfs-dev libcephfs2 libjq1 2021-07-26T15:43:53.007 INFO:teuthology.orchestra.run.smithi067.stdout: libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d liblttng-ust0 2021-07-26T15:43:53.008 INFO:teuthology.orchestra.run.smithi067.stdout: liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2021-07-26T15:43:53.009 INFO:teuthology.orchestra.run.smithi067.stdout: libxslt1.1 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-07-26T15:43:53.010 INFO:teuthology.orchestra.run.smithi067.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2021-07-26T15:43:53.010 INFO:teuthology.orchestra.run.smithi067.stdout: python3-ceph-argparse python3-ceph-common python3-cephfs python3-cherrypy3 2021-07-26T15:43:53.010 INFO:teuthology.orchestra.run.smithi067.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2021-07-26T15:43:53.010 INFO:teuthology.orchestra.run.smithi067.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2021-07-26T15:43:53.011 INFO:teuthology.orchestra.run.smithi067.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2021-07-26T15:43:53.011 INFO:teuthology.orchestra.run.smithi067.stdout: python3-oauthlib python3-openssl python3-packaging python3-paste 2021-07-26T15:43:53.011 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-07-26T15:43:53.011 INFO:teuthology.orchestra.run.smithi067.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-07-26T15:43:53.011 INFO:teuthology.orchestra.run.smithi067.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-07-26T15:43:53.012 INFO:teuthology.orchestra.run.smithi067.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-07-26T15:43:53.012 INFO:teuthology.orchestra.run.smithi067.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-07-26T15:43:53.012 INFO:teuthology.orchestra.run.smithi067.stdout: python3-simplejson python3-singledispatch python3-sklearn 2021-07-26T15:43:53.012 INFO:teuthology.orchestra.run.smithi067.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-07-26T15:43:53.013 INFO:teuthology.orchestra.run.smithi067.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-07-26T15:43:53.013 INFO:teuthology.orchestra.run.smithi067.stdout: python3-webtest python3-werkzeug radosgw rbd-fuse socat xmlstarlet 2021-07-26T15:43:53.013 INFO:teuthology.orchestra.run.smithi067.stdout:The following packages will be upgraded: 2021-07-26T15:43:53.013 INFO:teuthology.orchestra.run.smithi067.stdout: librados2 librbd1 2021-07-26T15:43:53.162 INFO:teuthology.orchestra.run.smithi087.stdout:2 upgraded, 97 newly installed, 0 to remove and 143 not upgraded. 2021-07-26T15:43:53.164 INFO:teuthology.orchestra.run.smithi087.stdout:Need to get 153 MB of archives. 2021-07-26T15:43:53.164 INFO:teuthology.orchestra.run.smithi087.stdout:After this operation, 697 MB of additional disk space will be used. 2021-07-26T15:43:53.164 INFO:teuthology.orchestra.run.smithi087.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.13-213-g0f589fd5-1focal [1,694 kB] 2021-07-26T15:43:53.170 INFO:teuthology.orchestra.run.smithi067.stdout:2 upgraded, 97 newly installed, 0 to remove and 143 not upgraded. 2021-07-26T15:43:53.170 INFO:teuthology.orchestra.run.smithi067.stdout:Need to get 153 MB of archives. 2021-07-26T15:43:53.171 INFO:teuthology.orchestra.run.smithi067.stdout:After this operation, 697 MB of additional disk space will be used. 2021-07-26T15:43:53.172 INFO:teuthology.orchestra.run.smithi067.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 15.2.13-213-g0f589fd5-1focal [1,694 kB] 2021-07-26T15:43:53.179 INFO:teuthology.orchestra.run.smithi087.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-07-26T15:43:53.202 INFO:teuthology.orchestra.run.smithi067.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-07-26T15:43:53.363 INFO:teuthology.orchestra.run.smithi067.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.13-213-g0f589fd5-1focal [3,247 kB] 2021-07-26T15:43:53.384 INFO:teuthology.orchestra.run.smithi087.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 15.2.13-213-g0f589fd5-1focal [3,247 kB] 2021-07-26T15:43:53.549 INFO:teuthology.orchestra.run.smithi067.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.13-213-g0f589fd5-1focal [463 kB] 2021-07-26T15:43:53.570 INFO:teuthology.orchestra.run.smithi067.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.13-213-g0f589fd5-1focal [366 kB] 2021-07-26T15:43:53.571 INFO:teuthology.orchestra.run.smithi067.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-07-26T15:43:53.582 INFO:teuthology.orchestra.run.smithi087.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-07-26T15:43:53.582 INFO:teuthology.orchestra.run.smithi067.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-07-26T15:43:53.582 INFO:teuthology.orchestra.run.smithi067.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-07-26T15:43:53.584 INFO:teuthology.orchestra.run.smithi087.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-07-26T15:43:53.593 INFO:teuthology.orchestra.run.smithi087.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 15.2.13-213-g0f589fd5-1focal [463 kB] 2021-07-26T15:43:53.602 INFO:teuthology.orchestra.run.smithi087.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-07-26T15:43:53.606 INFO:teuthology.orchestra.run.smithi087.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 15.2.13-213-g0f589fd5-1focal [366 kB] 2021-07-26T15:43:53.610 INFO:teuthology.orchestra.run.smithi067.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.13-213-g0f589fd5-1focal [20.8 kB] 2021-07-26T15:43:53.611 INFO:teuthology.orchestra.run.smithi067.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.13-213-g0f589fd5-1focal [156 kB] 2021-07-26T15:43:53.615 INFO:teuthology.orchestra.run.smithi067.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.13-213-g0f589fd5-1focal [29.0 kB] 2021-07-26T15:43:53.616 INFO:teuthology.orchestra.run.smithi067.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.13-213-g0f589fd5-1focal [363 kB] 2021-07-26T15:43:53.630 INFO:teuthology.orchestra.run.smithi067.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.13-213-g0f589fd5-1focal [3,140 kB] 2021-07-26T15:43:53.656 INFO:teuthology.orchestra.run.smithi087.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 15.2.13-213-g0f589fd5-1focal [20.8 kB] 2021-07-26T15:43:53.657 INFO:teuthology.orchestra.run.smithi087.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 15.2.13-213-g0f589fd5-1focal [156 kB] 2021-07-26T15:43:53.664 INFO:teuthology.orchestra.run.smithi087.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 15.2.13-213-g0f589fd5-1focal [29.0 kB] 2021-07-26T15:43:53.665 INFO:teuthology.orchestra.run.smithi087.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 15.2.13-213-g0f589fd5-1focal [363 kB] 2021-07-26T15:43:53.671 INFO:teuthology.orchestra.run.smithi087.stdout:Get:13 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 15.2.13-213-g0f589fd5-1focal [3,140 kB] 2021-07-26T15:43:53.722 INFO:teuthology.orchestra.run.smithi067.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-07-26T15:43:53.731 INFO:teuthology.orchestra.run.smithi087.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-07-26T15:43:53.765 INFO:teuthology.orchestra.run.smithi067.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-07-26T15:43:53.779 INFO:teuthology.orchestra.run.smithi067.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-07-26T15:43:53.785 INFO:teuthology.orchestra.run.smithi087.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-07-26T15:43:53.791 INFO:teuthology.orchestra.run.smithi087.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2021-07-26T15:43:53.809 INFO:teuthology.orchestra.run.smithi067.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-07-26T15:43:53.813 INFO:teuthology.orchestra.run.smithi067.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-07-26T15:43:53.815 INFO:teuthology.orchestra.run.smithi067.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-07-26T15:43:53.815 INFO:teuthology.orchestra.run.smithi087.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-07-26T15:43:53.830 INFO:teuthology.orchestra.run.smithi087.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-07-26T15:43:53.838 INFO:teuthology.orchestra.run.smithi087.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-07-26T15:43:53.847 INFO:teuthology.orchestra.run.smithi067.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-07-26T15:43:53.847 INFO:teuthology.orchestra.run.smithi067.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-07-26T15:43:53.848 INFO:teuthology.orchestra.run.smithi067.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-07-26T15:43:53.849 INFO:teuthology.orchestra.run.smithi067.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-07-26T15:43:53.853 INFO:teuthology.orchestra.run.smithi067.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.13-213-g0f589fd5-1focal [116 kB] 2021-07-26T15:43:53.857 INFO:teuthology.orchestra.run.smithi067.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.13-213-g0f589fd5-1focal [360 kB] 2021-07-26T15:43:53.859 INFO:teuthology.orchestra.run.smithi087.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jwt all 1.7.1-2ubuntu2 [17.4 kB] 2021-07-26T15:43:53.861 INFO:teuthology.orchestra.run.smithi087.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-07-26T15:43:53.865 INFO:teuthology.orchestra.run.smithi087.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-07-26T15:43:53.867 INFO:teuthology.orchestra.run.smithi087.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-07-26T15:43:53.875 INFO:teuthology.orchestra.run.smithi067.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.13-213-g0f589fd5-1focal [20.0 MB] 2021-07-26T15:43:53.903 INFO:teuthology.orchestra.run.smithi087.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 15.2.13-213-g0f589fd5-1focal [116 kB] 2021-07-26T15:43:53.907 INFO:teuthology.orchestra.run.smithi087.stdout:Get:25 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 15.2.13-213-g0f589fd5-1focal [360 kB] 2021-07-26T15:43:53.920 INFO:teuthology.orchestra.run.smithi087.stdout:Get:26 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 15.2.13-213-g0f589fd5-1focal [20.0 MB] 2021-07-26T15:43:53.937 INFO:teuthology.orchestra.run.smithi067.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-07-26T15:43:53.938 INFO:teuthology.orchestra.run.smithi067.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-07-26T15:43:53.938 INFO:teuthology.orchestra.run.smithi067.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-07-26T15:43:53.942 INFO:teuthology.orchestra.run.smithi067.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-07-26T15:43:53.947 INFO:teuthology.orchestra.run.smithi067.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-07-26T15:43:53.948 INFO:teuthology.orchestra.run.smithi087.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-07-26T15:43:53.948 INFO:teuthology.orchestra.run.smithi087.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-07-26T15:43:53.949 INFO:teuthology.orchestra.run.smithi087.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-07-26T15:43:53.953 INFO:teuthology.orchestra.run.smithi087.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-07-26T15:43:53.954 INFO:teuthology.orchestra.run.smithi087.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-07-26T15:43:54.030 INFO:teuthology.orchestra.run.smithi067.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-07-26T15:43:54.033 INFO:teuthology.orchestra.run.smithi067.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-07-26T15:43:54.034 INFO:teuthology.orchestra.run.smithi067.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-07-26T15:43:54.040 INFO:teuthology.orchestra.run.smithi087.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-07-26T15:43:54.044 INFO:teuthology.orchestra.run.smithi087.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-07-26T15:43:54.046 INFO:teuthology.orchestra.run.smithi087.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-07-26T15:43:54.051 INFO:teuthology.orchestra.run.smithi067.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-07-26T15:43:54.052 INFO:teuthology.orchestra.run.smithi067.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-07-26T15:43:54.082 INFO:teuthology.orchestra.run.smithi087.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-07-26T15:43:54.083 INFO:teuthology.orchestra.run.smithi087.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-07-26T15:43:54.135 INFO:teuthology.orchestra.run.smithi067.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-07-26T15:43:54.136 INFO:teuthology.orchestra.run.smithi067.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-07-26T15:43:54.140 INFO:teuthology.orchestra.run.smithi067.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-07-26T15:43:54.145 INFO:teuthology.orchestra.run.smithi087.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-07-26T15:43:54.145 INFO:teuthology.orchestra.run.smithi087.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-07-26T15:43:54.146 INFO:teuthology.orchestra.run.smithi067.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-07-26T15:43:54.148 INFO:teuthology.orchestra.run.smithi067.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-07-26T15:43:54.149 INFO:teuthology.orchestra.run.smithi087.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-07-26T15:43:54.162 INFO:teuthology.orchestra.run.smithi087.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-07-26T15:43:54.171 INFO:teuthology.orchestra.run.smithi087.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-07-26T15:43:54.237 INFO:teuthology.orchestra.run.smithi067.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-07-26T15:43:54.241 INFO:teuthology.orchestra.run.smithi067.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-07-26T15:43:54.244 INFO:teuthology.orchestra.run.smithi067.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-07-26T15:43:54.244 INFO:teuthology.orchestra.run.smithi087.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2021-07-26T15:43:54.246 INFO:teuthology.orchestra.run.smithi067.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-07-26T15:43:54.247 INFO:teuthology.orchestra.run.smithi067.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-07-26T15:43:54.249 INFO:teuthology.orchestra.run.smithi087.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-07-26T15:43:54.253 INFO:teuthology.orchestra.run.smithi087.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-07-26T15:43:54.261 INFO:teuthology.orchestra.run.smithi087.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-07-26T15:43:54.261 INFO:teuthology.orchestra.run.smithi087.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-07-26T15:43:54.341 INFO:teuthology.orchestra.run.smithi067.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-07-26T15:43:54.346 INFO:teuthology.orchestra.run.smithi087.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-07-26T15:43:55.053 INFO:teuthology.orchestra.run.smithi067.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-07-26T15:43:55.098 INFO:teuthology.orchestra.run.smithi087.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-07-26T15:43:55.133 INFO:teuthology.orchestra.run.smithi067.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-07-26T15:43:55.143 INFO:teuthology.orchestra.run.smithi067.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-07-26T15:43:55.274 INFO:teuthology.orchestra.run.smithi087.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-07-26T15:43:55.282 INFO:teuthology.orchestra.run.smithi067.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-07-26T15:43:55.282 INFO:teuthology.orchestra.run.smithi067.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-07-26T15:43:55.283 INFO:teuthology.orchestra.run.smithi087.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-07-26T15:43:55.284 INFO:teuthology.orchestra.run.smithi067.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-07-26T15:43:55.284 INFO:teuthology.orchestra.run.smithi067.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-07-26T15:43:55.284 INFO:teuthology.orchestra.run.smithi067.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-07-26T15:43:55.285 INFO:teuthology.orchestra.run.smithi067.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-07-26T15:43:55.285 INFO:teuthology.orchestra.run.smithi067.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-07-26T15:43:55.286 INFO:teuthology.orchestra.run.smithi067.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-07-26T15:43:55.300 INFO:teuthology.orchestra.run.smithi087.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-07-26T15:43:55.300 INFO:teuthology.orchestra.run.smithi087.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-07-26T15:43:55.301 INFO:teuthology.orchestra.run.smithi087.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-07-26T15:43:55.301 INFO:teuthology.orchestra.run.smithi087.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-07-26T15:43:55.302 INFO:teuthology.orchestra.run.smithi087.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-07-26T15:43:55.302 INFO:teuthology.orchestra.run.smithi087.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2021-07-26T15:43:55.302 INFO:teuthology.orchestra.run.smithi087.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2021-07-26T15:43:55.318 INFO:teuthology.orchestra.run.smithi067.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-07-26T15:43:55.357 INFO:teuthology.orchestra.run.smithi087.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-07-26T15:43:55.384 INFO:teuthology.orchestra.run.smithi067.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-07-26T15:43:55.385 INFO:teuthology.orchestra.run.smithi067.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.13-213-g0f589fd5-1focal [5,301 kB] 2021-07-26T15:43:55.421 INFO:teuthology.orchestra.run.smithi087.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-07-26T15:43:55.422 INFO:teuthology.orchestra.run.smithi087.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-07-26T15:43:55.423 INFO:teuthology.orchestra.run.smithi087.stdout:Get:61 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 15.2.13-213-g0f589fd5-1focal [5,301 kB] 2021-07-26T15:43:55.427 INFO:teuthology.orchestra.run.smithi087.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-07-26T15:43:55.430 INFO:teuthology.orchestra.run.smithi087.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-07-26T15:43:55.433 INFO:teuthology.orchestra.run.smithi087.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-07-26T15:43:55.435 INFO:teuthology.orchestra.run.smithi087.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-07-26T15:43:55.438 INFO:teuthology.orchestra.run.smithi087.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-07-26T15:43:55.439 INFO:teuthology.orchestra.run.smithi087.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-07-26T15:43:55.441 INFO:teuthology.orchestra.run.smithi087.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-07-26T15:43:55.448 INFO:teuthology.orchestra.run.smithi067.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-07-26T15:43:55.450 INFO:teuthology.orchestra.run.smithi067.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-07-26T15:43:55.453 INFO:teuthology.orchestra.run.smithi067.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-07-26T15:43:55.454 INFO:teuthology.orchestra.run.smithi067.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-07-26T15:43:55.460 INFO:teuthology.orchestra.run.smithi067.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/main amd64 libxslt1.1 amd64 1.1.34-4 [152 kB] 2021-07-26T15:43:55.463 INFO:teuthology.orchestra.run.smithi067.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-07-26T15:43:55.466 INFO:teuthology.orchestra.run.smithi067.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-07-26T15:43:55.520 INFO:teuthology.orchestra.run.smithi087.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-07-26T15:43:55.522 INFO:teuthology.orchestra.run.smithi087.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-07-26T15:43:55.522 INFO:teuthology.orchestra.run.smithi087.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-07-26T15:43:55.522 INFO:teuthology.orchestra.run.smithi087.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-07-26T15:43:55.526 INFO:teuthology.orchestra.run.smithi087.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-07-26T15:43:55.533 INFO:teuthology.orchestra.run.smithi067.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-07-26T15:43:55.533 INFO:teuthology.orchestra.run.smithi067.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-07-26T15:43:55.536 INFO:teuthology.orchestra.run.smithi067.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-07-26T15:43:55.543 INFO:teuthology.orchestra.run.smithi087.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-07-26T15:43:55.603 INFO:teuthology.orchestra.run.smithi087.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-07-26T15:43:55.604 INFO:teuthology.orchestra.run.smithi087.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-07-26T15:43:55.604 INFO:teuthology.orchestra.run.smithi087.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-07-26T15:43:55.607 INFO:teuthology.orchestra.run.smithi087.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-07-26T15:43:55.615 INFO:teuthology.orchestra.run.smithi067.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-07-26T15:43:55.617 INFO:teuthology.orchestra.run.smithi067.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.3 [1,382 kB] 2021-07-26T15:43:55.638 INFO:teuthology.orchestra.run.smithi067.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-07-26T15:43:55.639 INFO:teuthology.orchestra.run.smithi067.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-07-26T15:43:55.640 INFO:teuthology.orchestra.run.smithi067.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-07-26T15:43:55.640 INFO:teuthology.orchestra.run.smithi067.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-07-26T15:43:55.641 INFO:teuthology.orchestra.run.smithi067.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-07-26T15:43:55.675 INFO:teuthology.orchestra.run.smithi067.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.13-213-g0f589fd5-1focal [162 kB] 2021-07-26T15:43:55.685 INFO:teuthology.orchestra.run.smithi087.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-07-26T15:43:55.685 INFO:teuthology.orchestra.run.smithi087.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-07-26T15:43:55.686 INFO:teuthology.orchestra.run.smithi087.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-07-26T15:43:55.689 INFO:teuthology.orchestra.run.smithi087.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-07-26T15:43:55.693 INFO:teuthology.orchestra.run.smithi067.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.13-213-g0f589fd5-1focal [1,401 kB] 2021-07-26T15:43:55.696 INFO:teuthology.orchestra.run.smithi067.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-07-26T15:43:55.697 INFO:teuthology.orchestra.run.smithi067.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-07-26T15:43:55.698 INFO:teuthology.orchestra.run.smithi067.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-07-26T15:43:55.734 INFO:teuthology.orchestra.run.smithi087.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 15.2.13-213-g0f589fd5-1focal [162 kB] 2021-07-26T15:43:55.739 INFO:teuthology.orchestra.run.smithi087.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 15.2.13-213-g0f589fd5-1focal [1,401 kB] 2021-07-26T15:43:55.778 INFO:teuthology.orchestra.run.smithi067.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.13-213-g0f589fd5-1focal [6,172 kB] 2021-07-26T15:43:55.779 INFO:teuthology.orchestra.run.smithi067.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2021-07-26T15:43:55.841 INFO:teuthology.orchestra.run.smithi087.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 15.2.13-213-g0f589fd5-1focal [6,172 kB] 2021-07-26T15:43:56.172 INFO:teuthology.orchestra.run.smithi067.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.13-213-g0f589fd5-1focal [23.8 MB] 2021-07-26T15:43:56.241 INFO:teuthology.orchestra.run.smithi087.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 15.2.13-213-g0f589fd5-1focal [23.8 MB] 2021-07-26T15:43:57.881 INFO:teuthology.orchestra.run.smithi067.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.13-213-g0f589fd5-1focal [3,996 B] 2021-07-26T15:43:57.882 INFO:teuthology.orchestra.run.smithi067.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.13-213-g0f589fd5-1focal [538 kB] 2021-07-26T15:43:57.882 INFO:teuthology.orchestra.run.smithi087.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 15.2.13-213-g0f589fd5-1focal [3,996 B] 2021-07-26T15:43:57.882 INFO:teuthology.orchestra.run.smithi087.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 15.2.13-213-g0f589fd5-1focal [538 kB] 2021-07-26T15:43:57.893 INFO:teuthology.orchestra.run.smithi087.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.13-213-g0f589fd5-1focal [2,006 kB] 2021-07-26T15:43:57.893 INFO:teuthology.orchestra.run.smithi067.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 15.2.13-213-g0f589fd5-1focal [2,006 kB] 2021-07-26T15:43:57.957 INFO:teuthology.orchestra.run.smithi067.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.13-213-g0f589fd5-1focal [53.1 kB] 2021-07-26T15:43:57.959 INFO:teuthology.orchestra.run.smithi067.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.13-213-g0f589fd5-1focal [58.1 kB] 2021-07-26T15:43:57.960 INFO:teuthology.orchestra.run.smithi067.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.13-213-g0f589fd5-1focal [3,204 kB] 2021-07-26T15:43:58.005 INFO:teuthology.orchestra.run.smithi087.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 15.2.13-213-g0f589fd5-1focal [53.1 kB] 2021-07-26T15:43:58.007 INFO:teuthology.orchestra.run.smithi087.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 15.2.13-213-g0f589fd5-1focal [58.1 kB] 2021-07-26T15:43:58.009 INFO:teuthology.orchestra.run.smithi087.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 15.2.13-213-g0f589fd5-1focal [3,204 kB] 2021-07-26T15:43:58.172 INFO:teuthology.orchestra.run.smithi067.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.13-213-g0f589fd5-1focal [34.3 kB] 2021-07-26T15:43:58.173 INFO:teuthology.orchestra.run.smithi067.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.13-213-g0f589fd5-1focal [7,891 kB] 2021-07-26T15:43:58.227 INFO:teuthology.orchestra.run.smithi087.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-cloud all 15.2.13-213-g0f589fd5-1focal [34.3 kB] 2021-07-26T15:43:58.228 INFO:teuthology.orchestra.run.smithi087.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 15.2.13-213-g0f589fd5-1focal [7,891 kB] 2021-07-26T15:43:58.677 INFO:teuthology.orchestra.run.smithi067.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.13-213-g0f589fd5-1focal [4,108 B] 2021-07-26T15:43:58.677 INFO:teuthology.orchestra.run.smithi067.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.13-213-g0f589fd5-1focal [39.9 MB] 2021-07-26T15:43:58.761 INFO:teuthology.orchestra.run.smithi087.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 15.2.13-213-g0f589fd5-1focal [4,108 B] 2021-07-26T15:43:58.761 INFO:teuthology.orchestra.run.smithi087.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 15.2.13-213-g0f589fd5-1focal [39.9 MB] 2021-07-26T15:44:01.571 INFO:teuthology.orchestra.run.smithi067.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.13-213-g0f589fd5-1focal [18.1 kB] 2021-07-26T15:44:01.572 INFO:teuthology.orchestra.run.smithi067.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.13-213-g0f589fd5-1focal [9,717 kB] 2021-07-26T15:44:01.723 INFO:teuthology.orchestra.run.smithi087.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 15.2.13-213-g0f589fd5-1focal [18.1 kB] 2021-07-26T15:44:01.723 INFO:teuthology.orchestra.run.smithi087.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 15.2.13-213-g0f589fd5-1focal [9,717 kB] 2021-07-26T15:44:02.180 INFO:teuthology.orchestra.run.smithi067.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.13-213-g0f589fd5-1focal [60.9 kB] 2021-07-26T15:44:02.383 INFO:teuthology.orchestra.run.smithi087.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 15.2.13-213-g0f589fd5-1focal [60.9 kB] 2021-07-26T15:44:02.771 INFO:teuthology.orchestra.run.smithi067.stdout:Fetched 153 MB in 9s (16.7 MB/s) 2021-07-26T15:44:02.920 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-07-26T15:44:02.953 INFO:teuthology.orchestra.run.smithi087.stdout:Fetched 153 MB in 9s (16.3 MB/s) 2021-07-26T15:44:02.960 INFO:teuthology.orchestra.run.smithi067.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138107 files and directories currently installed.) 2021-07-26T15:44:02.965 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../00-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-07-26T15:44:03.029 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:44:03.115 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-07-26T15:44:03.168 INFO:teuthology.orchestra.run.smithi087.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 138107 files and directories currently installed.) 2021-07-26T15:44:03.172 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../00-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-07-26T15:44:03.237 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:44:03.382 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../01-librbd1_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:03.541 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librbd1 (15.2.13-213-g0f589fd5-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:44:03.689 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../01-librbd1_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:03.883 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librbd1 (15.2.13-213-g0f589fd5-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:44:04.169 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../02-librados2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:04.395 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librados2 (15.2.13-213-g0f589fd5-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:44:04.452 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../02-librados2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:04.578 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librados2 (15.2.13-213-g0f589fd5-1focal) over (15.2.13-0ubuntu0.20.04.1) ... 2021-07-26T15:44:05.049 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs2. 2021-07-26T15:44:05.069 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../03-libcephfs2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:05.108 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:05.165 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs2. 2021-07-26T15:44:05.183 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../03-libcephfs2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:05.214 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:05.410 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rados. 2021-07-26T15:44:05.427 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../04-python3-rados_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:05.460 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rados (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:05.525 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rados. 2021-07-26T15:44:05.542 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../04-python3-rados_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:05.600 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rados (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:05.804 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-07-26T15:44:05.820 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../05-python3-ceph-argparse_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:05.862 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-argparse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:05.919 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-07-26T15:44:05.937 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../05-python3-ceph-argparse_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:05.977 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-argparse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:06.182 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cephfs. 2021-07-26T15:44:06.201 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../06-python3-cephfs_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:06.240 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cephfs (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:06.246 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cephfs. 2021-07-26T15:44:06.262 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../06-python3-cephfs_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:06.297 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cephfs (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:06.591 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-ceph-common. 2021-07-26T15:44:06.592 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-ceph-common. 2021-07-26T15:44:06.607 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../07-python3-ceph-common_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:06.613 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../07-python3-ceph-common_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:06.806 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:06.806 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:06.984 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-prettytable. 2021-07-26T15:44:06.985 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-prettytable. 2021-07-26T15:44:07.002 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../08-python3-prettytable_0.7.2-5_all.deb ... 2021-07-26T15:44:07.003 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../08-python3-prettytable_0.7.2-5_all.deb ... 2021-07-26T15:44:07.043 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-07-26T15:44:07.045 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-07-26T15:44:07.231 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rbd. 2021-07-26T15:44:07.247 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../09-python3-rbd_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:07.281 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rbd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:07.296 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rbd. 2021-07-26T15:44:07.311 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../09-python3-rbd_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:07.357 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rbd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:07.650 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-07-26T15:44:07.670 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../10-librabbitmq4_0.10.0-1_amd64.deb ... 2021-07-26T15:44:07.734 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:44:07.757 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-07-26T15:44:07.772 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../10-librabbitmq4_0.10.0-1_amd64.deb ... 2021-07-26T15:44:07.815 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:44:08.096 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-07-26T15:44:08.111 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../11-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-07-26T15:44:08.151 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-07-26T15:44:08.153 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:44:08.167 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../11-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-07-26T15:44:08.209 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:44:08.472 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package librgw2. 2021-07-26T15:44:08.488 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../12-librgw2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:08.523 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking librgw2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:08.545 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package librgw2. 2021-07-26T15:44:08.565 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../12-librgw2_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:08.603 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking librgw2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:09.050 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rgw. 2021-07-26T15:44:09.066 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../13-python3-rgw_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:09.133 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:09.181 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rgw. 2021-07-26T15:44:09.198 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../13-python3-rgw_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:09.239 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:09.494 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-07-26T15:44:09.500 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-07-26T15:44:09.515 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../14-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-07-26T15:44:09.520 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../14-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-07-26T15:44:09.550 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:44:09.552 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:44:09.894 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liboath0. 2021-07-26T15:44:09.913 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../15-liboath0_2.6.1-1.3_amd64.deb ... 2021-07-26T15:44:09.921 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liboath0. 2021-07-26T15:44:09.941 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../15-liboath0_2.6.1-1.3_amd64.deb ... 2021-07-26T15:44:09.952 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-07-26T15:44:09.980 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-07-26T15:44:10.274 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libradosstriper1. 2021-07-26T15:44:10.289 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libradosstriper1. 2021-07-26T15:44:10.293 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../16-libradosstriper1_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:10.306 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../16-libradosstriper1_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:10.324 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libradosstriper1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:10.347 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libradosstriper1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:10.733 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-common. 2021-07-26T15:44:10.752 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../17-ceph-common_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:10.769 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-common. 2021-07-26T15:44:10.783 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:10.789 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../17-ceph-common_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:10.829 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:12.755 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-base. 2021-07-26T15:44:12.774 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../18-ceph-base_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:12.824 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-base (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:12.866 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-base. 2021-07-26T15:44:12.882 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../18-ceph-base_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:12.934 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-base (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:13.726 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cryptography. 2021-07-26T15:44:13.745 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../19-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-07-26T15:44:13.784 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:44:13.887 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cryptography. 2021-07-26T15:44:13.903 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../19-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2021-07-26T15:44:13.945 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:44:14.264 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-openssl. 2021-07-26T15:44:14.281 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-07-26T15:44:14.322 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-07-26T15:44:14.433 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-openssl. 2021-07-26T15:44:14.452 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-07-26T15:44:14.508 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-07-26T15:44:14.607 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-07-26T15:44:14.623 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:14.666 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-modules-core (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:14.769 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-07-26T15:44:14.786 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:14.818 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-modules-core (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:14.978 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bcrypt. 2021-07-26T15:44:14.994 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-07-26T15:44:15.061 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:44:15.231 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-bcrypt. 2021-07-26T15:44:15.247 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-07-26T15:44:15.289 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:44:15.347 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cherrypy3. 2021-07-26T15:44:15.365 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-07-26T15:44:15.405 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:44:15.584 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cherrypy3. 2021-07-26T15:44:15.599 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-07-26T15:44:15.634 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:44:15.684 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jwt. 2021-07-26T15:44:15.701 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../24-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-07-26T15:44:15.750 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:44:16.011 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-logutils. 2021-07-26T15:44:16.020 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jwt. 2021-07-26T15:44:16.027 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../25-python3-logutils_0.3.3-7_all.deb ... 2021-07-26T15:44:16.040 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../24-python3-jwt_1.7.1-2ubuntu2_all.deb ... 2021-07-26T15:44:16.061 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-07-26T15:44:16.087 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:44:16.348 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-markupsafe. 2021-07-26T15:44:16.363 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../26-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-07-26T15:44:16.414 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:44:16.449 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-logutils. 2021-07-26T15:44:16.465 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../25-python3-logutils_0.3.3-7_all.deb ... 2021-07-26T15:44:16.507 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-07-26T15:44:16.717 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-mako. 2021-07-26T15:44:16.732 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../27-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-07-26T15:44:16.775 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:44:16.810 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-markupsafe. 2021-07-26T15:44:16.826 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../26-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-07-26T15:44:16.868 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:44:17.103 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplegeneric. 2021-07-26T15:44:17.121 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../28-python3-simplegeneric_0.8.1-3_all.deb ... 2021-07-26T15:44:17.161 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:44:17.195 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-mako. 2021-07-26T15:44:17.211 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../27-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-07-26T15:44:17.254 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:44:17.422 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-singledispatch. 2021-07-26T15:44:17.438 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../29-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-07-26T15:44:17.472 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:44:17.590 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplegeneric. 2021-07-26T15:44:17.609 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../28-python3-simplegeneric_0.8.1-3_all.deb ... 2021-07-26T15:44:17.667 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:44:17.774 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webob. 2021-07-26T15:44:17.791 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../30-python3-webob_1%3a1.8.5-2_all.deb ... 2021-07-26T15:44:17.833 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-07-26T15:44:17.985 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-singledispatch. 2021-07-26T15:44:18.004 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../29-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-07-26T15:44:18.059 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:44:18.161 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-soupsieve. 2021-07-26T15:44:18.176 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../31-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-07-26T15:44:18.219 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:44:18.395 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webob. 2021-07-26T15:44:18.413 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../30-python3-webob_1%3a1.8.5-2_all.deb ... 2021-07-26T15:44:18.454 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-07-26T15:44:18.563 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-bs4. 2021-07-26T15:44:18.581 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../32-python3-bs4_4.8.2-1_all.deb ... 2021-07-26T15:44:18.623 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-07-26T15:44:18.806 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-soupsieve. 2021-07-26T15:44:18.822 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../31-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-07-26T15:44:18.865 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:44:18.985 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-waitress. 2021-07-26T15:44:19.002 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../33-python3-waitress_1.4.1-1_all.deb ... 2021-07-26T15:44:19.046 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-07-26T15:44:19.194 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-bs4. 2021-07-26T15:44:19.209 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../32-python3-bs4_4.8.2-1_all.deb ... 2021-07-26T15:44:19.251 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-07-26T15:44:19.629 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-waitress. 2021-07-26T15:44:19.646 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../33-python3-waitress_1.4.1-1_all.deb ... 2021-07-26T15:44:19.806 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-07-26T15:44:19.846 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-tempita. 2021-07-26T15:44:19.865 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../34-python3-tempita_0.5.2-6_all.deb ... 2021-07-26T15:44:19.904 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-07-26T15:44:20.207 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-paste. 2021-07-26T15:44:20.223 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../35-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-07-26T15:44:20.266 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:44:20.450 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-tempita. 2021-07-26T15:44:20.469 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../34-python3-tempita_0.5.2-6_all.deb ... 2021-07-26T15:44:20.533 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-07-26T15:44:20.611 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-07-26T15:44:20.629 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../36-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-07-26T15:44:20.669 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:44:20.885 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-paste. 2021-07-26T15:44:20.905 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../35-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-07-26T15:44:20.947 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:44:21.005 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastedeploy. 2021-07-26T15:44:21.020 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../37-python3-pastedeploy_2.1.0-1_all.deb ... 2021-07-26T15:44:21.084 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:44:21.271 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-07-26T15:44:21.289 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../36-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-07-26T15:44:21.329 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:44:21.408 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webtest. 2021-07-26T15:44:21.424 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../38-python3-webtest_2.0.32-2_all.deb ... 2021-07-26T15:44:21.467 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-07-26T15:44:21.674 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastedeploy. 2021-07-26T15:44:21.690 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../37-python3-pastedeploy_2.1.0-1_all.deb ... 2021-07-26T15:44:21.733 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:44:21.802 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pecan. 2021-07-26T15:44:21.819 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../39-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-07-26T15:44:21.861 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:44:22.068 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webtest. 2021-07-26T15:44:22.086 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../38-python3-webtest_2.0.32-2_all.deb ... 2021-07-26T15:44:22.126 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-07-26T15:44:22.218 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-werkzeug. 2021-07-26T15:44:22.232 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../40-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-07-26T15:44:22.282 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:44:22.471 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pecan. 2021-07-26T15:44:22.488 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../39-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-07-26T15:44:22.529 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:44:22.694 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr. 2021-07-26T15:44:22.710 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../41-ceph-mgr_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:22.755 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:22.901 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-werkzeug. 2021-07-26T15:44:22.916 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../40-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-07-26T15:44:22.961 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:44:23.213 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mon. 2021-07-26T15:44:23.230 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../42-ceph-mon_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:23.271 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mon (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:23.395 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr. 2021-07-26T15:44:23.411 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../41-ceph-mgr_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:23.454 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:23.956 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mon. 2021-07-26T15:44:23.973 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../42-ceph-mon_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:24.015 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mon (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:24.235 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-osd. 2021-07-26T15:44:24.253 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../43-ceph-osd_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:24.291 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-osd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:25.627 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-osd. 2021-07-26T15:44:25.648 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../43-ceph-osd_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:25.718 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-osd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:26.797 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph. 2021-07-26T15:44:26.812 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../44-ceph_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:26.855 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:27.191 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-fuse. 2021-07-26T15:44:27.209 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../45-ceph-fuse_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:27.249 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:27.620 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mds. 2021-07-26T15:44:27.637 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../46-ceph-mds_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:27.677 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mds (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:28.123 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph. 2021-07-26T15:44:28.143 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../44-ceph_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:28.181 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package cephadm. 2021-07-26T15:44:28.190 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:28.200 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../47-cephadm_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:28.239 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:28.535 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-fuse. 2021-07-26T15:44:28.551 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../45-ceph-fuse_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:28.593 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:28.594 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-jinja2. 2021-07-26T15:44:28.608 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../48-python3-jinja2_2.10.1-2_all.deb ... 2021-07-26T15:44:28.651 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-07-26T15:44:28.961 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-07-26T15:44:28.980 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../49-ceph-mgr-cephadm_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:29.011 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mds. 2021-07-26T15:44:29.020 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:29.022 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../46-ceph-mds_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:29.062 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mds (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:29.365 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-repoze.lru. 2021-07-26T15:44:29.384 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../50-python3-repoze.lru_0.7-2_all.deb ... 2021-07-26T15:44:29.423 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-07-26T15:44:29.565 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package cephadm. 2021-07-26T15:44:29.583 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../47-cephadm_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:29.623 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:29.667 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjs-underscore. 2021-07-26T15:44:29.683 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../51-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-07-26T15:44:29.717 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:44:29.976 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-jinja2. 2021-07-26T15:44:29.978 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-07-26T15:44:29.992 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../48-python3-jinja2_2.10.1-2_all.deb ... 2021-07-26T15:44:29.994 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../52-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-07-26T15:44:30.028 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:44:30.034 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-07-26T15:44:30.297 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-routes. 2021-07-26T15:44:30.316 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../53-python3-routes_2.4.1-2_all.deb ... 2021-07-26T15:44:30.355 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-07-26T15:44:30.421 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-07-26T15:44:30.437 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../49-ceph-mgr-cephadm_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:30.479 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:30.725 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-07-26T15:44:30.744 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../54-ceph-mgr-dashboard_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:30.783 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-dashboard (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:30.824 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-repoze.lru. 2021-07-26T15:44:30.839 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../50-python3-repoze.lru_0.7-2_all.deb ... 2021-07-26T15:44:30.899 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-07-26T15:44:31.135 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjs-underscore. 2021-07-26T15:44:31.153 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../51-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2021-07-26T15:44:31.218 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:44:31.498 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-07-26T15:44:31.511 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../52-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-07-26T15:44:31.580 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:44:31.735 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-07-26T15:44:31.753 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-cloud_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:31.791 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:31.923 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-routes. 2021-07-26T15:44:31.942 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../53-python3-routes_2.4.1-2_all.deb ... 2021-07-26T15:44:31.981 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-07-26T15:44:32.136 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-decorator. 2021-07-26T15:44:32.151 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../56-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-07-26T15:44:32.194 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:44:32.351 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-07-26T15:44:32.369 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../54-ceph-mgr-dashboard_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:32.409 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-dashboard (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:32.497 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-07-26T15:44:32.514 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../57-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-07-26T15:44:32.555 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:44:32.883 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-scipy. 2021-07-26T15:44:32.901 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../58-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-07-26T15:44:32.941 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-07-26T15:44:33.458 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-diskprediction-cloud. 2021-07-26T15:44:33.475 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../55-ceph-mgr-diskprediction-cloud_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:33.524 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-diskprediction-cloud (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:33.861 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-decorator. 2021-07-26T15:44:33.878 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../56-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-07-26T15:44:33.919 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:44:34.221 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-07-26T15:44:34.241 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../57-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-07-26T15:44:34.288 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:44:34.309 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-07-26T15:44:34.325 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../59-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-07-26T15:44:34.368 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:44:34.624 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-scipy. 2021-07-26T15:44:34.641 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../58-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-07-26T15:44:34.682 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-07-26T15:44:34.937 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-joblib. 2021-07-26T15:44:34.957 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../60-python3-joblib_0.14.0-3_all.deb ... 2021-07-26T15:44:34.995 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-07-26T15:44:35.441 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-sklearn. 2021-07-26T15:44:35.460 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../61-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-07-26T15:44:35.499 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:44:36.195 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-07-26T15:44:36.214 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../59-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-07-26T15:44:36.242 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-07-26T15:44:36.253 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:44:36.256 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../62-ceph-mgr-diskprediction-local_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:36.300 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:36.833 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-joblib. 2021-07-26T15:44:36.850 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../60-python3-joblib_0.14.0-3_all.deb ... 2021-07-26T15:44:36.890 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-07-26T15:44:37.285 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-sklearn. 2021-07-26T15:44:37.301 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../61-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-07-26T15:44:37.368 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:44:37.477 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-cachetools. 2021-07-26T15:44:37.494 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../63-python3-cachetools_4.0.0-1_all.deb ... 2021-07-26T15:44:37.536 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-07-26T15:44:37.821 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1. 2021-07-26T15:44:37.841 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../64-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-07-26T15:44:37.879 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:44:38.118 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-07-26T15:44:38.135 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../62-ceph-mgr-diskprediction-local_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:38.176 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-diskprediction-local (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:38.236 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-07-26T15:44:38.250 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../65-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-07-26T15:44:38.292 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:44:38.603 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-rsa. 2021-07-26T15:44:38.619 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../66-python3-rsa_4.0-3_all.deb ... 2021-07-26T15:44:38.685 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-rsa (4.0-3) ... 2021-07-26T15:44:38.998 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-google-auth. 2021-07-26T15:44:39.016 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../67-python3-google-auth_1.5.1-2_all.deb ... 2021-07-26T15:44:39.056 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-07-26T15:44:39.305 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-cachetools. 2021-07-26T15:44:39.325 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../63-python3-cachetools_4.0.0-1_all.deb ... 2021-07-26T15:44:39.362 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-07-26T15:44:39.410 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-blinker. 2021-07-26T15:44:39.426 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../68-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-07-26T15:44:39.468 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:44:39.665 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1. 2021-07-26T15:44:39.685 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../64-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-07-26T15:44:39.723 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:44:39.771 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-oauthlib. 2021-07-26T15:44:39.789 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../69-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-07-26T15:44:39.829 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:44:40.076 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-07-26T15:44:40.094 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../65-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-07-26T15:44:40.134 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:44:40.191 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-07-26T15:44:40.209 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../70-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-07-26T15:44:40.249 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:44:40.462 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-rsa. 2021-07-26T15:44:40.479 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../66-python3-rsa_4.0-3_all.deb ... 2021-07-26T15:44:40.546 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-rsa (4.0-3) ... 2021-07-26T15:44:40.561 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-websocket. 2021-07-26T15:44:40.579 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../71-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-07-26T15:44:40.620 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:44:40.882 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-google-auth. 2021-07-26T15:44:40.899 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../67-python3-google-auth_1.5.1-2_all.deb ... 2021-07-26T15:44:40.940 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-07-26T15:44:40.956 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-kubernetes. 2021-07-26T15:44:40.972 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../72-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-07-26T15:44:41.015 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:44:41.293 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-blinker. 2021-07-26T15:44:41.310 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../68-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2021-07-26T15:44:41.368 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:44:41.626 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-07-26T15:44:41.643 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../73-ceph-mgr-k8sevents_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:41.684 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-mgr-k8sevents (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:41.721 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-oauthlib. 2021-07-26T15:44:41.738 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../69-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2021-07-26T15:44:41.779 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:44:42.038 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libonig5:amd64. 2021-07-26T15:44:42.057 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../74-libonig5_6.9.4-1_amd64.deb ... 2021-07-26T15:44:42.103 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:44:42.125 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-07-26T15:44:42.142 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../70-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-07-26T15:44:42.183 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:44:42.464 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libjq1:amd64. 2021-07-26T15:44:42.482 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../75-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:44:42.520 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-websocket. 2021-07-26T15:44:42.522 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:44:42.537 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../71-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-07-26T15:44:42.647 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:44:42.817 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package jq. 2021-07-26T15:44:42.833 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../76-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:44:42.875 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:44:43.004 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-kubernetes. 2021-07-26T15:44:43.025 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../72-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-07-26T15:44:43.062 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:44:43.128 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package socat. 2021-07-26T15:44:43.145 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../77-socat_1.7.3.3-2_amd64.deb ... 2021-07-26T15:44:43.195 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking socat (1.7.3.3-2) ... 2021-07-26T15:44:43.606 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-07-26T15:44:43.625 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../78-libxslt1.1_1.1.34-4_amd64.deb ... 2021-07-26T15:44:43.650 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-07-26T15:44:43.664 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:44:43.668 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../73-ceph-mgr-k8sevents_15.2.13-213-g0f589fd5-1focal_all.deb ... 2021-07-26T15:44:43.733 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-mgr-k8sevents (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:43.934 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package xmlstarlet. 2021-07-26T15:44:43.951 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../79-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-07-26T15:44:44.000 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:44:44.111 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libonig5:amd64. 2021-07-26T15:44:44.128 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../74-libonig5_6.9.4-1_amd64.deb ... 2021-07-26T15:44:44.169 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:44:44.355 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package ceph-test. 2021-07-26T15:44:44.372 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../80-ceph-test_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:44.413 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking ceph-test (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:44.547 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libjq1:amd64. 2021-07-26T15:44:44.564 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../75-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:44:44.605 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:44:44.908 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package jq. 2021-07-26T15:44:44.926 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../76-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-07-26T15:44:44.966 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:44:45.252 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package socat. 2021-07-26T15:44:45.268 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../77-socat_1.7.3.3-2_amd64.deb ... 2021-07-26T15:44:45.310 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking socat (1.7.3.3-2) ... 2021-07-26T15:44:45.714 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libxslt1.1:amd64. 2021-07-26T15:44:45.733 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../78-libxslt1.1_1.1.34-4_amd64.deb ... 2021-07-26T15:44:45.772 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:44:46.049 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package xmlstarlet. 2021-07-26T15:44:46.066 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../79-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-07-26T15:44:46.108 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:44:46.462 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package ceph-test. 2021-07-26T15:44:46.478 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../80-ceph-test_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:46.545 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking ceph-test (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:47.853 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package libcephfs-dev. 2021-07-26T15:44:47.872 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../81-libcephfs-dev_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:47.911 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking libcephfs-dev (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:48.330 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package nvme-cli. 2021-07-26T15:44:48.347 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../82-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-07-26T15:44:48.407 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:44:48.803 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-atomicwrites. 2021-07-26T15:44:48.818 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../83-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-07-26T15:44:48.860 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:44:49.167 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-attr. 2021-07-26T15:44:49.180 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../84-python3-attr_19.3.0-2_all.deb ... 2021-07-26T15:44:49.222 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-07-26T15:44:49.583 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-webencodings. 2021-07-26T15:44:49.599 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../85-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-07-26T15:44:49.641 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:44:49.909 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package libcephfs-dev. 2021-07-26T15:44:49.929 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../81-libcephfs-dev_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:49.961 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-html5lib. 2021-07-26T15:44:49.967 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking libcephfs-dev (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:49.978 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../86-python3-html5lib_1.0.1-2_all.deb ... 2021-07-26T15:44:50.019 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-07-26T15:44:50.380 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-07-26T15:44:50.398 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../87-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-07-26T15:44:50.421 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package nvme-cli. 2021-07-26T15:44:50.438 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../82-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-07-26T15:44:50.439 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:44:50.497 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:44:50.901 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-atomicwrites. 2021-07-26T15:44:50.918 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../83-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-07-26T15:44:50.960 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:44:51.400 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-packaging. 2021-07-26T15:44:51.418 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../88-python3-packaging_20.3-1_all.deb ... 2021-07-26T15:44:51.497 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-packaging (20.3-1) ... 2021-07-26T15:44:51.737 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-attr. 2021-07-26T15:44:51.757 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../84-python3-attr_19.3.0-2_all.deb ... 2021-07-26T15:44:51.811 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pastescript. 2021-07-26T15:44:51.820 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-07-26T15:44:51.831 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../89-python3-pastescript_2.0.2-4_all.deb ... 2021-07-26T15:44:51.869 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-07-26T15:44:52.181 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-webencodings. 2021-07-26T15:44:52.198 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../85-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-07-26T15:44:52.206 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pluggy. 2021-07-26T15:44:52.225 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../90-python3-pluggy_0.13.0-2_all.deb ... 2021-07-26T15:44:52.239 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:44:52.264 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-07-26T15:44:52.567 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-html5lib. 2021-07-26T15:44:52.586 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../86-python3-html5lib_1.0.1-2_all.deb ... 2021-07-26T15:44:52.618 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-psutil. 2021-07-26T15:44:52.625 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-07-26T15:44:52.634 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../91-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-07-26T15:44:52.676 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:44:53.029 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-07-26T15:44:53.029 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-py. 2021-07-26T15:44:53.046 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../87-python3-lxml_4.5.0-1ubuntu0.3_amd64.deb ... 2021-07-26T15:44:53.048 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../92-python3-py_1.8.1-1_all.deb ... 2021-07-26T15:44:53.087 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:44:53.095 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-py (1.8.1-1) ... 2021-07-26T15:44:53.426 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pyinotify. 2021-07-26T15:44:53.442 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../93-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-07-26T15:44:53.492 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:44:53.574 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-packaging. 2021-07-26T15:44:53.593 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../88-python3-packaging_20.3-1_all.deb ... 2021-07-26T15:44:53.632 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-packaging (20.3-1) ... 2021-07-26T15:44:53.820 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-wcwidth. 2021-07-26T15:44:53.837 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../94-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-07-26T15:44:53.878 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:44:53.959 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pastescript. 2021-07-26T15:44:53.976 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../89-python3-pastescript_2.0.2-4_all.deb ... 2021-07-26T15:44:54.017 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-07-26T15:44:54.167 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-pytest. 2021-07-26T15:44:54.184 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../95-python3-pytest_4.6.9-1_all.deb ... 2021-07-26T15:44:54.239 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-07-26T15:44:54.371 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pluggy. 2021-07-26T15:44:54.390 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../90-python3-pluggy_0.13.0-2_all.deb ... 2021-07-26T15:44:54.446 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-07-26T15:44:54.579 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package python3-simplejson. 2021-07-26T15:44:54.596 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../96-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-07-26T15:44:54.637 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:44:54.782 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-psutil. 2021-07-26T15:44:54.799 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../91-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-07-26T15:44:54.849 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:44:55.087 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package radosgw. 2021-07-26T15:44:55.105 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../97-radosgw_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:55.147 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking radosgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:55.245 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-py. 2021-07-26T15:44:55.265 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../92-python3-py_1.8.1-1_all.deb ... 2021-07-26T15:44:55.337 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-py (1.8.1-1) ... 2021-07-26T15:44:55.682 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pyinotify. 2021-07-26T15:44:55.701 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../93-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-07-26T15:44:55.740 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:44:56.088 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-wcwidth. 2021-07-26T15:44:56.101 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../94-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-07-26T15:44:56.143 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:44:56.332 INFO:teuthology.orchestra.run.smithi087.stdout:Selecting previously unselected package rbd-fuse. 2021-07-26T15:44:56.349 INFO:teuthology.orchestra.run.smithi087.stdout:Preparing to unpack .../98-rbd-fuse_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:56.397 INFO:teuthology.orchestra.run.smithi087.stdout:Unpacking rbd-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:56.473 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-pytest. 2021-07-26T15:44:56.488 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../95-python3-pytest_4.6.9-1_all.deb ... 2021-07-26T15:44:56.540 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-07-26T15:44:56.698 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-attr (19.3.0-2) ... 2021-07-26T15:44:56.919 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package python3-simplejson. 2021-07-26T15:44:56.940 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../96-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2021-07-26T15:44:56.978 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:44:57.036 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:44:57.161 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:44:57.287 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:44:57.479 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package radosgw. 2021-07-26T15:44:57.480 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:57.497 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../97-radosgw_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:57.546 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking radosgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:58.044 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user cephadm....done 2021-07-26T15:44:58.206 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-07-26T15:44:58.583 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-07-26T15:44:58.658 INFO:teuthology.orchestra.run.smithi067.stdout:Selecting previously unselected package rbd-fuse. 2021-07-26T15:44:58.674 INFO:teuthology.orchestra.run.smithi067.stdout:Preparing to unpack .../98-rbd-fuse_15.2.13-213-g0f589fd5-1focal_amd64.deb ... 2021-07-26T15:44:58.716 INFO:teuthology.orchestra.run.smithi067.stdout:Unpacking rbd-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:44:58.876 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-07-26T15:44:59.027 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-py (1.8.1-1) ... 2021-07-26T15:44:59.041 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-attr (19.3.0-2) ... 2021-07-26T15:44:59.345 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-07-26T15:44:59.370 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-07-26T15:44:59.498 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-07-26T15:44:59.650 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-07-26T15:44:59.755 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:44:59.834 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:00.049 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-07-26T15:45:00.351 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:45:00.471 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user cephadm....done 2021-07-26T15:45:00.644 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:45:00.657 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-07-26T15:45:00.953 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-argparse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:00.993 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-07-26T15:45:01.255 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:45:01.292 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-07-26T15:45:01.381 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:45:01.436 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-py (1.8.1-1) ... 2021-07-26T15:45:01.666 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:45:01.796 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-07-26T15:45:01.950 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:45:02.216 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jwt (1.7.1-2ubuntu2) ... 2021-07-26T15:45:02.326 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:45:02.501 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-07-26T15:45:02.604 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:45:02.793 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-07-26T15:45:02.989 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:45:03.516 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-07-26T15:45:03.517 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-07-26T15:45:03.517 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-argparse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:03.649 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-07-26T15:45:03.723 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-07-26T15:45:03.874 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-07-26T15:45:03.933 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-packaging (20.3-1) ... 2021-07-26T15:45:04.174 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-07-26T15:45:04.234 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:45:04.394 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:45:04.500 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-07-26T15:45:04.686 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:45:04.876 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-07-26T15:45:05.072 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:45:05.203 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2021-07-26T15:45:05.442 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:45:05.563 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-07-26T15:45:05.812 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up socat (1.7.3.3-2) ... 2021-07-26T15:45:05.881 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-07-26T15:45:05.939 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:06.240 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-07-26T15:45:06.273 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-07-26T15:45:06.541 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-packaging (20.3-1) ... 2021-07-26T15:45:06.758 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:45:06.867 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-07-26T15:45:06.875 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-07-26T15:45:07.018 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-07-26T15:45:07.185 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:45:07.318 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:45:07.330 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-07-26T15:45:07.662 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:45:07.742 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-07-26T15:45:07.955 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-07-26T15:45:08.126 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2021-07-26T15:45:08.223 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:45:08.350 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:45:08.503 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up socat (1.7.3.3-2) ... 2021-07-26T15:45:08.617 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-07-26T15:45:08.654 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:08.910 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:45:08.990 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-07-26T15:45:09.245 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:45:09.386 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-07-26T15:45:09.518 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-07-26T15:45:09.640 INFO:teuthology.orchestra.run.smithi087.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-07-26T15:45:09.826 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libxslt1.1:amd64 (1.1.34-4) ... 2021-07-26T15:45:09.922 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:45:09.952 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-07-26T15:45:10.049 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:45:10.278 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-07-26T15:45:10.366 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:45:10.555 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-07-26T15:45:10.718 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:45:10.843 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:45:10.847 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-07-26T15:45:10.970 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-07-26T15:45:10.974 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-07-26T15:45:11.266 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-07-26T15:45:11.329 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:45:11.568 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-07-26T15:45:11.631 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librados2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:11.790 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-07-26T15:45:11.900 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-07-26T15:45:12.211 INFO:teuthology.orchestra.run.smithi067.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-07-26T15:45:12.474 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-07-26T15:45:12.633 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-07-26T15:45:12.967 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-07-26T15:45:13.255 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librgw2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:13.336 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2021-07-26T15:45:13.381 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:45:13.462 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-07-26T15:45:13.507 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-07-26T15:45:13.604 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-07-26T15:45:13.884 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-07-26T15:45:13.930 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2021-07-26T15:45:14.194 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:45:14.217 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librados2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:14.367 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-07-26T15:45:14.501 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-07-26T15:45:14.826 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:14.955 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:45:15.306 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libradosstriper1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:15.421 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:45:15.731 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:45:15.890 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librgw2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:15.999 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:45:16.156 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-07-26T15:45:16.531 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-07-26T15:45:16.746 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up librbd1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:16.818 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-07-26T15:45:16.871 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:45:16.981 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:45:17.107 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:45:17.152 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-07-26T15:45:17.417 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:45:17.519 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs2 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:17.543 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rsa (4.0-3) ... 2021-07-26T15:45:17.644 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2021-07-26T15:45:17.844 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-07-26T15:45:17.971 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libradosstriper1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:18.072 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-07-26T15:45:18.137 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-modules-core (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:18.262 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:18.390 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-07-26T15:45:18.492 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:45:18.492 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:45:18.947 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up libcephfs-dev (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:19.107 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:45:19.392 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-07-26T15:45:19.471 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up librbd1 (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:19.595 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-07-26T15:45:19.693 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:45:19.697 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-07-26T15:45:19.798 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.3) ... 2021-07-26T15:45:20.045 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rados (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:20.100 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-07-26T15:45:20.171 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rbd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:20.226 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rsa (4.0-3) ... 2021-07-26T15:45:20.297 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up rbd-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:20.457 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-routes (2.4.1-2) ... 2021-07-26T15:45:20.544 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-07-26T15:45:20.766 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-07-26T15:45:20.845 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-modules-core (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:20.962 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:21.080 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-rgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:21.185 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-cephfs (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:21.194 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:45:21.194 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-07-26T15:45:21.546 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:45:21.647 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up libcephfs-dev (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:21.782 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-07-26T15:45:22.091 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-07-26T15:45:22.461 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:22.726 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-07-26T15:45:22.990 INFO:teuthology.orchestra.run.smithi087.stdout:Adding group ceph....done 2021-07-26T15:45:23.087 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rados (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:23.238 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rbd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:23.364 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up rbd-fuse (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:23.366 INFO:teuthology.orchestra.run.smithi087.stdout:Adding system user ceph....done 2021-07-26T15:45:23.473 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-routes (2.4.1-2) ... 2021-07-26T15:45:23.561 INFO:teuthology.orchestra.run.smithi087.stdout:Setting system user ceph properties....done 2021-07-26T15:45:23.584 INFO:teuthology.orchestra.run.smithi087.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-07-26T15:45:23.734 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-07-26T15:45:23.774 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-07-26T15:45:24.055 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-07-26T15:45:24.059 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-rgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:24.185 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-cephfs (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:24.507 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-test (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:24.589 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-07-26T15:45:24.633 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up radosgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:24.881 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:45:24.881 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:45:25.519 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-base (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:25.568 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-common (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:25.836 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-07-26T15:45:26.157 INFO:teuthology.orchestra.run.smithi067.stdout:Adding group ceph....done 2021-07-26T15:45:26.295 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mds (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:26.515 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:45:26.516 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:45:26.567 INFO:teuthology.orchestra.run.smithi067.stdout:Adding system user ceph....done 2021-07-26T15:45:26.767 INFO:teuthology.orchestra.run.smithi067.stdout:Setting system user ceph properties....done 2021-07-26T15:45:26.793 INFO:teuthology.orchestra.run.smithi067.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2021-07-26T15:45:26.946 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-07-26T15:45:26.963 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:27.212 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:45:27.213 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:45:27.273 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-07-26T15:45:27.648 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:27.730 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-test (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:27.767 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-osd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:27.881 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up radosgw (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:28.132 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:45:28.132 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-07-26T15:45:28.332 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:45:28.332 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:45:28.766 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-base (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:28.776 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-k8sevents (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:28.904 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-diskprediction-local (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:29.045 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mon (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:29.128 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-07-26T15:45:29.276 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:45:29.277 INFO:teuthology.orchestra.run.smithi087.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:45:29.592 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mds (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:29.730 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:29.820 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:45:29.820 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-07-26T15:45:29.914 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:30.040 INFO:teuthology.orchestra.run.smithi087.stdout:Setting up ceph-mgr-dashboard (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:30.184 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-07-26T15:45:30.286 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:30.459 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-07-26T15:45:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:45:30.519 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-07-26T15:45:30.996 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-diskprediction-cloud (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:31.138 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-osd (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:31.708 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:45:31.708 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-07-26T15:45:32.174 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-k8sevents (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:32.300 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-diskprediction-local (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:32.467 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mon (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:32.696 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:45:32.697 INFO:teuthology.orchestra.run.smithi067.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-07-26T15:45:33.146 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-cephadm (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:33.287 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:33.438 INFO:teuthology.orchestra.run.smithi067.stdout:Setting up ceph-mgr-dashboard (15.2.13-213-g0f589fd5-1focal) ... 2021-07-26T15:45:33.500 INFO:teuthology.orchestra.run.smithi087.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-07-26T15:45:33.584 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-07-26T15:45:33.895 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-07-26T15:45:33.908 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-07-26T15:45:33.911 DEBUG:teuthology.parallel:result is None 2021-07-26T15:45:36.990 INFO:teuthology.orchestra.run.smithi067.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.2) ... 2021-07-26T15:45:37.390 INFO:teuthology.orchestra.run.smithi067.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-07-26T15:45:37.392 DEBUG:teuthology.parallel:result is None 2021-07-26T15:45:37.393 DEBUG:teuthology.orchestra.run.smithi067:> sudo lsb_release -is 2021-07-26T15:45:37.443 INFO:teuthology.orchestra.run.smithi067.stdout:Ubuntu 2021-07-26T15:45:37.445 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:45:37.446 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:45:37.446 INFO:teuthology.packaging:ref: None 2021-07-26T15:45:37.447 INFO:teuthology.packaging:tag: None 2021-07-26T15:45:37.447 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:45:37.447 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:45:37.448 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:45:37.758 DEBUG:teuthology.orchestra.run.smithi067:> dpkg-query -W -f '${Version}' ceph 2021-07-26T15:45:37.782 INFO:teuthology.orchestra.run.smithi067.stdout:15.2.13-213-g0f589fd5-1focal 2021-07-26T15:45:37.783 INFO:teuthology.packaging:The installed version of ceph is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:45:37.783 INFO:teuthology.task.install:The correct ceph version 15.2.13-213-g0f589fd5-1focal is installed. 2021-07-26T15:45:37.784 DEBUG:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2021-07-26T15:45:37.837 INFO:teuthology.orchestra.run.smithi087.stdout:Ubuntu 2021-07-26T15:45:37.842 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:45:37.843 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:45:37.844 INFO:teuthology.packaging:ref: None 2021-07-26T15:45:37.845 INFO:teuthology.packaging:tag: None 2021-07-26T15:45:37.845 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:45:37.846 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:45:37.847 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:45:38.173 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-query -W -f '${Version}' ceph 2021-07-26T15:45:38.197 INFO:teuthology.orchestra.run.smithi087.stdout:15.2.13-213-g0f589fd5-1focal 2021-07-26T15:45:38.198 INFO:teuthology.packaging:The installed version of ceph is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:45:38.198 INFO:teuthology.task.install:The correct ceph version 15.2.13-213-g0f589fd5-1focal is installed. 2021-07-26T15:45:38.199 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-07-26T15:45:38.200 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:38.200 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-07-26T15:45:38.219 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:45:38.220 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-07-26T15:45:38.256 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-07-26T15:45:38.258 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:38.258 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/daemon-helper 2021-07-26T15:45:38.276 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-07-26T15:45:38.290 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:45:38.290 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/daemon-helper 2021-07-26T15:45:38.306 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-07-26T15:45:38.316 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-07-26T15:45:38.317 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:38.317 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/usr/bin/adjust-ulimits 2021-07-26T15:45:38.349 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-07-26T15:45:38.365 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:45:38.365 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/usr/bin/adjust-ulimits 2021-07-26T15:45:38.384 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-07-26T15:45:38.396 INFO:teuthology.run_tasks:Running task ceph... 2021-07-26T15:45:38.458 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-07-26T15:45:38.459 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 777 /var/log/ceph 2021-07-26T15:45:38.461 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 777 /var/log/ceph 2021-07-26T15:45:38.477 INFO:tasks.ceph:Disabling ceph logrotate... 2021-07-26T15:45:38.478 DEBUG:teuthology.orchestra.run.smithi067:> sudo rm -f -- /etc/logrotate.d/ceph 2021-07-26T15:45:38.519 DEBUG:teuthology.orchestra.run.smithi087:> sudo rm -f -- /etc/logrotate.d/ceph 2021-07-26T15:45:38.534 INFO:tasks.ceph:Creating extra log directories... 2021-07-26T15:45:38.535 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-07-26T15:45:38.538 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-07-26T15:45:38.609 INFO:tasks.ceph:Creating ceph cluster c1... 2021-07-26T15:45:38.609 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-07-26T15:45:38.610 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293853', 'branch': 'wip-kefu-testing-2021-07-24-1158', 'description': 'upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary}', 'email': None, 'first_in_suite': False, 'job_id': '6293853', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi', 'nuke-on-error': True, 'overrides': {'admin_socket': {'branch': 'wip-kefu-testing-2021-07-24-1158'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone3'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', 'tests_ps.py'], 'branch': 'octopus', 'repo': 'https://github.com/ceph/ceph.git'}, 'workunit': {'branch': 'wip-kefu-testing-2021-07-24-1158', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'owner': 'scheduled_sage@teuthology', 'priority': 90, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'sleep_before_teardown': 0, 'suite': 'upgrade', 'suite_branch': 'wip-kefu-testing-2021-07-24-1158', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'targets': {'smithi067.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW3/rIpnOb9l3Yyz6bZXXGq1w/Y4PLohUySyGWDeKu1qrSzsuJNZ8lcm4lqk1yZDEaHdhaIf/W2Csod3HvbpL2xt++asgvrveXs8xmPXU30cNzz7Ids1Nus48OLAnW1I4MMS5/SspyIc4brszUtEls3B60X4DhTztrpjPerQU4yguQtWjqngsp5LI69t0CmhMV5zYQCOSExMC3FofevQtEhJQjJ2dPKVOAcKIOLicpaLuBkfIJw1cX5vZaODr7JS3P9jnaIG157WS8uSlRmWB1xD94DCVCsIpekDW/hEbt4M/eGaWyLnb+UfmyJ3/fiW/0Fywg+84sIO46kR54i4AY5UPMRaL989+Cdp0oudvgNeh7tvFDmRDtbaA7yD9rQ66Deor7izCJGDj8auWnhkKw/84b/5uWqqe2Is1IyqnrTU5wcrJXhwZBAIDaAti0sqVH57veJwk5AFRbZP6U6X8sn+AvY5xgp/i8HdTx1VFC5ekW5jn/BqOBnN+HwHD5EfM=', 'smithi087.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBBTcZju7nXW6kP1AOdUkhnSc9lqjBY4+lA70AbJvVQldB2S3HLwBdcibDZc6sVdIEiNpvMehyRlbh0NGoIdwaKkL/peCQMFz0C16TJL4tkiGsmpyrAgxTUxuJIbRdPTEnHVUt2hPPOiHB9KIAOBFGm02PcvNFdmpbfSE7tPq8EF3wFhStHL+AULdQBUM5shVCU2IU1DdqbJ1U3+mP/oUkISexe2R34UiAvb/aiKik/6GgD26lL4lak/2zgePRGcLYnBIQIAFO9XQ2KEqzAdOFDFhxob9FygzvWTCB3x0oET7Ab47sm4kzyNsQDEQJifpYylC9rHXuPEOntyS56KczfWvXzM94dWVHYTRrTT/auwIzuk9cdLlCbWqntVW6upa57Tw5uOXxGgp4bQ+g8vVidDwyBagbPWh2Rq4qqpOotM3BIkuIfuZnlfDelnJ8OJoXKytETZZcvxausAC9hdQ3eBQNnJ+bGjRlNBJzqe1ftROaD8mamoBcR9pN4aq3OnU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2'}}, {'parallel': ['upgrade-task']}, {'rgw': {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'b6f3efab84b70e18e86ec271a07564aeb4ed3bac', 'timestamp': '2021-07-26_15:05:01', 'tube': 'smithi', 'upgrade-task': [{'install.upgrade': {'c2.client.0': None, 'c2.client.1': None, 'c2.mgr.x': None, 'c2.mon.a': None, 'c2.osd.0': None, 'c2.osd.1': None, 'c2.osd.2': None}}], 'user': 'sage', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.30581'} 2021-07-26T15:45:38.611 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-07-26T15:45:38.614 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/c1.data 2021-07-26T15:45:38.621 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:45:38.663 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:45:38.681 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:38.682 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/scratch_devs of=/dev/stdout 2021-07-26T15:45:38.689 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-07-26T15:45:38.689 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-07-26T15:45:38.696 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-07-26T15:45:38.697 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:45:38.697 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 345 Links: 1 2021-07-26T15:45:38.697 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:45:38.697 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2021-07-26 15:42:49.464006572 +0000 2021-07-26T15:45:38.698 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2021-07-26 15:42:49.288006566 +0000 2021-07-26T15:45:38.698 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2021-07-26 15:42:49.288006566 +0000 2021-07-26T15:45:38.698 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2021-07-26T15:45:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2021-07-26T15:45:38.707 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2021-07-26T15:45:38.708 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000394054 s, 1.3 MB/s 2021-07-26T15:45:38.712 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-07-26T15:45:38.765 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-07-26T15:45:38.765 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:45:38.765 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 352 Links: 1 2021-07-26T15:45:38.765 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:45:38.766 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2021-07-26 15:42:49.848006584 +0000 2021-07-26T15:45:38.766 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2021-07-26 15:42:49.688006579 +0000 2021-07-26T15:45:38.766 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2021-07-26 15:42:49.688006579 +0000 2021-07-26T15:45:38.766 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2021-07-26T15:45:38.775 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2021-07-26T15:45:38.776 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2021-07-26T15:45:38.776 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000369217 s, 1.4 MB/s 2021-07-26T15:45:38.780 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-07-26T15:45:38.788 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-07-26T15:45:38.788 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:45:38.788 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 358 Links: 1 2021-07-26T15:45:38.788 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:45:38.789 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2021-07-26 15:42:50.264006598 +0000 2021-07-26T15:45:38.789 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2021-07-26 15:42:50.096006592 +0000 2021-07-26T15:45:38.789 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2021-07-26 15:42:50.096006592 +0000 2021-07-26T15:45:38.789 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2021-07-26T15:45:38.794 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2021-07-26T15:45:38.795 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2021-07-26T15:45:38.795 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000392367 s, 1.3 MB/s 2021-07-26T15:45:38.799 DEBUG:teuthology.orchestra.run.smithi067:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-07-26T15:45:38.806 INFO:teuthology.orchestra.run.smithi067.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-07-26T15:45:38.806 INFO:teuthology.orchestra.run.smithi067.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:45:38.806 INFO:teuthology.orchestra.run.smithi067.stdout:Device: 6h/6d Inode: 363 Links: 1 2021-07-26T15:45:38.807 INFO:teuthology.orchestra.run.smithi067.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:45:38.807 INFO:teuthology.orchestra.run.smithi067.stdout:Access: 2021-07-26 15:42:50.716006612 +0000 2021-07-26T15:45:38.807 INFO:teuthology.orchestra.run.smithi067.stdout:Modify: 2021-07-26 15:42:50.508006606 +0000 2021-07-26T15:45:38.807 INFO:teuthology.orchestra.run.smithi067.stdout:Change: 2021-07-26 15:42:50.508006606 +0000 2021-07-26T15:45:38.807 INFO:teuthology.orchestra.run.smithi067.stdout: Birth: - 2021-07-26T15:45:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records in 2021-07-26T15:45:38.816 INFO:teuthology.orchestra.run.smithi067.stderr:1+0 records out 2021-07-26T15:45:38.817 INFO:teuthology.orchestra.run.smithi067.stderr:512 bytes copied, 0.000373552 s, 1.4 MB/s 2021-07-26T15:45:38.821 INFO:tasks.ceph:osd dev map: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:45:38.822 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:45:38.822 INFO:tasks.ceph:Generating config... 2021-07-26T15:45:38.823 INFO:tasks.ceph:[client] debug rgw = 20 2021-07-26T15:45:38.824 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-07-26T15:45:38.824 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2021-07-26T15:45:38.824 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:45:38.825 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-07-26T15:45:38.825 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-07-26T15:45:38.825 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-07-26T15:45:38.826 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-07-26T15:45:38.826 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-07-26T15:45:38.827 INFO:tasks.ceph:[client] setgroup = ceph 2021-07-26T15:45:38.827 INFO:tasks.ceph:[client] setuser = ceph 2021-07-26T15:45:38.827 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-07-26T15:45:38.828 INFO:tasks.ceph:[mgr] debug ms = 1 2021-07-26T15:45:38.828 INFO:tasks.ceph:[mon] debug mon = 20 2021-07-26T15:45:38.828 INFO:tasks.ceph:[mon] debug ms = 1 2021-07-26T15:45:38.829 INFO:tasks.ceph:[mon] debug paxos = 20 2021-07-26T15:45:38.829 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:45:38.829 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:45:38.829 INFO:tasks.ceph:[osd] debug ms = 1 2021-07-26T15:45:38.830 INFO:tasks.ceph:[osd] debug osd = 20 2021-07-26T15:45:38.830 INFO:tasks.ceph:Setting up c1.mon.a... 2021-07-26T15:45:38.831 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c1.keyring 2021-07-26T15:45:38.872 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/c1.keyring 2021-07-26T15:45:38.876 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c1.keyring 2021-07-26T15:45:38.952 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-07-26T15:45:38.963 DEBUG:tasks.ceph:Ceph mon addresses: [('c1.mon.a', '172.21.15.67')] 2021-07-26T15:45:38.963 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.67'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2021-07-26T15:45:38.965 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:38.965 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:45:38.970 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.67 --print /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:45:39.046 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:45:39.047 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:45:39.048 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:45:39.048 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: generated fsid 9835dab8-7238-49ef-a4d6-28066214571f 2021-07-26T15:45:39.048 INFO:teuthology.orchestra.run.smithi067.stdout:epoch 0 2021-07-26T15:45:39.049 INFO:teuthology.orchestra.run.smithi067.stdout:fsid 9835dab8-7238-49ef-a4d6-28066214571f 2021-07-26T15:45:39.049 INFO:teuthology.orchestra.run.smithi067.stdout:last_changed 2021-07-26T15:45:39.044310+0000 2021-07-26T15:45:39.049 INFO:teuthology.orchestra.run.smithi067.stdout:created 2021-07-26T15:45:39.044310+0000 2021-07-26T15:45:39.049 INFO:teuthology.orchestra.run.smithi067.stdout:min_mon_release 0 (unknown) 2021-07-26T15:45:39.050 INFO:teuthology.orchestra.run.smithi067.stdout:0: [v2:172.21.15.67:3300/0,v1:172.21.15.67:6789/0] mon.a 2021-07-26T15:45:39.050 INFO:teuthology.orchestra.run.smithi067.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c1.monmap (1 monitors) 2021-07-26T15:45:39.051 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:45:39.062 INFO:tasks.ceph:Writing /etc/ceph/c1.conf for FSID 9835dab8-7238-49ef-a4d6-28066214571f... 2021-07-26T15:45:39.065 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-07-26T15:45:39.071 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c1.conf && sudo chmod 0644 /etc/ceph/c1.conf > /dev/null 2021-07-26T15:45:39.104 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2021-07-26T15:45:39.105 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2021-07-26T15:45:39.105 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:45:39.105 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2021-07-26T15:45:39.105 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.106 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2021-07-26T15:45:39.108 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.109 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2021-07-26T15:45:39.109 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.109 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2021-07-26T15:45:39.110 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2021-07-26T15:45:39.110 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.111 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2021-07-26T15:45:39.111 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2021-07-26T15:45:39.112 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.112 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:45:39.112 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2021-07-26T15:45:39.113 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.113 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:45:39.114 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:45:39.115 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.115 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2021-07-26T15:45:39.116 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.117 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2021-07-26T15:45:39.117 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2021-07-26T15:45:39.117 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:45:39.117 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:45:39.118 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2021-07-26T15:45:39.118 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:45:39.118 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2021-07-26T15:45:39.118 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:45:39.119 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:45:39.119 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2021-07-26T15:45:39.119 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.119 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:45:39.120 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.120 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2021-07-26T15:45:39.120 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.120 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2021-07-26T15:45:39.121 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.121 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2021-07-26T15:45:39.121 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2021-07-26T15:45:39.121 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2021-07-26T15:45:39.122 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = 172.21.15.67 2021-07-26T15:45:39.123 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = 9835dab8-7238-49ef-a4d6-28066214571f 2021-07-26T15:45:39.123 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.123 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2021-07-26T15:45:39.123 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2021-07-26T15:45:39.124 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.124 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2021-07-26T15:45:39.124 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2021-07-26T15:45:39.124 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.124 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2021-07-26T15:45:39.126 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2021-07-26T15:45:39.126 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.126 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2021-07-26T15:45:39.127 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2021-07-26T15:45:39.127 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2021-07-26T15:45:39.127 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.127 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2021-07-26T15:45:39.128 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2021-07-26T15:45:39.128 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.128 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:45:39.128 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.128 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2021-07-26T15:45:39.129 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.129 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2021-07-26T15:45:39.129 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.129 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:45:39.130 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2021-07-26T15:45:39.130 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.130 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2021-07-26T15:45:39.130 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2021-07-26T15:45:39.131 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2021-07-26T15:45:39.131 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2021-07-26T15:45:39.131 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.131 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2021-07-26T15:45:39.132 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2021-07-26T15:45:39.132 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2021-07-26T15:45:39.132 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2021-07-26T15:45:39.132 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2021-07-26T15:45:39.132 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:45:39.133 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:45:39.133 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2021-07-26T15:45:39.133 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.133 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2021-07-26T15:45:39.134 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2021-07-26T15:45:39.134 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2021-07-26T15:45:39.134 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2021-07-26T15:45:39.134 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2021-07-26T15:45:39.135 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2021-07-26T15:45:39.135 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2021-07-26T15:45:39.135 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:45:39.135 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2021-07-26T15:45:39.136 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2021-07-26T15:45:39.136 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:45:39.136 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.136 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:45:39.137 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:45:39.137 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:45:39.137 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.137 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:45:39.138 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:45:39.138 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:45:39.138 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:39.139 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2021-07-26T15:45:39.139 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2021-07-26T15:45:39.139 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2021-07-26T15:45:39.139 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2021-07-26T15:45:39.140 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:45:39.140 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:45:39.140 INFO:teuthology.orchestra.run.smithi067.stdout: debug rgw = 20 2021-07-26T15:45:39.140 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt require ssl = False 2021-07-26T15:45:39.140 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:45:39.141 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:45:39.141 INFO:teuthology.orchestra.run.smithi067.stdout: rgw curl low speed time = 300 2021-07-26T15:45:39.141 INFO:teuthology.orchestra.run.smithi067.stdout: rgw data log num shards = 4 2021-07-26T15:45:39.141 INFO:teuthology.orchestra.run.smithi067.stdout: rgw md log max shards = 4 2021-07-26T15:45:39.142 INFO:teuthology.orchestra.run.smithi067.stdout: rgw sync log trim interval = 0 2021-07-26T15:45:39.142 INFO:teuthology.orchestra.run.smithi067.stdout: rgw sync obj etag verify = True 2021-07-26T15:45:39.142 INFO:teuthology.orchestra.run.smithi067.stdout: setgroup = ceph 2021-07-26T15:45:39.142 INFO:teuthology.orchestra.run.smithi067.stdout: setuser = ceph 2021-07-26T15:45:39.143 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2021-07-26T15:45:39.145 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2021-07-26T15:45:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2021-07-26T15:45:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:45:39.145 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2021-07-26T15:45:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2021-07-26T15:45:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.146 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2021-07-26T15:45:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2021-07-26T15:45:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2021-07-26T15:45:39.147 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2021-07-26T15:45:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2021-07-26T15:45:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.148 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:45:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2021-07-26T15:45:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:45:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:45:39.149 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2021-07-26T15:45:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2021-07-26T15:45:39.150 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2021-07-26T15:45:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:45:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:45:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2021-07-26T15:45:39.151 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:45:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2021-07-26T15:45:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:45:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:45:39.152 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2021-07-26T15:45:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:45:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2021-07-26T15:45:39.153 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2021-07-26T15:45:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2021-07-26T15:45:39.154 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2021-07-26T15:45:39.155 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2021-07-26T15:45:39.155 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = 172.21.15.67 2021-07-26T15:45:39.155 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 9835dab8-7238-49ef-a4d6-28066214571f 2021-07-26T15:45:39.155 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.156 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2021-07-26T15:45:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2021-07-26T15:45:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2021-07-26T15:45:39.156 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2021-07-26T15:45:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2021-07-26T15:45:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2021-07-26T15:45:39.157 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2021-07-26T15:45:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2021-07-26T15:45:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2021-07-26T15:45:39.158 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2021-07-26T15:45:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2021-07-26T15:45:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.159 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:45:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2021-07-26T15:45:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.160 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2021-07-26T15:45:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:45:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2021-07-26T15:45:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.161 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2021-07-26T15:45:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2021-07-26T15:45:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-07-26T15:45:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2021-07-26T15:45:39.162 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.163 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2021-07-26T15:45:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-07-26T15:45:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2021-07-26T15:45:39.163 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2021-07-26T15:45:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2021-07-26T15:45:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:45:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:45:39.164 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2021-07-26T15:45:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.165 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2021-07-26T15:45:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-07-26T15:45:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2021-07-26T15:45:39.165 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2021-07-26T15:45:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2021-07-26T15:45:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2021-07-26T15:45:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2021-07-26T15:45:39.166 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:45:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2021-07-26T15:45:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2021-07-26T15:45:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:45:39.167 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:45:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:45:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:45:39.168 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:45:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:45:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:45:39.169 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:45:39.169 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2021-07-26T15:45:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2021-07-26T15:45:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2021-07-26T15:45:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2021-07-26T15:45:39.170 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:45:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:45:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: debug rgw = 20 2021-07-26T15:45:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: rgw crypt require ssl = False 2021-07-26T15:45:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:45:39.171 INFO:teuthology.orchestra.run.smithi087.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:45:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: rgw curl low speed time = 300 2021-07-26T15:45:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: rgw data log num shards = 4 2021-07-26T15:45:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: rgw md log max shards = 4 2021-07-26T15:45:39.172 INFO:teuthology.orchestra.run.smithi087.stdout: rgw sync log trim interval = 0 2021-07-26T15:45:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: rgw sync obj etag verify = True 2021-07-26T15:45:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: setgroup = ceph 2021-07-26T15:45:39.173 INFO:teuthology.orchestra.run.smithi087.stdout: setuser = ceph 2021-07-26T15:45:39.173 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2021-07-26T15:45:39.174 INFO:tasks.ceph:Creating admin key on c1.mon.a... 2021-07-26T15:45:39.174 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c1.keyring 2021-07-26T15:45:39.231 INFO:tasks.ceph:Copying monmap to all nodes... 2021-07-26T15:45:39.232 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:39.232 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/c1.keyring of=/dev/stdout 2021-07-26T15:45:39.240 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:39.240 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/home/ubuntu/cephtest/c1.monmap of=/dev/stdout 2021-07-26T15:45:39.247 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2021-07-26T15:45:39.247 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:39.248 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/c1.keyring 2021-07-26T15:45:39.248 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-07-26T15:45:39.328 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:39.330 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-07-26T15:45:39.422 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2021-07-26T15:45:39.426 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:45:39.428 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/c1.keyring 2021-07-26T15:45:39.429 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/c1.keyring 2021-07-26T15:45:39.524 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:45:39.525 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/c1.monmap 2021-07-26T15:45:39.596 INFO:tasks.ceph:Setting up mon nodes... 2021-07-26T15:45:39.597 INFO:tasks.ceph:Setting up mgr nodes... 2021-07-26T15:45:39.597 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mgr/c1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c1-x/keyring 2021-07-26T15:45:39.654 INFO:teuthology.orchestra.run.smithi067.stdout:creating /var/lib/ceph/mgr/c1-x/keyring 2021-07-26T15:45:39.657 INFO:tasks.ceph:Setting up mds nodes... 2021-07-26T15:45:39.658 INFO:tasks.ceph_client:Setting up client nodes... 2021-07-26T15:45:39.659 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c1.client.0.keyring && sudo chmod 0644 /etc/ceph/c1.client.0.keyring 2021-07-26T15:45:39.749 INFO:teuthology.orchestra.run.smithi067.stdout:creating /etc/ceph/c1.client.0.keyring 2021-07-26T15:45:39.759 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-07-26T15:45:39.760 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:45:39.760 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/c1-0 2021-07-26T15:45:39.824 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:45:39.825 INFO:tasks.ceph:role: c1.osd.0 2021-07-26T15:45:39.825 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com 2021-07-26T15:45:39.825 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-07-26T15:45:40.405 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:45:40.405 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:45:40.406 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:45:40.407 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 2021-07-26T15:45:40.407 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:45:40.408 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:45:40.408 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:45:40.409 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:45:40.410 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:45:40.410 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:45:40.412 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2021-07-26T15:45:40.413 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c1-0 2021-07-26T15:45:40.491 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-0 2021-07-26T15:45:40.504 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:45:40.505 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:45:40.505 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/c1-1 2021-07-26T15:45:40.520 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:45:40.521 INFO:tasks.ceph:role: c1.osd.1 2021-07-26T15:45:40.521 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com 2021-07-26T15:45:40.522 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-07-26T15:45:41.048 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:45:41.048 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:45:41.048 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:45:41.049 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 2021-07-26T15:45:41.049 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:45:41.049 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:45:41.049 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:45:41.050 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:45:41.050 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:45:41.050 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:45:41.051 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2021-07-26T15:45:41.052 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c1-1 2021-07-26T15:45:41.096 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-1 2021-07-26T15:45:41.106 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:45:41.107 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:45:41.107 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/osd/c1-2 2021-07-26T15:45:41.118 INFO:tasks.ceph:roles_to_devs: {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:45:41.118 INFO:tasks.ceph:role: c1.osd.2 2021-07-26T15:45:41.119 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com 2021-07-26T15:45:41.119 DEBUG:teuthology.orchestra.run.smithi067:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-07-26T15:45:41.585 INFO:teuthology.orchestra.run.smithi067.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:45:41.585 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:45:41.585 INFO:teuthology.orchestra.run.smithi067.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:45:41.586 INFO:teuthology.orchestra.run.smithi067.stdout: = reflink=1 2021-07-26T15:45:41.586 INFO:teuthology.orchestra.run.smithi067.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:45:41.586 INFO:teuthology.orchestra.run.smithi067.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:45:41.586 INFO:teuthology.orchestra.run.smithi067.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:45:41.587 INFO:teuthology.orchestra.run.smithi067.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:45:41.587 INFO:teuthology.orchestra.run.smithi067.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:45:41.587 INFO:teuthology.orchestra.run.smithi067.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:45:41.587 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi067.front.sepia.ceph.com -o noatime 2021-07-26T15:45:41.588 DEBUG:teuthology.orchestra.run.smithi067:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c1-2 2021-07-26T15:45:41.637 DEBUG:teuthology.orchestra.run.smithi067:> sudo /sbin/restorecon /var/lib/ceph/osd/c1-2 2021-07-26T15:45:41.694 INFO:teuthology.orchestra.run.smithi067.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:45:41.694 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:45:41.695 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:45:41.754 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:41.752+0000 7f281f235d80 -1 auth: error reading file: /var/lib/ceph/osd/c1-0/keyring: can't open /var/lib/ceph/osd/c1-0/keyring: (2) No such file or directory 2021-07-26T15:45:41.755 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:41.752+0000 7f281f235d80 -1 created new key in keyring /var/lib/ceph/osd/c1-0/keyring 2021-07-26T15:45:41.755 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:41.752+0000 7f281f235d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-07-26T15:45:41.756 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:41.752+0000 7f281f235d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-07-26T15:45:41.756 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:41.752+0000 7f281f235d80 -1 bluestore(/var/lib/ceph/osd/c1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-0/block: (2) No such file or directory 2021-07-26T15:45:41.756 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:41.752+0000 7f281f235d80 -1 bluestore(/var/lib/ceph/osd/c1-0) _read_fsid unparsable uuid 2021-07-26T15:45:41.780 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:41.776+0000 7f281f235d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:45:43.676 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-0 2021-07-26T15:45:43.691 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:45:43.779 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:43.772+0000 7f34af105d80 -1 auth: error reading file: /var/lib/ceph/osd/c1-1/keyring: can't open /var/lib/ceph/osd/c1-1/keyring: (2) No such file or directory 2021-07-26T15:45:43.779 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:43.772+0000 7f34af105d80 -1 created new key in keyring /var/lib/ceph/osd/c1-1/keyring 2021-07-26T15:45:43.780 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:43.772+0000 7f34af105d80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-07-26T15:45:43.780 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:43.772+0000 7f34af105d80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-07-26T15:45:43.780 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:43.772+0000 7f34af105d80 -1 bluestore(/var/lib/ceph/osd/c1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-1/block: (2) No such file or directory 2021-07-26T15:45:43.780 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:43.772+0000 7f34af105d80 -1 bluestore(/var/lib/ceph/osd/c1-1) _read_fsid unparsable uuid 2021-07-26T15:45:43.795 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:43.788+0000 7f34af105d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:45:45.708 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-1 2021-07-26T15:45:45.726 DEBUG:teuthology.orchestra.run.smithi067:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:45:45.766 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:45.760+0000 7f5789b05d80 -1 auth: error reading file: /var/lib/ceph/osd/c1-2/keyring: can't open /var/lib/ceph/osd/c1-2/keyring: (2) No such file or directory 2021-07-26T15:45:45.767 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:45.760+0000 7f5789b05d80 -1 created new key in keyring /var/lib/ceph/osd/c1-2/keyring 2021-07-26T15:45:45.767 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:45.760+0000 7f5789b05d80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-07-26T15:45:45.767 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:45.760+0000 7f5789b05d80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-07-26T15:45:45.767 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:45.760+0000 7f5789b05d80 -1 bluestore(/var/lib/ceph/osd/c1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c1-2/block: (2) No such file or directory 2021-07-26T15:45:45.768 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:45.760+0000 7f5789b05d80 -1 bluestore(/var/lib/ceph/osd/c1-2) _read_fsid unparsable uuid 2021-07-26T15:45:45.788 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:45:45.780+0000 7f5789b05d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:45:47.672 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c1-2 2021-07-26T15:45:47.729 INFO:tasks.ceph:Reading keys from all nodes... 2021-07-26T15:45:47.730 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:47.730 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/mgr/c1-x/keyring of=/dev/stdout 2021-07-26T15:45:47.741 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:47.741 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/c1-0/keyring of=/dev/stdout 2021-07-26T15:45:47.797 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:47.798 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/c1-1/keyring of=/dev/stdout 2021-07-26T15:45:47.809 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:47.810 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/c1-2/keyring of=/dev/stdout 2021-07-26T15:45:47.874 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:47.875 DEBUG:teuthology.orchestra.run.smithi067:> dd if=/etc/ceph/c1.client.0.keyring of=/dev/stdout 2021-07-26T15:45:47.880 INFO:tasks.ceph:Adding keys to all mons... 2021-07-26T15:45:47.880 DEBUG:teuthology.orchestra.run.smithi067:> sudo tee -a /etc/ceph/c1.keyring 2021-07-26T15:45:47.892 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr.x] 2021-07-26T15:45:47.892 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCj2P5gf0LlJhAAm0OlyAAWRY1wd4pH1dkoiQ== 2021-07-26T15:45:47.893 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.0] 2021-07-26T15:45:47.893 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCl2P5glUPgLBAAKHEvc8wUznNZuBC11YXuFA== 2021-07-26T15:45:47.893 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.1] 2021-07-26T15:45:47.893 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCn2P5g/NAoLhAAv8WyENy6sh7AqipkMYHPhw== 2021-07-26T15:45:47.894 INFO:teuthology.orchestra.run.smithi067.stdout:[osd.2] 2021-07-26T15:45:47.894 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCp2P5g+4F9LRAAH7lUZfsJrjbiMPlHAXnt/Q== 2021-07-26T15:45:47.894 INFO:teuthology.orchestra.run.smithi067.stdout:[client.0] 2021-07-26T15:45:47.894 INFO:teuthology.orchestra.run.smithi067.stdout: key = AQCj2P5gPzhSLBAAKrH+B6fwlG1+jws++ztLxw== 2021-07-26T15:45:47.895 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-07-26T15:45:47.981 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:45:48.020 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:45:48.061 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:45:48.143 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-07-26T15:45:48.188 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-07-26T15:45:48.189 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /var/lib/ceph/mon/c1-a 2021-07-26T15:45:48.203 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c1 --mkfs -i a --monmap /home/ubuntu/cephtest/c1.monmap --keyring /etc/ceph/c1.keyring 2021-07-26T15:45:48.311 DEBUG:teuthology.orchestra.run.smithi067:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c1-a 2021-07-26T15:45:48.332 DEBUG:teuthology.orchestra.run.smithi067:> rm -- /home/ubuntu/cephtest/c1.monmap 2021-07-26T15:45:48.380 INFO:tasks.ceph:Starting mon daemons in cluster c1... 2021-07-26T15:45:48.380 INFO:tasks.ceph.c1.mon.a:Restarting daemon 2021-07-26T15:45:48.381 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c1 -i a 2021-07-26T15:45:48.384 INFO:tasks.ceph.c1.mon.a:Started 2021-07-26T15:45:48.384 INFO:tasks.ceph:Starting mgr daemons in cluster c1... 2021-07-26T15:45:48.385 INFO:tasks.ceph.c1.mgr.x:Restarting daemon 2021-07-26T15:45:48.385 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c1 -i x 2021-07-26T15:45:48.387 INFO:tasks.ceph.c1.mgr.x:Started 2021-07-26T15:45:48.388 INFO:tasks.ceph:Setting crush tunables to default 2021-07-26T15:45:48.389 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster c1 osd crush tunables default 2021-07-26T15:45:48.627 INFO:teuthology.orchestra.run.smithi067.stderr:adjusted tunables profile to default 2021-07-26T15:45:48.640 INFO:tasks.ceph:Starting osd daemons in cluster c1... 2021-07-26T15:45:48.641 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:48.641 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/c1-0/fsid of=/dev/stdout 2021-07-26T15:45:48.656 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:48.657 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/c1-1/fsid of=/dev/stdout 2021-07-26T15:45:48.667 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:45:48.668 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd if=/var/lib/ceph/osd/c1-2/fsid of=/dev/stdout 2021-07-26T15:45:48.728 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster c1 osd new 4922c861-c7cd-4867-9e1e-63b029977efd 0 2021-07-26T15:45:48.910 INFO:teuthology.orchestra.run.smithi067.stdout:0 2021-07-26T15:45:48.922 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster c1 osd new 8ec86e09-1a9e-460d-93d0-aabce76a20f2 1 2021-07-26T15:45:49.105 INFO:teuthology.orchestra.run.smithi067.stdout:1 2021-07-26T15:45:49.117 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster c1 osd new f528cadd-3051-4dc3-985c-245c368442c7 2 2021-07-26T15:45:49.303 INFO:teuthology.orchestra.run.smithi067.stdout:2 2021-07-26T15:45:49.320 INFO:tasks.ceph.c1.osd.0:Restarting daemon 2021-07-26T15:45:49.321 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 0 2021-07-26T15:45:49.324 INFO:tasks.ceph.c1.osd.0:Started 2021-07-26T15:45:49.324 INFO:tasks.ceph.c1.osd.1:Restarting daemon 2021-07-26T15:45:49.325 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 1 2021-07-26T15:45:49.328 INFO:tasks.ceph.c1.osd.1:Started 2021-07-26T15:45:49.328 INFO:tasks.ceph.c1.osd.2:Restarting daemon 2021-07-26T15:45:49.329 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c1 -i 2 2021-07-26T15:45:49.331 INFO:tasks.ceph.c1.osd.2:Started 2021-07-26T15:45:49.331 INFO:tasks.ceph:Waiting for OSDs to come up 2021-07-26T15:45:49.634 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-07-26T15:45:49.716 INFO:tasks.ceph.c1.osd.1.smithi067.stderr:2021-07-26T15:45:49.712+0000 7f7b2d15ad80 -1 Falling back to public interface 2021-07-26T15:45:49.795 INFO:teuthology.misc.health.smithi067.stdout: 2021-07-26T15:45:49.796 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":5,"fsid":"9835dab8-7238-49ef-a4d6-28066214571f","created":"2021-07-26T15:45:48.512094+0000","modified":"2021-07-26T15:45:49.299553+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"4922c861-c7cd-4867-9e1e-63b029977efd","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8ec86e09-1a9e-460d-93d0-aabce76a20f2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f528cadd-3051-4dc3-985c-245c368442c7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:45:49.810 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-07-26T15:45:49.931 INFO:tasks.ceph.c1.osd.0.smithi067.stderr:2021-07-26T15:45:49.928+0000 7efdf605fd80 -1 Falling back to public interface 2021-07-26T15:45:49.952 INFO:tasks.ceph.c1.osd.2.smithi067.stderr:2021-07-26T15:45:49.948+0000 7fe2b80bfd80 -1 Falling back to public interface 2021-07-26T15:45:50.091 INFO:tasks.ceph.c1.osd.1.smithi067.stderr:2021-07-26T15:45:50.088+0000 7f7b2d15ad80 -1 osd.1 0 log_to_monitors {default=true} 2021-07-26T15:45:50.583 INFO:tasks.ceph.c1.osd.0.smithi067.stderr:2021-07-26T15:45:50.576+0000 7efdf605fd80 -1 osd.0 0 log_to_monitors {default=true} 2021-07-26T15:45:50.592 INFO:tasks.ceph.c1.osd.2.smithi067.stderr:2021-07-26T15:45:50.588+0000 7fe2b80bfd80 -1 osd.2 0 log_to_monitors {default=true} 2021-07-26T15:45:51.554 INFO:tasks.ceph.c1.osd.1.smithi067.stderr:2021-07-26T15:45:51.552+0000 7f7b1f214700 -1 osd.1 0 waiting for initial osdmap 2021-07-26T15:45:52.554 INFO:tasks.ceph.c1.osd.2.smithi067.stderr:2021-07-26T15:45:52.552+0000 7fe2aa179700 -1 osd.2 0 waiting for initial osdmap 2021-07-26T15:45:52.555 INFO:tasks.ceph.c1.osd.0.smithi067.stderr:2021-07-26T15:45:52.552+0000 7efde8119700 -1 osd.0 0 waiting for initial osdmap 2021-07-26T15:45:56.114 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c1 osd dump --format=json 2021-07-26T15:45:56.357 INFO:teuthology.misc.health.smithi067.stdout: 2021-07-26T15:45:56.357 INFO:teuthology.misc.health.smithi067.stdout:{"epoch":11,"fsid":"9835dab8-7238-49ef-a4d6-28066214571f","created":"2021-07-26T15:45:48.512094+0000","modified":"2021-07-26T15:45:55.564476+0000","last_up_change":"2021-07-26T15:45:53.553157+0000","last_in_change":"2021-07-26T15:45:53.553157+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:45:51.420653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"4922c861-c7cd-4867-9e1e-63b029977efd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":14267},{"type":"v1","addr":"172.21.15.67:6809","nonce":14267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":14267},{"type":"v1","addr":"172.21.15.67:6811","nonce":14267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":14267},{"type":"v1","addr":"172.21.15.67:6815","nonce":14267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":14267},{"type":"v1","addr":"172.21.15.67:6813","nonce":14267}]},"public_addr":"172.21.15.67:6809/14267","cluster_addr":"172.21.15.67:6811/14267","heartbeat_back_addr":"172.21.15.67:6815/14267","heartbeat_front_addr":"172.21.15.67:6813/14267","state":["exists","up"]},{"osd":1,"uuid":"8ec86e09-1a9e-460d-93d0-aabce76a20f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":14268},{"type":"v1","addr":"172.21.15.67:6801","nonce":14268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":14268},{"type":"v1","addr":"172.21.15.67:6803","nonce":14268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":14268},{"type":"v1","addr":"172.21.15.67:6807","nonce":14268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":14268},{"type":"v1","addr":"172.21.15.67:6805","nonce":14268}]},"public_addr":"172.21.15.67:6801/14268","cluster_addr":"172.21.15.67:6803/14268","heartbeat_back_addr":"172.21.15.67:6807/14268","heartbeat_front_addr":"172.21.15.67:6805/14268","state":["exists","up"]},{"osd":2,"uuid":"f528cadd-3051-4dc3-985c-245c368442c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":14269},{"type":"v1","addr":"172.21.15.67:6817","nonce":14269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":14269},{"type":"v1","addr":"172.21.15.67:6819","nonce":14269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":14269},{"type":"v1","addr":"172.21.15.67:6823","nonce":14269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":14269},{"type":"v1","addr":"172.21.15.67:6821","nonce":14269}]},"public_addr":"172.21.15.67:6817/14269","cluster_addr":"172.21.15.67:6819/14269","heartbeat_back_addr":"172.21.15.67:6823/14269","heartbeat_front_addr":"172.21.15.67:6821/14269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.542235+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.048511+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.614740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:45:56.368 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-07-26T15:45:56.368 INFO:tasks.ceph:Creating RBD pool 2021-07-26T15:45:56.369 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster c1 osd pool create rbd 8 2021-07-26T15:45:57.591 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'rbd' created 2021-07-26T15:45:57.603 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph --cluster c1 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-07-26T15:45:58.595 INFO:teuthology.orchestra.run.smithi067.stderr:enabled application 'rbd' on pool 'rbd' 2021-07-26T15:45:58.607 INFO:tasks.ceph:Starting mds daemons in cluster c1... 2021-07-26T15:45:58.608 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-07-26T15:45:58.609 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-07-26T15:45:58.855 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:58.855 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":13,"fsid":"9835dab8-7238-49ef-a4d6-28066214571f","created":"2021-07-26T15:45:48.512094+0000","modified":"2021-07-26T15:45:58.578490+0000","last_up_change":"2021-07-26T15:45:53.553157+0000","last_in_change":"2021-07-26T15:45:53.553157+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:45:51.420653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:45:56.666285+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4922c861-c7cd-4867-9e1e-63b029977efd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":14267},{"type":"v1","addr":"172.21.15.67:6809","nonce":14267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":14267},{"type":"v1","addr":"172.21.15.67:6811","nonce":14267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":14267},{"type":"v1","addr":"172.21.15.67:6815","nonce":14267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":14267},{"type":"v1","addr":"172.21.15.67:6813","nonce":14267}]},"public_addr":"172.21.15.67:6809/14267","cluster_addr":"172.21.15.67:6811/14267","heartbeat_back_addr":"172.21.15.67:6815/14267","heartbeat_front_addr":"172.21.15.67:6813/14267","state":["exists","up"]},{"osd":1,"uuid":"8ec86e09-1a9e-460d-93d0-aabce76a20f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":14268},{"type":"v1","addr":"172.21.15.67:6801","nonce":14268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":14268},{"type":"v1","addr":"172.21.15.67:6803","nonce":14268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":14268},{"type":"v1","addr":"172.21.15.67:6807","nonce":14268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":14268},{"type":"v1","addr":"172.21.15.67:6805","nonce":14268}]},"public_addr":"172.21.15.67:6801/14268","cluster_addr":"172.21.15.67:6803/14268","heartbeat_back_addr":"172.21.15.67:6807/14268","heartbeat_front_addr":"172.21.15.67:6805/14268","state":["exists","up"]},{"osd":2,"uuid":"f528cadd-3051-4dc3-985c-245c368442c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":14269},{"type":"v1","addr":"172.21.15.67:6817","nonce":14269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":14269},{"type":"v1","addr":"172.21.15.67:6819","nonce":14269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":14269},{"type":"v1","addr":"172.21.15.67:6823","nonce":14269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":14269},{"type":"v1","addr":"172.21.15.67:6821","nonce":14269}]},"public_addr":"172.21.15.67:6817/14269","cluster_addr":"172.21.15.67:6819/14269","heartbeat_back_addr":"172.21.15.67:6823/14269","heartbeat_front_addr":"172.21.15.67:6821/14269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.542235+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.048511+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.614740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:45:58.866 INFO:tasks.ceph.ceph_manager.c1:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-07-26T15:45:51.420653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-07-26T15:45:56.666285+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-07-26T15:45:58.871 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd pool get device_health_metrics pg_num 2021-07-26T15:45:59.125 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 1 2021-07-26T15:45:59.139 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd pool get rbd pg_num 2021-07-26T15:45:59.380 INFO:teuthology.orchestra.run.smithi067.stdout:pg_num: 8 2021-07-26T15:45:59.393 INFO:tasks.ceph:Waiting until c1 daemons up and pgs clean... 2021-07-26T15:45:59.394 INFO:tasks.ceph.ceph_manager.c1:waiting for mgr available 2021-07-26T15:45:59.394 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 mgr dump --format=json 2021-07-26T15:45:59.674 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:59.687 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":4,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6824","nonce":14081},{"type":"v1","addr":"172.21.15.67:6825","nonce":14081}]},"active_addr":"172.21.15.67:6825/14081","active_change":"2021-07-26T15:45:51.338383+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":2710221021}]},{"addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":1217983256}]},{"addrvec":[{"type":"v2","addr":"172.21.15.67:0","nonce":2699558304}]}]}} 2021-07-26T15:45:59.691 INFO:tasks.ceph.ceph_manager.c1:mgr available! 2021-07-26T15:45:59.691 INFO:tasks.ceph.ceph_manager.c1:waiting for all up 2021-07-26T15:45:59.692 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-07-26T15:45:59.927 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:45:59.928 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":14,"fsid":"9835dab8-7238-49ef-a4d6-28066214571f","created":"2021-07-26T15:45:48.512094+0000","modified":"2021-07-26T15:45:59.586789+0000","last_up_change":"2021-07-26T15:45:53.553157+0000","last_in_change":"2021-07-26T15:45:53.553157+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:45:51.420653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:45:56.666285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4922c861-c7cd-4867-9e1e-63b029977efd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":14267},{"type":"v1","addr":"172.21.15.67:6809","nonce":14267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":14267},{"type":"v1","addr":"172.21.15.67:6811","nonce":14267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":14267},{"type":"v1","addr":"172.21.15.67:6815","nonce":14267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":14267},{"type":"v1","addr":"172.21.15.67:6813","nonce":14267}]},"public_addr":"172.21.15.67:6809/14267","cluster_addr":"172.21.15.67:6811/14267","heartbeat_back_addr":"172.21.15.67:6815/14267","heartbeat_front_addr":"172.21.15.67:6813/14267","state":["exists","up"]},{"osd":1,"uuid":"8ec86e09-1a9e-460d-93d0-aabce76a20f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":14268},{"type":"v1","addr":"172.21.15.67:6801","nonce":14268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":14268},{"type":"v1","addr":"172.21.15.67:6803","nonce":14268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":14268},{"type":"v1","addr":"172.21.15.67:6807","nonce":14268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":14268},{"type":"v1","addr":"172.21.15.67:6805","nonce":14268}]},"public_addr":"172.21.15.67:6801/14268","cluster_addr":"172.21.15.67:6803/14268","heartbeat_back_addr":"172.21.15.67:6807/14268","heartbeat_front_addr":"172.21.15.67:6805/14268","state":["exists","up"]},{"osd":2,"uuid":"f528cadd-3051-4dc3-985c-245c368442c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":14269},{"type":"v1","addr":"172.21.15.67:6817","nonce":14269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":14269},{"type":"v1","addr":"172.21.15.67:6819","nonce":14269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":14269},{"type":"v1","addr":"172.21.15.67:6823","nonce":14269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":14269},{"type":"v1","addr":"172.21.15.67:6821","nonce":14269}]},"public_addr":"172.21.15.67:6817/14269","cluster_addr":"172.21.15.67:6819/14269","heartbeat_back_addr":"172.21.15.67:6823/14269","heartbeat_front_addr":"172.21.15.67:6821/14269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.542235+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.048511+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.614740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:45:59.941 INFO:tasks.ceph.ceph_manager.c1:all up! 2021-07-26T15:45:59.941 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd dump --format=json 2021-07-26T15:46:00.186 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:00.187 INFO:teuthology.orchestra.run.smithi067.stdout:{"epoch":14,"fsid":"9835dab8-7238-49ef-a4d6-28066214571f","created":"2021-07-26T15:45:48.512094+0000","modified":"2021-07-26T15:45:59.586789+0000","last_up_change":"2021-07-26T15:45:53.553157+0000","last_in_change":"2021-07-26T15:45:53.553157+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:45:51.420653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:45:56.666285+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4922c861-c7cd-4867-9e1e-63b029977efd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6808","nonce":14267},{"type":"v1","addr":"172.21.15.67:6809","nonce":14267}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6810","nonce":14267},{"type":"v1","addr":"172.21.15.67:6811","nonce":14267}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6814","nonce":14267},{"type":"v1","addr":"172.21.15.67:6815","nonce":14267}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6812","nonce":14267},{"type":"v1","addr":"172.21.15.67:6813","nonce":14267}]},"public_addr":"172.21.15.67:6809/14267","cluster_addr":"172.21.15.67:6811/14267","heartbeat_back_addr":"172.21.15.67:6815/14267","heartbeat_front_addr":"172.21.15.67:6813/14267","state":["exists","up"]},{"osd":1,"uuid":"8ec86e09-1a9e-460d-93d0-aabce76a20f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6800","nonce":14268},{"type":"v1","addr":"172.21.15.67:6801","nonce":14268}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6802","nonce":14268},{"type":"v1","addr":"172.21.15.67:6803","nonce":14268}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6806","nonce":14268},{"type":"v1","addr":"172.21.15.67:6807","nonce":14268}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6804","nonce":14268},{"type":"v1","addr":"172.21.15.67:6805","nonce":14268}]},"public_addr":"172.21.15.67:6801/14268","cluster_addr":"172.21.15.67:6803/14268","heartbeat_back_addr":"172.21.15.67:6807/14268","heartbeat_front_addr":"172.21.15.67:6805/14268","state":["exists","up"]},{"osd":2,"uuid":"f528cadd-3051-4dc3-985c-245c368442c7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6816","nonce":14269},{"type":"v1","addr":"172.21.15.67:6817","nonce":14269}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6818","nonce":14269},{"type":"v1","addr":"172.21.15.67:6819","nonce":14269}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6822","nonce":14269},{"type":"v1","addr":"172.21.15.67:6823","nonce":14269}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.67:6820","nonce":14269},{"type":"v1","addr":"172.21.15.67:6821","nonce":14269}]},"public_addr":"172.21.15.67:6817/14269","cluster_addr":"172.21.15.67:6819/14269","heartbeat_back_addr":"172.21.15.67:6823/14269","heartbeat_front_addr":"172.21.15.67:6821/14269","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.542235+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.048511+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:45:51.614740+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:46:00.200 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.0 flush_pg_stats 2021-07-26T15:46:00.345 INFO:teuthology.orchestra.run.smithi067.stdout:38654705669 2021-07-26T15:46:00.346 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.1 flush_pg_stats 2021-07-26T15:46:00.490 INFO:teuthology.orchestra.run.smithi067.stdout:34359738372 2021-07-26T15:46:00.491 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 tell osd.2 flush_pg_stats 2021-07-26T15:46:00.629 INFO:teuthology.orchestra.run.smithi067.stdout:38654705669 2021-07-26T15:46:00.630 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2021-07-26T15:46:00.879 INFO:teuthology.orchestra.run.smithi067.stdout:38654705667 2021-07-26T15:46:00.892 INFO:tasks.ceph.ceph_manager.c1:need seq 38654705669 got 38654705667 for osd.0 2021-07-26T15:46:01.895 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.0 2021-07-26T15:46:02.152 INFO:teuthology.orchestra.run.smithi067.stdout:38654705669 2021-07-26T15:46:02.165 INFO:tasks.ceph.ceph_manager.c1:need seq 38654705669 got 38654705669 for osd.0 2021-07-26T15:46:02.166 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.1 2021-07-26T15:46:02.413 INFO:teuthology.orchestra.run.smithi067.stdout:34359738372 2021-07-26T15:46:02.425 INFO:tasks.ceph.ceph_manager.c1:need seq 34359738372 got 34359738372 for osd.1 2021-07-26T15:46:02.425 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 osd last-stat-seq osd.2 2021-07-26T15:46:02.669 INFO:teuthology.orchestra.run.smithi067.stdout:38654705669 2021-07-26T15:46:02.681 INFO:tasks.ceph.ceph_manager.c1:need seq 38654705669 got 38654705669 for osd.2 2021-07-26T15:46:02.682 INFO:tasks.ceph.ceph_manager.c1:waiting for clean 2021-07-26T15:46:02.683 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2021-07-26T15:46:02.921 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:02.924 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2021-07-26T15:46:02.935 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-07-26T15:46:01.349408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146104,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426696,"statfs":{"total":322122547200,"available":318900936704,"internally_reserved":3221225472,"allocated":360448,"data_stored":102738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.768269"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.596163+0000","last_change":"2021-07-26T15:45:58.594491+0000","last_active":"2021-07-26T15:45:58.596163+0000","last_peered":"2021-07-26T15:45:58.596163+0000","last_clean":"2021-07-26T15:45:58.596163+0000","last_became_active":"2021-07-26T15:45:58.594130+0000","last_became_peered":"2021-07-26T15:45:58.594130+0000","last_unstale":"2021-07-26T15:45:58.596163+0000","last_undegraded":"2021-07-26T15:45:58.596163+0000","last_fullsized":"2021-07-26T15:45:58.596163+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.596963+0000","last_change":"2021-07-26T15:45:58.595841+0000","last_active":"2021-07-26T15:45:58.596963+0000","last_peered":"2021-07-26T15:45:58.596963+0000","last_clean":"2021-07-26T15:45:58.596963+0000","last_became_active":"2021-07-26T15:45:58.593459+0000","last_became_peered":"2021-07-26T15:45:58.593459+0000","last_unstale":"2021-07-26T15:45:58.596963+0000","last_undegraded":"2021-07-26T15:45:58.596963+0000","last_fullsized":"2021-07-26T15:45:58.596963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.595648+0000","last_change":"2021-07-26T15:45:58.593225+0000","last_active":"2021-07-26T15:45:58.595648+0000","last_peered":"2021-07-26T15:45:58.595648+0000","last_clean":"2021-07-26T15:45:58.595648+0000","last_became_active":"2021-07-26T15:45:58.592866+0000","last_became_peered":"2021-07-26T15:45:58.592866+0000","last_unstale":"2021-07-26T15:45:58.595648+0000","last_undegraded":"2021-07-26T15:45:58.595648+0000","last_fullsized":"2021-07-26T15:45:58.595648+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.596170+0000","last_change":"2021-07-26T15:45:58.594576+0000","last_active":"2021-07-26T15:45:58.596170+0000","last_peered":"2021-07-26T15:45:58.596170+0000","last_clean":"2021-07-26T15:45:58.596170+0000","last_became_active":"2021-07-26T15:45:58.594209+0000","last_became_peered":"2021-07-26T15:45:58.594209+0000","last_unstale":"2021-07-26T15:45:58.596170+0000","last_undegraded":"2021-07-26T15:45:58.596170+0000","last_fullsized":"2021-07-26T15:45:58.596170+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.593219+0000","last_change":"2021-07-26T15:45:58.593219+0000","last_active":"2021-07-26T15:45:58.593219+0000","last_peered":"2021-07-26T15:45:58.593219+0000","last_clean":"2021-07-26T15:45:58.593219+0000","last_became_active":"2021-07-26T15:45:58.592627+0000","last_became_peered":"2021-07-26T15:45:58.592627+0000","last_unstale":"2021-07-26T15:45:58.593219+0000","last_undegraded":"2021-07-26T15:45:58.593219+0000","last_fullsized":"2021-07-26T15:45:58.593219+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.596049+0000","last_change":"2021-07-26T15:45:58.595255+0000","last_active":"2021-07-26T15:45:58.596049+0000","last_peered":"2021-07-26T15:45:58.596049+0000","last_clean":"2021-07-26T15:45:58.596049+0000","last_became_active":"2021-07-26T15:45:58.594930+0000","last_became_peered":"2021-07-26T15:45:58.594930+0000","last_unstale":"2021-07-26T15:45:58.596049+0000","last_undegraded":"2021-07-26T15:45:58.596049+0000","last_fullsized":"2021-07-26T15:45:58.596049+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.595873+0000","last_change":"2021-07-26T15:45:58.594637+0000","last_active":"2021-07-26T15:45:58.595873+0000","last_peered":"2021-07-26T15:45:58.595873+0000","last_clean":"2021-07-26T15:45:58.595873+0000","last_became_active":"2021-07-26T15:45:58.594277+0000","last_became_peered":"2021-07-26T15:45:58.594277+0000","last_unstale":"2021-07-26T15:45:58.595873+0000","last_undegraded":"2021-07-26T15:45:58.595873+0000","last_fullsized":"2021-07-26T15:45:58.595873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.596193+0000","last_change":"2021-07-26T15:45:58.593945+0000","last_active":"2021-07-26T15:45:58.596193+0000","last_peered":"2021-07-26T15:45:58.596193+0000","last_clean":"2021-07-26T15:45:58.596193+0000","last_became_active":"2021-07-26T15:45:58.593521+0000","last_became_peered":"2021-07-26T15:45:58.593521+0000","last_unstale":"2021-07-26T15:45:58.596193+0000","last_undegraded":"2021-07-26T15:45:58.596193+0000","last_fullsized":"2021-07-26T15:45:58.596193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.583444+0000","last_change":"2021-07-26T15:45:54.573626+0000","last_active":"2021-07-26T15:45:58.583444+0000","last_peered":"2021-07-26T15:45:58.583444+0000","last_clean":"2021-07-26T15:45:58.583444+0000","last_became_active":"2021-07-26T15:45:54.572180+0000","last_became_peered":"2021-07-26T15:45:54.572180+0000","last_unstale":"2021-07-26T15:45:58.583444+0000","last_undegraded":"2021-07-26T15:45:58.583444+0000","last_fullsized":"2021-07-26T15:45:58.583444+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:51.533807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:51.533807+0000","last_clean_scrub_stamp":"2021-07-26T15:45:51.533807+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":31926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]}]}} 2021-07-26T15:46:02.936 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 pg dump --format=json 2021-07-26T15:46:03.188 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:03.191 INFO:teuthology.orchestra.run.smithi067.stderr:dumped all 2021-07-26T15:46:03.200 INFO:teuthology.orchestra.run.smithi067.stdout:{"pg_ready":true,"pg_map":{"version":15,"stamp":"2021-07-26T15:46:01.349408+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146104,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426696,"statfs":{"total":322122547200,"available":318900936704,"internally_reserved":3221225472,"allocated":360448,"data_stored":102738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.768269"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.596163+0000","last_change":"2021-07-26T15:45:58.594491+0000","last_active":"2021-07-26T15:45:58.596163+0000","last_peered":"2021-07-26T15:45:58.596163+0000","last_clean":"2021-07-26T15:45:58.596163+0000","last_became_active":"2021-07-26T15:45:58.594130+0000","last_became_peered":"2021-07-26T15:45:58.594130+0000","last_unstale":"2021-07-26T15:45:58.596163+0000","last_undegraded":"2021-07-26T15:45:58.596163+0000","last_fullsized":"2021-07-26T15:45:58.596163+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.596963+0000","last_change":"2021-07-26T15:45:58.595841+0000","last_active":"2021-07-26T15:45:58.596963+0000","last_peered":"2021-07-26T15:45:58.596963+0000","last_clean":"2021-07-26T15:45:58.596963+0000","last_became_active":"2021-07-26T15:45:58.593459+0000","last_became_peered":"2021-07-26T15:45:58.593459+0000","last_unstale":"2021-07-26T15:45:58.596963+0000","last_undegraded":"2021-07-26T15:45:58.596963+0000","last_fullsized":"2021-07-26T15:45:58.596963+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.595648+0000","last_change":"2021-07-26T15:45:58.593225+0000","last_active":"2021-07-26T15:45:58.595648+0000","last_peered":"2021-07-26T15:45:58.595648+0000","last_clean":"2021-07-26T15:45:58.595648+0000","last_became_active":"2021-07-26T15:45:58.592866+0000","last_became_peered":"2021-07-26T15:45:58.592866+0000","last_unstale":"2021-07-26T15:45:58.595648+0000","last_undegraded":"2021-07-26T15:45:58.595648+0000","last_fullsized":"2021-07-26T15:45:58.595648+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.596170+0000","last_change":"2021-07-26T15:45:58.594576+0000","last_active":"2021-07-26T15:45:58.596170+0000","last_peered":"2021-07-26T15:45:58.596170+0000","last_clean":"2021-07-26T15:45:58.596170+0000","last_became_active":"2021-07-26T15:45:58.594209+0000","last_became_peered":"2021-07-26T15:45:58.594209+0000","last_unstale":"2021-07-26T15:45:58.596170+0000","last_undegraded":"2021-07-26T15:45:58.596170+0000","last_fullsized":"2021-07-26T15:45:58.596170+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.593219+0000","last_change":"2021-07-26T15:45:58.593219+0000","last_active":"2021-07-26T15:45:58.593219+0000","last_peered":"2021-07-26T15:45:58.593219+0000","last_clean":"2021-07-26T15:45:58.593219+0000","last_became_active":"2021-07-26T15:45:58.592627+0000","last_became_peered":"2021-07-26T15:45:58.592627+0000","last_unstale":"2021-07-26T15:45:58.593219+0000","last_undegraded":"2021-07-26T15:45:58.593219+0000","last_fullsized":"2021-07-26T15:45:58.593219+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.596049+0000","last_change":"2021-07-26T15:45:58.595255+0000","last_active":"2021-07-26T15:45:58.596049+0000","last_peered":"2021-07-26T15:45:58.596049+0000","last_clean":"2021-07-26T15:45:58.596049+0000","last_became_active":"2021-07-26T15:45:58.594930+0000","last_became_peered":"2021-07-26T15:45:58.594930+0000","last_unstale":"2021-07-26T15:45:58.596049+0000","last_undegraded":"2021-07-26T15:45:58.596049+0000","last_fullsized":"2021-07-26T15:45:58.596049+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.595873+0000","last_change":"2021-07-26T15:45:58.594637+0000","last_active":"2021-07-26T15:45:58.595873+0000","last_peered":"2021-07-26T15:45:58.595873+0000","last_clean":"2021-07-26T15:45:58.595873+0000","last_became_active":"2021-07-26T15:45:58.594277+0000","last_became_peered":"2021-07-26T15:45:58.594277+0000","last_unstale":"2021-07-26T15:45:58.595873+0000","last_undegraded":"2021-07-26T15:45:58.595873+0000","last_fullsized":"2021-07-26T15:45:58.595873+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.596193+0000","last_change":"2021-07-26T15:45:58.593945+0000","last_active":"2021-07-26T15:45:58.596193+0000","last_peered":"2021-07-26T15:45:58.596193+0000","last_clean":"2021-07-26T15:45:58.596193+0000","last_became_active":"2021-07-26T15:45:58.593521+0000","last_became_peered":"2021-07-26T15:45:58.593521+0000","last_unstale":"2021-07-26T15:45:58.596193+0000","last_undegraded":"2021-07-26T15:45:58.596193+0000","last_fullsized":"2021-07-26T15:45:58.596193+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:57.572622+0000","last_clean_scrub_stamp":"2021-07-26T15:45:57.572622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:45:58.583444+0000","last_change":"2021-07-26T15:45:54.573626+0000","last_active":"2021-07-26T15:45:58.583444+0000","last_peered":"2021-07-26T15:45:58.583444+0000","last_clean":"2021-07-26T15:45:58.583444+0000","last_became_active":"2021-07-26T15:45:54.572180+0000","last_became_peered":"2021-07-26T15:45:54.572180+0000","last_unstale":"2021-07-26T15:45:58.583444+0000","last_undegraded":"2021-07-26T15:45:58.583444+0000","last_fullsized":"2021-07-26T15:45:58.583444+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:45:51.533807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:45:51.533807+0000","last_clean_scrub_stamp":"2021-07-26T15:45:51.533807+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":9,"seq":38654705669,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":31926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.497}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738372,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41899999999999998}]}]}]}} 2021-07-26T15:46:03.204 INFO:tasks.ceph.ceph_manager.c1:clean! 2021-07-26T15:46:03.205 INFO:tasks.ceph:Waiting until ceph cluster c1 is healthy... 2021-07-26T15:46:03.205 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy 2021-07-26T15:46:03.205 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c1 health --format=json 2021-07-26T15:46:03.489 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:03.501 INFO:teuthology.orchestra.run.smithi067.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-07-26T15:46:03.502 INFO:tasks.ceph.ceph_manager.c1:wait_until_healthy done 2021-07-26T15:46:03.502 INFO:teuthology.run_tasks:Running task ceph... 2021-07-26T15:46:03.521 INFO:tasks.ceph:Creating ceph cluster c2... 2021-07-26T15:46:03.522 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'cpu_profile': set(), 'cluster': 'c2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-07-26T15:46:03.522 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi/6293853', 'branch': 'wip-kefu-testing-2021-07-24-1158', 'description': 'upgrade/octopus-x/rgw-multisite/{clusters frontend overrides realm tasks upgrade/secondary}', 'email': None, 'first_in_suite': False, 'job_id': '6293853', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'sage-2021-07-26_15:05:01-upgrade-wip-kefu-testing-2021-07-24-1158-distro-basic-smithi', 'nuke-on-error': True, 'overrides': {'admin_socket': {'branch': 'wip-kefu-testing-2021-07-24-1158'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'rgw': {'compression type': 'random', 'frontend': 'beast'}, 'rgw-multisite': {'realm': {'is default': True, 'name': 'test-realm'}, 'zonegroups': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zonegroup', 'zones': [{'endpoints': ['c1.client.0'], 'is_default': True, 'is_master': True, 'name': 'test-zone1'}, {'endpoints': ['c2.client.0'], 'is_default': True, 'name': 'test-zone2'}, {'endpoints': ['c2.client.1'], 'is_pubsub': True, 'name': 'test-zone3'}]}]}, 'rgw-multisite-tests': {'args': ['tests.py', 'tests_ps.py'], 'branch': 'octopus', 'repo': 'https://github.com/ceph/ceph.git'}, 'workunit': {'branch': 'wip-kefu-testing-2021-07-24-1158', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'}}, 'owner': 'scheduled_sage@teuthology', 'priority': 90, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['c1.mon.a', 'c1.mgr.x', 'c1.osd.0', 'c1.osd.1', 'c1.osd.2', 'c1.client.0'], ['c2.mon.a', 'c2.mgr.x', 'c2.osd.0', 'c2.osd.1', 'c2.osd.2', 'c2.client.0', 'c2.client.1']], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'sleep_before_teardown': 0, 'suite': 'upgrade', 'suite_branch': 'wip-kefu-testing-2021-07-24-1158', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_bccf07c244ef1754a7e8d345570b6a04f2ee5a7e/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'targets': {'smithi067.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDW3/rIpnOb9l3Yyz6bZXXGq1w/Y4PLohUySyGWDeKu1qrSzsuJNZ8lcm4lqk1yZDEaHdhaIf/W2Csod3HvbpL2xt++asgvrveXs8xmPXU30cNzz7Ids1Nus48OLAnW1I4MMS5/SspyIc4brszUtEls3B60X4DhTztrpjPerQU4yguQtWjqngsp5LI69t0CmhMV5zYQCOSExMC3FofevQtEhJQjJ2dPKVOAcKIOLicpaLuBkfIJw1cX5vZaODr7JS3P9jnaIG157WS8uSlRmWB1xD94DCVCsIpekDW/hEbt4M/eGaWyLnb+UfmyJ3/fiW/0Fywg+84sIO46kR54i4AY5UPMRaL989+Cdp0oudvgNeh7tvFDmRDtbaA7yD9rQ66Deor7izCJGDj8auWnhkKw/84b/5uWqqe2Is1IyqnrTU5wcrJXhwZBAIDaAti0sqVH57veJwk5AFRbZP6U6X8sn+AvY5xgp/i8HdTx1VFC5ekW5jn/BqOBnN+HwHD5EfM=', 'smithi087.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBBTcZju7nXW6kP1AOdUkhnSc9lqjBY4+lA70AbJvVQldB2S3HLwBdcibDZc6sVdIEiNpvMehyRlbh0NGoIdwaKkL/peCQMFz0C16TJL4tkiGsmpyrAgxTUxuJIbRdPTEnHVUt2hPPOiHB9KIAOBFGm02PcvNFdmpbfSE7tPq8EF3wFhStHL+AULdQBUM5shVCU2IU1DdqbJ1U3+mP/oUkISexe2R34UiAvb/aiKik/6GgD26lL4lak/2zgePRGcLYnBIQIAFO9XQ2KEqzAdOFDFhxob9FygzvWTCB3x0oET7Ab47sm4kzyNsQDEQJifpYylC9rHXuPEOntyS56KczfWvXzM94dWVHYTRrTT/auwIzuk9cdLlCbWqntVW6upa57Tw5uOXxGgp4bQ+g8vVidDwyBagbPWh2Rq4qqpOotM3BIkuIfuZnlfDelnJ8OJoXKytETZZcvxausAC9hdQ3eBQNnJ+bGjRlNBJzqe1ftROaD8mamoBcR9pN4aq3OnU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'cluster': 'c1', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}}, {'ceph': {'cluster': 'c2', 'conf': {'client': {'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e', 'wait-for-scrub': False}}, {'parallel': ['upgrade-task']}, {'rgw': {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}}}, {'rgw-multisite': None}, {'rgw-multisite-tests': {'config': {'reconfigure_delay': 60}}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'b6f3efab84b70e18e86ec271a07564aeb4ed3bac', 'timestamp': '2021-07-26_15:05:01', 'tube': 'smithi', 'upgrade-task': [{'install.upgrade': {'c2.client.0': None, 'c2.client.1': None, 'c2.mgr.x': None, 'c2.mon.a': None, 'c2.osd.0': None, 'c2.osd.1': None, 'c2.osd.2': None}}], 'user': 'sage', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.30581'} 2021-07-26T15:46:03.523 DEBUG:teuthology.orchestra.run.smithi067:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-07-26T15:46:03.527 DEBUG:teuthology.orchestra.run.smithi087:> install -d -m0755 -- /home/ubuntu/cephtest/c2.data 2021-07-26T15:46:03.536 DEBUG:teuthology.orchestra.run.smithi067:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:46:03.575 DEBUG:teuthology.orchestra.run.smithi087:> sudo install -d -m0777 -- /var/run/ceph 2021-07-26T15:46:03.594 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:03.594 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/scratch_devs of=/dev/stdout 2021-07-26T15:46:03.644 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-07-26T15:46:03.645 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-07-26T15:46:03.652 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-07-26T15:46:03.652 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:46:03.653 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 343 Links: 1 2021-07-26T15:46:03.653 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:46:03.653 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2021-07-26 15:42:47.716000097 +0000 2021-07-26T15:46:03.654 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2021-07-26 15:42:47.568000097 +0000 2021-07-26T15:46:03.654 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2021-07-26 15:42:47.568000097 +0000 2021-07-26T15:46:03.654 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2021-07-26T15:46:03.662 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2021-07-26T15:46:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2021-07-26T15:46:03.663 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000399007 s, 1.3 MB/s 2021-07-26T15:46:03.668 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-07-26T15:46:03.680 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-07-26T15:46:03.680 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:46:03.680 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 353 Links: 1 2021-07-26T15:46:03.681 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:46:03.681 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2021-07-26 15:42:48.120000097 +0000 2021-07-26T15:46:03.681 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2021-07-26 15:42:47.960000097 +0000 2021-07-26T15:46:03.681 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2021-07-26 15:42:47.960000097 +0000 2021-07-26T15:46:03.681 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2021-07-26T15:46:03.683 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2021-07-26T15:46:03.684 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2021-07-26T15:46:03.684 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000372823 s, 1.4 MB/s 2021-07-26T15:46:03.689 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-07-26T15:46:03.739 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-07-26T15:46:03.740 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:46:03.741 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-07-26T15:46:03.741 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:46:03.741 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2021-07-26 15:42:48.512000097 +0000 2021-07-26T15:46:03.742 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2021-07-26 15:42:48.344000097 +0000 2021-07-26T15:46:03.742 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2021-07-26 15:42:48.344000097 +0000 2021-07-26T15:46:03.742 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2021-07-26T15:46:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2021-07-26T15:46:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2021-07-26T15:46:03.750 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.000390103 s, 1.3 MB/s 2021-07-26T15:46:03.755 DEBUG:teuthology.orchestra.run.smithi087:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-07-26T15:46:03.767 INFO:teuthology.orchestra.run.smithi087.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-07-26T15:46:03.768 INFO:teuthology.orchestra.run.smithi087.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-07-26T15:46:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:Device: 6h/6d Inode: 365 Links: 1 2021-07-26T15:46:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-07-26T15:46:03.768 INFO:teuthology.orchestra.run.smithi087.stdout:Access: 2021-07-26 15:42:48.904000097 +0000 2021-07-26T15:46:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:Modify: 2021-07-26 15:42:48.736000097 +0000 2021-07-26T15:46:03.769 INFO:teuthology.orchestra.run.smithi087.stdout:Change: 2021-07-26 15:42:48.736000097 +0000 2021-07-26T15:46:03.769 INFO:teuthology.orchestra.run.smithi087.stdout: Birth: - 2021-07-26T15:46:03.776 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records in 2021-07-26T15:46:03.776 INFO:teuthology.orchestra.run.smithi087.stderr:1+0 records out 2021-07-26T15:46:03.776 INFO:teuthology.orchestra.run.smithi087.stderr:512 bytes copied, 0.00040861 s, 1.3 MB/s 2021-07-26T15:46:03.780 INFO:tasks.ceph:osd dev map: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:46:03.782 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:46:03.782 INFO:tasks.ceph:Generating config... 2021-07-26T15:46:03.785 INFO:tasks.ceph:[client] debug rgw = 20 2021-07-26T15:46:03.785 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2021-07-26T15:46:03.786 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2021-07-26T15:46:03.786 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:46:03.786 INFO:tasks.ceph:[client] rgw curl low speed time = 300 2021-07-26T15:46:03.787 INFO:tasks.ceph:[client] rgw data log num shards = 4 2021-07-26T15:46:03.787 INFO:tasks.ceph:[client] rgw md log max shards = 4 2021-07-26T15:46:03.788 INFO:tasks.ceph:[client] rgw sync log trim interval = 0 2021-07-26T15:46:03.788 INFO:tasks.ceph:[client] rgw sync obj etag verify = True 2021-07-26T15:46:03.788 INFO:tasks.ceph:[client] setgroup = ceph 2021-07-26T15:46:03.789 INFO:tasks.ceph:[client] setuser = ceph 2021-07-26T15:46:03.789 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-07-26T15:46:03.789 INFO:tasks.ceph:[mgr] debug ms = 1 2021-07-26T15:46:03.790 INFO:tasks.ceph:[mon] debug mon = 20 2021-07-26T15:46:03.790 INFO:tasks.ceph:[mon] debug ms = 1 2021-07-26T15:46:03.791 INFO:tasks.ceph:[mon] debug paxos = 20 2021-07-26T15:46:03.791 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:46:03.793 INFO:tasks.ceph:[mon] mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:46:03.793 INFO:tasks.ceph:[osd] debug ms = 1 2021-07-26T15:46:03.794 INFO:tasks.ceph:[osd] debug osd = 20 2021-07-26T15:46:03.794 INFO:tasks.ceph:Setting up c2.mon.a... 2021-07-26T15:46:03.795 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/c2.keyring 2021-07-26T15:46:03.867 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/c2.keyring 2021-07-26T15:46:03.869 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/c2.keyring 2021-07-26T15:46:03.905 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-07-26T15:46:03.921 DEBUG:tasks.ceph:Ceph mon addresses: [('c2.mon.a', '172.21.15.87')] 2021-07-26T15:46:03.923 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.87'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug osd': 20}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': False, 'mon_warn_on_insecure_global_id_reclaim_allowed': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo=', 'rgw curl low speed time': 300, 'rgw data log num shards': 4, 'rgw md log max shards': 4, 'rgw sync log trim interval': 0, 'rgw sync obj etag verify': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2021-07-26T15:46:03.924 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:03.924 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:46:03.973 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.87 --print /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:46:04.003 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:04.004 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:04.005 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: monmap file /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:46:04.005 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: generated fsid 93bd2c70-9cf8-4f29-a5a4-17ad7b52319d 2021-07-26T15:46:04.006 INFO:teuthology.orchestra.run.smithi087.stdout:epoch 0 2021-07-26T15:46:04.006 INFO:teuthology.orchestra.run.smithi087.stdout:fsid 93bd2c70-9cf8-4f29-a5a4-17ad7b52319d 2021-07-26T15:46:04.007 INFO:teuthology.orchestra.run.smithi087.stdout:last_changed 2021-07-26T15:46:04.002601+0000 2021-07-26T15:46:04.007 INFO:teuthology.orchestra.run.smithi087.stdout:created 2021-07-26T15:46:04.002601+0000 2021-07-26T15:46:04.007 INFO:teuthology.orchestra.run.smithi087.stdout:min_mon_release 0 (unknown) 2021-07-26T15:46:04.007 INFO:teuthology.orchestra.run.smithi087.stdout:0: [v2:172.21.15.87:3300/0,v1:172.21.15.87:6789/0] mon.a 2021-07-26T15:46:04.008 INFO:teuthology.orchestra.run.smithi087.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/c2.monmap (1 monitors) 2021-07-26T15:46:04.008 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-07-26T15:46:04.013 INFO:tasks.ceph:Writing /etc/ceph/c2.conf for FSID 93bd2c70-9cf8-4f29-a5a4-17ad7b52319d... 2021-07-26T15:46:04.015 DEBUG:teuthology.orchestra.run.smithi067:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-07-26T15:46:04.018 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/c2.conf && sudo chmod 0644 /etc/ceph/c2.conf > /dev/null 2021-07-26T15:46:04.060 INFO:teuthology.orchestra.run.smithi067.stdout:[global] 2021-07-26T15:46:04.060 INFO:teuthology.orchestra.run.smithi067.stdout: chdir = "" 2021-07-26T15:46:04.061 INFO:teuthology.orchestra.run.smithi067.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:46:04.061 INFO:teuthology.orchestra.run.smithi067.stdout: auth supported = cephx 2021-07-26T15:46:04.062 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.062 INFO:teuthology.orchestra.run.smithi067.stdout: filestore xattr use omap = true 2021-07-26T15:46:04.062 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.063 INFO:teuthology.orchestra.run.smithi067.stdout: mon clock drift allowed = 1.000 2021-07-26T15:46:04.063 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.064 INFO:teuthology.orchestra.run.smithi067.stdout: osd crush chooseleaf type = 0 2021-07-26T15:46:04.064 INFO:teuthology.orchestra.run.smithi067.stdout: auth debug = true 2021-07-26T15:46:04.064 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.065 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on old message = true 2021-07-26T15:46:04.065 INFO:teuthology.orchestra.run.smithi067.stdout: ms die on bug = true 2021-07-26T15:46:04.065 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.066 INFO:teuthology.orchestra.run.smithi067.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:46:04.066 INFO:teuthology.orchestra.run.smithi067.stdout: mon pg warn max object skew = 0 2021-07-26T15:46:04.067 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.067 INFO:teuthology.orchestra.run.smithi067.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:46:04.068 INFO:teuthology.orchestra.run.smithi067.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:46:04.068 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.068 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default size = 2 2021-07-26T15:46:04.069 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.069 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow primary affinity = true 2021-07-26T15:46:04.069 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd allow pg remap = true 2021-07-26T15:46:04.069 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:46:04.070 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:46:04.070 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on no sortbitwise = false 2021-07-26T15:46:04.070 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:46:04.070 INFO:teuthology.orchestra.run.smithi067.stdout: mon warn on too few osds = false 2021-07-26T15:46:04.070 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:46:04.071 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:46:04.071 INFO:teuthology.orchestra.run.smithi067.stdout: mon_allow_pool_size_one = true 2021-07-26T15:46:04.071 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.071 INFO:teuthology.orchestra.run.smithi067.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:46:04.072 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.072 INFO:teuthology.orchestra.run.smithi067.stdout: osd default data pool replay window = 5 2021-07-26T15:46:04.072 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.072 INFO:teuthology.orchestra.run.smithi067.stdout: mon allow pool delete = true 2021-07-26T15:46:04.072 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon cluster log file level = debug 2021-07-26T15:46:04.073 INFO:teuthology.orchestra.run.smithi067.stdout: debug asserts on shutdown = true 2021-07-26T15:46:04.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon health detail to clog = false 2021-07-26T15:46:04.073 INFO:teuthology.orchestra.run.smithi067.stdout: mon host = 172.21.15.87 2021-07-26T15:46:04.074 INFO:teuthology.orchestra.run.smithi067.stdout: fsid = 93bd2c70-9cf8-4f29-a5a4-17ad7b52319d 2021-07-26T15:46:04.074 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.074 INFO:teuthology.orchestra.run.smithi067.stdout:[osd] 2021-07-26T15:46:04.074 INFO:teuthology.orchestra.run.smithi067.stdout: osd journal size = 100 2021-07-26T15:46:04.074 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub load threshold = 5.0 2021-07-26T15:46:04.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd scrub max interval = 600 2021-07-26T15:46:04.075 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.075 INFO:teuthology.orchestra.run.smithi067.stdout: osd recover clone overlap = true 2021-07-26T15:46:04.076 INFO:teuthology.orchestra.run.smithi067.stdout: osd recovery max chunk = 1048576 2021-07-26T15:46:04.076 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.076 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug shutdown = true 2021-07-26T15:46:04.076 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug op order = true 2021-07-26T15:46:04.076 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug verify stray on activate = true 2021-07-26T15:46:04.077 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.077 INFO:teuthology.orchestra.run.smithi067.stdout: osd open classes on start = true 2021-07-26T15:46:04.077 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug pg log writeout = true 2021-07-26T15:46:04.077 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.078 INFO:teuthology.orchestra.run.smithi067.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:46:04.078 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.078 INFO:teuthology.orchestra.run.smithi067.stdout: osd map max advance = 10 2021-07-26T15:46:04.078 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.078 INFO:teuthology.orchestra.run.smithi067.stdout: journal zero on create = true 2021-07-26T15:46:04.079 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.079 INFO:teuthology.orchestra.run.smithi067.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:46:04.079 INFO:teuthology.orchestra.run.smithi067.stdout: filestore apply finisher threads = 3 2021-07-26T15:46:04.079 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.080 INFO:teuthology.orchestra.run.smithi067.stdout: bdev debug aio = true 2021-07-26T15:46:04.080 INFO:teuthology.orchestra.run.smithi067.stdout: osd debug misdirected ops = true 2021-07-26T15:46:04.080 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2021-07-26T15:46:04.080 INFO:teuthology.orchestra.run.smithi067.stdout: debug osd = 20 2021-07-26T15:46:04.080 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.081 INFO:teuthology.orchestra.run.smithi067.stdout:[mgr] 2021-07-26T15:46:04.081 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2021-07-26T15:46:04.081 INFO:teuthology.orchestra.run.smithi067.stdout: debug mgr = 20 2021-07-26T15:46:04.081 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2021-07-26T15:46:04.081 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2021-07-26T15:46:04.082 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:46:04.082 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:46:04.082 INFO:teuthology.orchestra.run.smithi067.stdout: mgr/telemetry/nag = false 2021-07-26T15:46:04.082 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.083 INFO:teuthology.orchestra.run.smithi067.stdout:[mon] 2021-07-26T15:46:04.083 INFO:teuthology.orchestra.run.smithi067.stdout: debug ms = 1 2021-07-26T15:46:04.083 INFO:teuthology.orchestra.run.smithi067.stdout: debug mon = 20 2021-07-26T15:46:04.083 INFO:teuthology.orchestra.run.smithi067.stdout: debug paxos = 20 2021-07-26T15:46:04.083 INFO:teuthology.orchestra.run.smithi067.stdout: debug auth = 20 2021-07-26T15:46:04.084 INFO:teuthology.orchestra.run.smithi067.stdout: mon data avail warn = 5 2021-07-26T15:46:04.084 INFO:teuthology.orchestra.run.smithi067.stdout: mon mgr mkfs grace = 240 2021-07-26T15:46:04.084 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:46:04.084 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd reporter subtree level = osd 2021-07-26T15:46:04.085 INFO:teuthology.orchestra.run.smithi067.stdout: mon osd prime pg temp = true 2021-07-26T15:46:04.085 INFO:teuthology.orchestra.run.smithi067.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:46:04.085 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.085 INFO:teuthology.orchestra.run.smithi067.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:46:04.085 INFO:teuthology.orchestra.run.smithi067.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:46:04.086 INFO:teuthology.orchestra.run.smithi067.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:46:04.086 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.086 INFO:teuthology.orchestra.run.smithi067.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:46:04.086 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:46:04.087 INFO:teuthology.orchestra.run.smithi067.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:46:04.087 INFO:teuthology.orchestra.run.smithi067.stdout: 2021-07-26T15:46:04.087 INFO:teuthology.orchestra.run.smithi067.stdout:[client] 2021-07-26T15:46:04.087 INFO:teuthology.orchestra.run.smithi067.stdout: rgw cache enabled = true 2021-07-26T15:46:04.088 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable ops log = true 2021-07-26T15:46:04.088 INFO:teuthology.orchestra.run.smithi067.stdout: rgw enable usage log = true 2021-07-26T15:46:04.088 INFO:teuthology.orchestra.run.smithi067.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:46:04.088 INFO:teuthology.orchestra.run.smithi067.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:46:04.089 INFO:teuthology.orchestra.run.smithi067.stdout: debug rgw = 20 2021-07-26T15:46:04.089 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt require ssl = False 2021-07-26T15:46:04.089 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:46:04.089 INFO:teuthology.orchestra.run.smithi067.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:46:04.089 INFO:teuthology.orchestra.run.smithi067.stdout: rgw curl low speed time = 300 2021-07-26T15:46:04.090 INFO:teuthology.orchestra.run.smithi067.stdout: rgw data log num shards = 4 2021-07-26T15:46:04.090 INFO:teuthology.orchestra.run.smithi067.stdout: rgw md log max shards = 4 2021-07-26T15:46:04.090 INFO:teuthology.orchestra.run.smithi067.stdout: rgw sync log trim interval = 0 2021-07-26T15:46:04.090 INFO:teuthology.orchestra.run.smithi067.stdout: rgw sync obj etag verify = True 2021-07-26T15:46:04.091 INFO:teuthology.orchestra.run.smithi067.stdout: setgroup = ceph 2021-07-26T15:46:04.091 INFO:teuthology.orchestra.run.smithi067.stdout: setuser = ceph 2021-07-26T15:46:04.091 INFO:teuthology.orchestra.run.smithi067.stdout:[mon.a] 2021-07-26T15:46:04.093 INFO:teuthology.orchestra.run.smithi087.stdout:[global] 2021-07-26T15:46:04.093 INFO:teuthology.orchestra.run.smithi087.stdout: chdir = "" 2021-07-26T15:46:04.093 INFO:teuthology.orchestra.run.smithi087.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-07-26T15:46:04.093 INFO:teuthology.orchestra.run.smithi087.stdout: auth supported = cephx 2021-07-26T15:46:04.094 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.094 INFO:teuthology.orchestra.run.smithi087.stdout: filestore xattr use omap = true 2021-07-26T15:46:04.094 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.094 INFO:teuthology.orchestra.run.smithi087.stdout: mon clock drift allowed = 1.000 2021-07-26T15:46:04.095 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.095 INFO:teuthology.orchestra.run.smithi087.stdout: osd crush chooseleaf type = 0 2021-07-26T15:46:04.095 INFO:teuthology.orchestra.run.smithi087.stdout: auth debug = true 2021-07-26T15:46:04.095 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.095 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on old message = true 2021-07-26T15:46:04.096 INFO:teuthology.orchestra.run.smithi087.stdout: ms die on bug = true 2021-07-26T15:46:04.096 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.096 INFO:teuthology.orchestra.run.smithi087.stdout: mon max pg per osd = 10000 # >= luminous 2021-07-26T15:46:04.096 INFO:teuthology.orchestra.run.smithi087.stdout: mon pg warn max object skew = 0 2021-07-26T15:46:04.097 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.097 INFO:teuthology.orchestra.run.smithi087.stdout: # disable pg_autoscaler by default for new pools 2021-07-26T15:46:04.097 INFO:teuthology.orchestra.run.smithi087.stdout: osd_pool_default_pg_autoscale_mode = off 2021-07-26T15:46:04.097 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.097 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default size = 2 2021-07-26T15:46:04.098 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.098 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow primary affinity = true 2021-07-26T15:46:04.098 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd allow pg remap = true 2021-07-26T15:46:04.098 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on legacy crush tunables = false 2021-07-26T15:46:04.099 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on crush straw calc version zero = false 2021-07-26T15:46:04.099 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on no sortbitwise = false 2021-07-26T15:46:04.099 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on osd down out interval zero = false 2021-07-26T15:46:04.099 INFO:teuthology.orchestra.run.smithi087.stdout: mon warn on too few osds = false 2021-07-26T15:46:04.100 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-07-26T15:46:04.100 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_pool_no_redundancy = false 2021-07-26T15:46:04.100 INFO:teuthology.orchestra.run.smithi087.stdout: mon_allow_pool_size_one = true 2021-07-26T15:46:04.100 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.100 INFO:teuthology.orchestra.run.smithi087.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-07-26T15:46:04.101 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.101 INFO:teuthology.orchestra.run.smithi087.stdout: osd default data pool replay window = 5 2021-07-26T15:46:04.101 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.101 INFO:teuthology.orchestra.run.smithi087.stdout: mon allow pool delete = true 2021-07-26T15:46:04.101 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.102 INFO:teuthology.orchestra.run.smithi087.stdout: mon cluster log file level = debug 2021-07-26T15:46:04.102 INFO:teuthology.orchestra.run.smithi087.stdout: debug asserts on shutdown = true 2021-07-26T15:46:04.102 INFO:teuthology.orchestra.run.smithi087.stdout: mon health detail to clog = false 2021-07-26T15:46:04.102 INFO:teuthology.orchestra.run.smithi087.stdout: mon host = 172.21.15.87 2021-07-26T15:46:04.103 INFO:teuthology.orchestra.run.smithi087.stdout: fsid = 93bd2c70-9cf8-4f29-a5a4-17ad7b52319d 2021-07-26T15:46:04.103 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.103 INFO:teuthology.orchestra.run.smithi087.stdout:[osd] 2021-07-26T15:46:04.103 INFO:teuthology.orchestra.run.smithi087.stdout: osd journal size = 100 2021-07-26T15:46:04.104 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.104 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub load threshold = 5.0 2021-07-26T15:46:04.104 INFO:teuthology.orchestra.run.smithi087.stdout: osd scrub max interval = 600 2021-07-26T15:46:04.104 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.105 INFO:teuthology.orchestra.run.smithi087.stdout: osd recover clone overlap = true 2021-07-26T15:46:04.105 INFO:teuthology.orchestra.run.smithi087.stdout: osd recovery max chunk = 1048576 2021-07-26T15:46:04.105 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.105 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug shutdown = true 2021-07-26T15:46:04.105 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug op order = true 2021-07-26T15:46:04.106 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug verify stray on activate = true 2021-07-26T15:46:04.106 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.106 INFO:teuthology.orchestra.run.smithi087.stdout: osd open classes on start = true 2021-07-26T15:46:04.106 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug pg log writeout = true 2021-07-26T15:46:04.106 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.108 INFO:teuthology.orchestra.run.smithi087.stdout: osd deep scrub update digest min age = 30 2021-07-26T15:46:04.109 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.109 INFO:teuthology.orchestra.run.smithi087.stdout: osd map max advance = 10 2021-07-26T15:46:04.110 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.110 INFO:teuthology.orchestra.run.smithi087.stdout: journal zero on create = true 2021-07-26T15:46:04.111 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.111 INFO:teuthology.orchestra.run.smithi087.stdout: filestore ondisk finisher threads = 3 2021-07-26T15:46:04.112 INFO:teuthology.orchestra.run.smithi087.stdout: filestore apply finisher threads = 3 2021-07-26T15:46:04.115 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.115 INFO:teuthology.orchestra.run.smithi087.stdout: bdev debug aio = true 2021-07-26T15:46:04.115 INFO:teuthology.orchestra.run.smithi087.stdout: osd debug misdirected ops = true 2021-07-26T15:46:04.116 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-07-26T15:46:04.116 INFO:teuthology.orchestra.run.smithi087.stdout: debug osd = 20 2021-07-26T15:46:04.116 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.116 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr] 2021-07-26T15:46:04.117 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-07-26T15:46:04.117 INFO:teuthology.orchestra.run.smithi087.stdout: debug mgr = 20 2021-07-26T15:46:04.117 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2021-07-26T15:46:04.117 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2021-07-26T15:46:04.117 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:46:04.118 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:46:04.118 INFO:teuthology.orchestra.run.smithi087.stdout: mgr/telemetry/nag = false 2021-07-26T15:46:04.118 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.118 INFO:teuthology.orchestra.run.smithi087.stdout:[mon] 2021-07-26T15:46:04.119 INFO:teuthology.orchestra.run.smithi087.stdout: debug ms = 1 2021-07-26T15:46:04.119 INFO:teuthology.orchestra.run.smithi087.stdout: debug mon = 20 2021-07-26T15:46:04.119 INFO:teuthology.orchestra.run.smithi087.stdout: debug paxos = 20 2021-07-26T15:46:04.119 INFO:teuthology.orchestra.run.smithi087.stdout: debug auth = 20 2021-07-26T15:46:04.119 INFO:teuthology.orchestra.run.smithi087.stdout: mon data avail warn = 5 2021-07-26T15:46:04.120 INFO:teuthology.orchestra.run.smithi087.stdout: mon mgr mkfs grace = 240 2021-07-26T15:46:04.120 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min pgs per osd = 4 2021-07-26T15:46:04.120 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd reporter subtree level = osd 2021-07-26T15:46:04.120 INFO:teuthology.orchestra.run.smithi087.stdout: mon osd prime pg temp = true 2021-07-26T15:46:04.121 INFO:teuthology.orchestra.run.smithi087.stdout: mon reweight min bytes per osd = 10 2021-07-26T15:46:04.121 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.121 INFO:teuthology.orchestra.run.smithi087.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-07-26T15:46:04.121 INFO:teuthology.orchestra.run.smithi087.stdout: auth mon ticket ttl = 660 # 11m 2021-07-26T15:46:04.121 INFO:teuthology.orchestra.run.smithi087.stdout: auth service ticket ttl = 240 # 4m 2021-07-26T15:46:04.122 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.122 INFO:teuthology.orchestra.run.smithi087.stdout: # don't complain about insecure global_id in the test suite 2021-07-26T15:46:04.122 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim = False 2021-07-26T15:46:04.122 INFO:teuthology.orchestra.run.smithi087.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = False 2021-07-26T15:46:04.122 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:04.123 INFO:teuthology.orchestra.run.smithi087.stdout:[client] 2021-07-26T15:46:04.123 INFO:teuthology.orchestra.run.smithi087.stdout: rgw cache enabled = true 2021-07-26T15:46:04.123 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable ops log = true 2021-07-26T15:46:04.124 INFO:teuthology.orchestra.run.smithi087.stdout: rgw enable usage log = true 2021-07-26T15:46:04.124 INFO:teuthology.orchestra.run.smithi087.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-07-26T15:46:04.124 INFO:teuthology.orchestra.run.smithi087.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-07-26T15:46:04.124 INFO:teuthology.orchestra.run.smithi087.stdout: debug rgw = 20 2021-07-26T15:46:04.124 INFO:teuthology.orchestra.run.smithi087.stdout: rgw crypt require ssl = False 2021-07-26T15:46:04.125 INFO:teuthology.orchestra.run.smithi087.stdout: rgw crypt s3 kms backend = testing 2021-07-26T15:46:04.125 INFO:teuthology.orchestra.run.smithi087.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= 2021-07-26T15:46:04.125 INFO:teuthology.orchestra.run.smithi087.stdout: rgw curl low speed time = 300 2021-07-26T15:46:04.125 INFO:teuthology.orchestra.run.smithi087.stdout: rgw data log num shards = 4 2021-07-26T15:46:04.125 INFO:teuthology.orchestra.run.smithi087.stdout: rgw md log max shards = 4 2021-07-26T15:46:04.126 INFO:teuthology.orchestra.run.smithi087.stdout: rgw sync log trim interval = 0 2021-07-26T15:46:04.126 INFO:teuthology.orchestra.run.smithi087.stdout: rgw sync obj etag verify = True 2021-07-26T15:46:04.126 INFO:teuthology.orchestra.run.smithi087.stdout: setgroup = ceph 2021-07-26T15:46:04.126 INFO:teuthology.orchestra.run.smithi087.stdout: setuser = ceph 2021-07-26T15:46:04.127 INFO:teuthology.orchestra.run.smithi087.stdout:[mon.a] 2021-07-26T15:46:04.128 INFO:tasks.ceph:Creating admin key on c2.mon.a... 2021-07-26T15:46:04.129 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/c2.keyring 2021-07-26T15:46:04.174 INFO:tasks.ceph:Copying monmap to all nodes... 2021-07-26T15:46:04.174 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:04.175 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/c2.keyring of=/dev/stdout 2021-07-26T15:46:04.181 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:04.182 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/home/ubuntu/cephtest/c2.monmap of=/dev/stdout 2021-07-26T15:46:04.187 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi067.front.sepia.ceph.com 2021-07-26T15:46:04.188 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:46:04.188 DEBUG:teuthology.orchestra.run.smithi067:> sudo dd of=/etc/ceph/c2.keyring 2021-07-26T15:46:04.188 DEBUG:teuthology.orchestra.run.smithi067:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-07-26T15:46:04.217 DEBUG:teuthology.orchestra.run.smithi067:> set -ex 2021-07-26T15:46:04.217 DEBUG:teuthology.orchestra.run.smithi067:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-07-26T15:46:04.223 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi087.front.sepia.ceph.com 2021-07-26T15:46:04.224 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:04.226 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/ceph/c2.keyring 2021-07-26T15:46:04.226 DEBUG:teuthology.orchestra.run.smithi087:> sudo chmod 0644 /etc/ceph/c2.keyring 2021-07-26T15:46:04.254 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:04.255 DEBUG:teuthology.orchestra.run.smithi087:> dd of=/home/ubuntu/cephtest/c2.monmap 2021-07-26T15:46:04.262 INFO:tasks.ceph:Setting up mon nodes... 2021-07-26T15:46:04.263 INFO:tasks.ceph:Setting up mgr nodes... 2021-07-26T15:46:04.263 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mgr/c2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/c2-x/keyring 2021-07-26T15:46:04.305 INFO:teuthology.orchestra.run.smithi087.stdout:creating /var/lib/ceph/mgr/c2-x/keyring 2021-07-26T15:46:04.307 INFO:tasks.ceph:Setting up mds nodes... 2021-07-26T15:46:04.310 INFO:tasks.ceph_client:Setting up client nodes... 2021-07-26T15:46:04.311 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/c2.client.0.keyring && sudo chmod 0644 /etc/ceph/c2.client.0.keyring 2021-07-26T15:46:04.383 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/c2.client.0.keyring 2021-07-26T15:46:04.396 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/c2.client.1.keyring && sudo chmod 0644 /etc/ceph/c2.client.1.keyring 2021-07-26T15:46:04.425 INFO:teuthology.orchestra.run.smithi087.stdout:creating /etc/ceph/c2.client.1.keyring 2021-07-26T15:46:04.437 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-07-26T15:46:04.437 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi067.front.sepia.ceph.com'): {'c1.osd.0': '/dev/vg_nvme/lv_1', 'c1.osd.1': '/dev/vg_nvme/lv_2', 'c1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi087.front.sepia.ceph.com'): {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-07-26T15:46:04.438 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/c2-0 2021-07-26T15:46:04.453 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:46:04.454 INFO:tasks.ceph:role: c2.osd.0 2021-07-26T15:46:04.454 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com 2021-07-26T15:46:04.455 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-07-26T15:46:05.014 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:46:05.014 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:46:05.015 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:46:05.015 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2021-07-26T15:46:05.015 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:46:05.015 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:46:05.016 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:46:05.016 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:46:05.016 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:46:05.016 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:46:05.017 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2021-07-26T15:46:05.018 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/c2-0 2021-07-26T15:46:05.123 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-0 2021-07-26T15:46:05.137 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:46:05.138 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:46:05.139 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/c2-1 2021-07-26T15:46:05.197 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:46:05.198 INFO:tasks.ceph:role: c2.osd.1 2021-07-26T15:46:05.198 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com 2021-07-26T15:46:05.199 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-07-26T15:46:05.711 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:46:05.711 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:46:05.711 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:46:05.711 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2021-07-26T15:46:05.712 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:46:05.712 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:46:05.712 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:46:05.712 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:46:05.713 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:46:05.713 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:46:05.714 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2021-07-26T15:46:05.714 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/c2-1 2021-07-26T15:46:05.756 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-1 2021-07-26T15:46:05.812 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:46:05.813 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:46:05.814 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/osd/c2-2 2021-07-26T15:46:05.827 INFO:tasks.ceph:roles_to_devs: {'c2.osd.0': '/dev/vg_nvme/lv_1', 'c2.osd.1': '/dev/vg_nvme/lv_2', 'c2.osd.2': '/dev/vg_nvme/lv_3'} 2021-07-26T15:46:05.827 INFO:tasks.ceph:role: c2.osd.2 2021-07-26T15:46:05.828 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com 2021-07-26T15:46:05.828 DEBUG:teuthology.orchestra.run.smithi087:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-07-26T15:46:06.361 INFO:teuthology.orchestra.run.smithi087.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2021-07-26T15:46:06.361 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 attr=2, projid32bit=1 2021-07-26T15:46:06.361 INFO:teuthology.orchestra.run.smithi087.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-07-26T15:46:06.362 INFO:teuthology.orchestra.run.smithi087.stdout: = reflink=1 2021-07-26T15:46:06.362 INFO:teuthology.orchestra.run.smithi087.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2021-07-26T15:46:06.362 INFO:teuthology.orchestra.run.smithi087.stdout: = sunit=0 swidth=0 blks 2021-07-26T15:46:06.362 INFO:teuthology.orchestra.run.smithi087.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-07-26T15:46:06.363 INFO:teuthology.orchestra.run.smithi087.stdout:log =internal log bsize=4096 blocks=11443, version=2 2021-07-26T15:46:06.363 INFO:teuthology.orchestra.run.smithi087.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-07-26T15:46:06.363 INFO:teuthology.orchestra.run.smithi087.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-07-26T15:46:06.364 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi087.front.sepia.ceph.com -o noatime 2021-07-26T15:46:06.365 DEBUG:teuthology.orchestra.run.smithi087:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/c2-2 2021-07-26T15:46:06.432 DEBUG:teuthology.orchestra.run.smithi087:> sudo /sbin/restorecon /var/lib/ceph/osd/c2-2 2021-07-26T15:46:06.444 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-07-26T15:46:06.444 INFO:teuthology.orchestra.run.smithi087.stderr:sudo: /sbin/restorecon: command not found 2021-07-26T15:46:06.445 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:46:06.553 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:06.550+0000 7fad9d4cbd80 -1 auth: error reading file: /var/lib/ceph/osd/c2-0/keyring: can't open /var/lib/ceph/osd/c2-0/keyring: (2) No such file or directory 2021-07-26T15:46:06.555 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:06.550+0000 7fad9d4cbd80 -1 created new key in keyring /var/lib/ceph/osd/c2-0/keyring 2021-07-26T15:46:06.555 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:06.550+0000 7fad9d4cbd80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-07-26T15:46:06.556 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:06.550+0000 7fad9d4cbd80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-07-26T15:46:06.556 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:06.550+0000 7fad9d4cbd80 -1 bluestore(/var/lib/ceph/osd/c2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-0/block: (2) No such file or directory 2021-07-26T15:46:06.556 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:06.550+0000 7fad9d4cbd80 -1 bluestore(/var/lib/ceph/osd/c2-0) _read_fsid unparsable uuid 2021-07-26T15:46:06.578 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:06.574+0000 7fad9d4cbd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:46:08.463 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-0 2021-07-26T15:46:08.481 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:46:08.515 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:08.510+0000 7fd469a6dd80 -1 auth: error reading file: /var/lib/ceph/osd/c2-1/keyring: can't open /var/lib/ceph/osd/c2-1/keyring: (2) No such file or directory 2021-07-26T15:46:08.516 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:08.510+0000 7fd469a6dd80 -1 created new key in keyring /var/lib/ceph/osd/c2-1/keyring 2021-07-26T15:46:08.516 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:08.510+0000 7fd469a6dd80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-07-26T15:46:08.516 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:08.510+0000 7fd469a6dd80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-07-26T15:46:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:08.510+0000 7fd469a6dd80 -1 bluestore(/var/lib/ceph/osd/c2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-1/block: (2) No such file or directory 2021-07-26T15:46:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:08.510+0000 7fd469a6dd80 -1 bluestore(/var/lib/ceph/osd/c2-1) _read_fsid unparsable uuid 2021-07-26T15:46:08.533 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:08.526+0000 7fd469a6dd80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:46:10.444 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-1 2021-07-26T15:46:10.522 DEBUG:teuthology.orchestra.run.smithi087:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster c2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:46:10.627 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:10.622+0000 7fb06bdb0d80 -1 auth: error reading file: /var/lib/ceph/osd/c2-2/keyring: can't open /var/lib/ceph/osd/c2-2/keyring: (2) No such file or directory 2021-07-26T15:46:10.628 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:10.622+0000 7fb06bdb0d80 -1 created new key in keyring /var/lib/ceph/osd/c2-2/keyring 2021-07-26T15:46:10.628 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:10.622+0000 7fb06bdb0d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-07-26T15:46:10.629 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:10.622+0000 7fb06bdb0d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-07-26T15:46:10.629 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:10.622+0000 7fb06bdb0d80 -1 bluestore(/var/lib/ceph/osd/c2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/c2-2/block: (2) No such file or directory 2021-07-26T15:46:10.630 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:10.622+0000 7fb06bdb0d80 -1 bluestore(/var/lib/ceph/osd/c2-2) _read_fsid unparsable uuid 2021-07-26T15:46:10.645 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:10.638+0000 7fb06bdb0d80 -1 freelist read_size_meta_from_db missing size meta in DB 2021-07-26T15:46:12.559 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/osd/c2-2 2021-07-26T15:46:12.624 INFO:tasks.ceph:Reading keys from all nodes... 2021-07-26T15:46:12.624 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:12.625 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/mgr/c2-x/keyring of=/dev/stdout 2021-07-26T15:46:12.641 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:12.641 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/c2-0/keyring of=/dev/stdout 2021-07-26T15:46:12.708 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:12.708 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/c2-1/keyring of=/dev/stdout 2021-07-26T15:46:12.762 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:12.763 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/c2-2/keyring of=/dev/stdout 2021-07-26T15:46:12.773 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:12.774 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/c2.client.0.keyring of=/dev/stdout 2021-07-26T15:46:12.783 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:12.784 DEBUG:teuthology.orchestra.run.smithi087:> dd if=/etc/ceph/c2.client.1.keyring of=/dev/stdout 2021-07-26T15:46:12.791 INFO:tasks.ceph:Adding keys to all mons... 2021-07-26T15:46:12.792 DEBUG:teuthology.orchestra.run.smithi087:> sudo tee -a /etc/ceph/c2.keyring 2021-07-26T15:46:12.845 INFO:teuthology.orchestra.run.smithi087.stdout:[mgr.x] 2021-07-26T15:46:12.845 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC82P5gm/ogEhAAPlzGPtZ3xI2eq5xsE/7WPQ== 2021-07-26T15:46:12.846 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.0] 2021-07-26T15:46:12.846 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC+2P5gdpzwIBAAFWF6b38hR85Em47aHjMGog== 2021-07-26T15:46:12.846 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.1] 2021-07-26T15:46:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDA2P5gfwOtHhAAu7r0uuCt4eVJ7m7BnM5scw== 2021-07-26T15:46:12.847 INFO:teuthology.orchestra.run.smithi087.stdout:[osd.2] 2021-07-26T15:46:12.847 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQDC2P5gJJ9LJRAApHYdIsQb4Aj9IB8D5TRfOA== 2021-07-26T15:46:12.847 INFO:teuthology.orchestra.run.smithi087.stdout:[client.0] 2021-07-26T15:46:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC82P5grTjSFhAAwe/+J/YNSpc994DQyqnRbQ== 2021-07-26T15:46:12.848 INFO:teuthology.orchestra.run.smithi087.stdout:[client.1] 2021-07-26T15:46:12.848 INFO:teuthology.orchestra.run.smithi087.stdout: key = AQC82P5g/wRTGRAAQ8jTV91/7YX6JwTgNMgqRQ== 2021-07-26T15:46:12.850 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-07-26T15:46:12.892 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:46:12.976 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:46:13.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2021-07-26T15:46:13.055 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-07-26T15:46:13.096 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/c2.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-07-26T15:46:13.186 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-07-26T15:46:13.187 DEBUG:teuthology.orchestra.run.smithi087:> sudo mkdir -p /var/lib/ceph/mon/c2-a 2021-07-26T15:46:13.204 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster c2 --mkfs -i a --monmap /home/ubuntu/cephtest/c2.monmap --keyring /etc/ceph/c2.keyring 2021-07-26T15:46:13.304 DEBUG:teuthology.orchestra.run.smithi087:> sudo chown -R ceph:ceph /var/lib/ceph/mon/c2-a 2021-07-26T15:46:13.319 DEBUG:teuthology.orchestra.run.smithi087:> rm -- /home/ubuntu/cephtest/c2.monmap 2021-07-26T15:46:13.324 INFO:tasks.ceph:Starting mon daemons in cluster c2... 2021-07-26T15:46:13.325 INFO:tasks.ceph.c2.mon.a:Restarting daemon 2021-07-26T15:46:13.326 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster c2 -i a 2021-07-26T15:46:13.370 INFO:tasks.ceph.c2.mon.a:Started 2021-07-26T15:46:13.371 INFO:tasks.ceph:Starting mgr daemons in cluster c2... 2021-07-26T15:46:13.372 INFO:tasks.ceph.c2.mgr.x:Restarting daemon 2021-07-26T15:46:13.372 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster c2 -i x 2021-07-26T15:46:13.375 INFO:tasks.ceph.c2.mgr.x:Started 2021-07-26T15:46:13.376 INFO:tasks.ceph:Setting crush tunables to default 2021-07-26T15:46:13.377 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster c2 osd crush tunables default 2021-07-26T15:46:13.601 INFO:teuthology.orchestra.run.smithi087.stderr:adjusted tunables profile to default 2021-07-26T15:46:13.613 INFO:tasks.ceph:Starting osd daemons in cluster c2... 2021-07-26T15:46:13.615 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:13.615 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/c2-0/fsid of=/dev/stdout 2021-07-26T15:46:13.625 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:13.626 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/c2-1/fsid of=/dev/stdout 2021-07-26T15:46:13.638 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:13.639 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd if=/var/lib/ceph/osd/c2-2/fsid of=/dev/stdout 2021-07-26T15:46:13.652 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster c2 osd new 15d61128-bdd6-4955-bc42-6ec0ec732176 0 2021-07-26T15:46:13.830 INFO:teuthology.orchestra.run.smithi087.stdout:0 2021-07-26T15:46:13.840 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster c2 osd new 0f1dd4d1-2f99-4b2b-94d5-22ef9d9fb2d1 1 2021-07-26T15:46:14.024 INFO:teuthology.orchestra.run.smithi087.stdout:1 2021-07-26T15:46:14.035 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster c2 osd new e4ed904c-3068-4c5b-80fa-723ce2296da7 2 2021-07-26T15:46:14.222 INFO:teuthology.orchestra.run.smithi087.stdout:2 2021-07-26T15:46:14.237 INFO:tasks.ceph.c2.osd.0:Restarting daemon 2021-07-26T15:46:14.237 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 0 2021-07-26T15:46:14.239 INFO:tasks.ceph.c2.osd.0:Started 2021-07-26T15:46:14.240 INFO:tasks.ceph.c2.osd.1:Restarting daemon 2021-07-26T15:46:14.240 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 1 2021-07-26T15:46:14.243 INFO:tasks.ceph.c2.osd.1:Started 2021-07-26T15:46:14.244 INFO:tasks.ceph.c2.osd.2:Restarting daemon 2021-07-26T15:46:14.244 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster c2 -i 2 2021-07-26T15:46:14.246 INFO:tasks.ceph.c2.osd.2:Started 2021-07-26T15:46:14.247 INFO:tasks.ceph:Waiting for OSDs to come up 2021-07-26T15:46:14.549 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-07-26T15:46:14.611 INFO:tasks.ceph.c2.osd.1.smithi087.stderr:2021-07-26T15:46:14.606+0000 7fa8e55bed80 -1 Falling back to public interface 2021-07-26T15:46:14.697 INFO:teuthology.misc.health.smithi087.stdout: 2021-07-26T15:46:14.698 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":5,"fsid":"93bd2c70-9cf8-4f29-a5a4-17ad7b52319d","created":"2021-07-26T15:46:13.496849+0000","modified":"2021-07-26T15:46:14.215680+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"15d61128-bdd6-4955-bc42-6ec0ec732176","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0f1dd4d1-2f99-4b2b-94d5-22ef9d9fb2d1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"e4ed904c-3068-4c5b-80fa-723ce2296da7","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:46:14.714 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-07-26T15:46:14.839 INFO:tasks.ceph.c2.osd.2.smithi087.stderr:2021-07-26T15:46:14.834+0000 7f44c9340d80 -1 Falling back to public interface 2021-07-26T15:46:14.895 INFO:tasks.ceph.c2.osd.0.smithi087.stderr:2021-07-26T15:46:14.890+0000 7f62cd6e6d80 -1 Falling back to public interface 2021-07-26T15:46:15.252 INFO:tasks.ceph.c2.osd.1.smithi087.stderr:2021-07-26T15:46:15.246+0000 7fa8e55bed80 -1 osd.1 0 log_to_monitors {default=true} 2021-07-26T15:46:15.475 INFO:tasks.ceph.c2.osd.2.smithi087.stderr:2021-07-26T15:46:15.470+0000 7f44c9340d80 -1 osd.2 0 log_to_monitors {default=true} 2021-07-26T15:46:15.538 INFO:tasks.ceph.c2.osd.0.smithi087.stderr:2021-07-26T15:46:15.530+0000 7f62cd6e6d80 -1 osd.0 0 log_to_monitors {default=true} 2021-07-26T15:46:16.530 INFO:tasks.ceph.c2.osd.1.smithi087.stderr:2021-07-26T15:46:16.526+0000 7fa8d7678700 -1 osd.1 0 waiting for initial osdmap 2021-07-26T15:46:16.531 INFO:tasks.ceph.c2.osd.2.smithi087.stderr:2021-07-26T15:46:16.526+0000 7f44bb3fa700 -1 osd.2 0 waiting for initial osdmap 2021-07-26T15:46:17.535 INFO:tasks.ceph.c2.osd.0.smithi087.stderr:2021-07-26T15:46:17.530+0000 7f62bf7a0700 -1 osd.0 0 waiting for initial osdmap 2021-07-26T15:46:21.018 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster c2 osd dump --format=json 2021-07-26T15:46:21.254 INFO:teuthology.misc.health.smithi087.stdout: 2021-07-26T15:46:21.255 INFO:teuthology.misc.health.smithi087.stdout:{"epoch":11,"fsid":"93bd2c70-9cf8-4f29-a5a4-17ad7b52319d","created":"2021-07-26T15:46:13.496849+0000","modified":"2021-07-26T15:46:20.527145+0000","last_up_change":"2021-07-26T15:46:18.523749+0000","last_in_change":"2021-07-26T15:46:18.523749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:46:16.347930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"15d61128-bdd6-4955-bc42-6ec0ec732176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":14308},{"type":"v1","addr":"172.21.15.87:6817","nonce":14308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":14308},{"type":"v1","addr":"172.21.15.87:6819","nonce":14308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":14308},{"type":"v1","addr":"172.21.15.87:6823","nonce":14308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":14308},{"type":"v1","addr":"172.21.15.87:6821","nonce":14308}]},"public_addr":"172.21.15.87:6817/14308","cluster_addr":"172.21.15.87:6819/14308","heartbeat_back_addr":"172.21.15.87:6823/14308","heartbeat_front_addr":"172.21.15.87:6821/14308","state":["exists","up"]},{"osd":1,"uuid":"0f1dd4d1-2f99-4b2b-94d5-22ef9d9fb2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":14310},{"type":"v1","addr":"172.21.15.87:6801","nonce":14310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":14310},{"type":"v1","addr":"172.21.15.87:6803","nonce":14310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":14310},{"type":"v1","addr":"172.21.15.87:6807","nonce":14310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":14310},{"type":"v1","addr":"172.21.15.87:6805","nonce":14310}]},"public_addr":"172.21.15.87:6801/14310","cluster_addr":"172.21.15.87:6803/14310","heartbeat_back_addr":"172.21.15.87:6807/14310","heartbeat_front_addr":"172.21.15.87:6805/14310","state":["exists","up"]},{"osd":2,"uuid":"e4ed904c-3068-4c5b-80fa-723ce2296da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":14309},{"type":"v1","addr":"172.21.15.87:6809","nonce":14309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":14309},{"type":"v1","addr":"172.21.15.87:6811","nonce":14309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":14309},{"type":"v1","addr":"172.21.15.87:6815","nonce":14309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":14309},{"type":"v1","addr":"172.21.15.87:6813","nonce":14309}]},"public_addr":"172.21.15.87:6809/14309","cluster_addr":"172.21.15.87:6811/14309","heartbeat_back_addr":"172.21.15.87:6815/14309","heartbeat_front_addr":"172.21.15.87:6813/14309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.572686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.220986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.524728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:46:21.266 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-07-26T15:46:21.267 INFO:tasks.ceph:Creating RBD pool 2021-07-26T15:46:21.268 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster c2 osd pool create rbd 8 2021-07-26T15:46:21.788 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'rbd' created 2021-07-26T15:46:21.800 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph --cluster c2 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-07-26T15:46:22.799 INFO:teuthology.orchestra.run.smithi087.stderr:enabled application 'rbd' on pool 'rbd' 2021-07-26T15:46:22.807 INFO:tasks.ceph:Starting mds daemons in cluster c2... 2021-07-26T15:46:22.807 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-07-26T15:46:22.811 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-07-26T15:46:23.057 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:23.057 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":13,"fsid":"93bd2c70-9cf8-4f29-a5a4-17ad7b52319d","created":"2021-07-26T15:46:13.496849+0000","modified":"2021-07-26T15:46:22.775007+0000","last_up_change":"2021-07-26T15:46:18.523749+0000","last_in_change":"2021-07-26T15:46:18.523749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:46:16.347930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:46:21.565371+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15d61128-bdd6-4955-bc42-6ec0ec732176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":14308},{"type":"v1","addr":"172.21.15.87:6817","nonce":14308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":14308},{"type":"v1","addr":"172.21.15.87:6819","nonce":14308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":14308},{"type":"v1","addr":"172.21.15.87:6823","nonce":14308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":14308},{"type":"v1","addr":"172.21.15.87:6821","nonce":14308}]},"public_addr":"172.21.15.87:6817/14308","cluster_addr":"172.21.15.87:6819/14308","heartbeat_back_addr":"172.21.15.87:6823/14308","heartbeat_front_addr":"172.21.15.87:6821/14308","state":["exists","up"]},{"osd":1,"uuid":"0f1dd4d1-2f99-4b2b-94d5-22ef9d9fb2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":14310},{"type":"v1","addr":"172.21.15.87:6801","nonce":14310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":14310},{"type":"v1","addr":"172.21.15.87:6803","nonce":14310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":14310},{"type":"v1","addr":"172.21.15.87:6807","nonce":14310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":14310},{"type":"v1","addr":"172.21.15.87:6805","nonce":14310}]},"public_addr":"172.21.15.87:6801/14310","cluster_addr":"172.21.15.87:6803/14310","heartbeat_back_addr":"172.21.15.87:6807/14310","heartbeat_front_addr":"172.21.15.87:6805/14310","state":["exists","up"]},{"osd":2,"uuid":"e4ed904c-3068-4c5b-80fa-723ce2296da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":14309},{"type":"v1","addr":"172.21.15.87:6809","nonce":14309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":14309},{"type":"v1","addr":"172.21.15.87:6811","nonce":14309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":14309},{"type":"v1","addr":"172.21.15.87:6815","nonce":14309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":14309},{"type":"v1","addr":"172.21.15.87:6813","nonce":14309}]},"public_addr":"172.21.15.87:6809/14309","cluster_addr":"172.21.15.87:6811/14309","heartbeat_back_addr":"172.21.15.87:6815/14309","heartbeat_front_addr":"172.21.15.87:6813/14309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.572686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.220986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.524728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:46:23.073 INFO:tasks.ceph.ceph_manager.c2:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-07-26T15:46:16.347930+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2021-07-26T15:46:21.565371+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2021-07-26T15:46:23.074 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd pool get device_health_metrics pg_num 2021-07-26T15:46:23.317 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 1 2021-07-26T15:46:23.329 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd pool get rbd pg_num 2021-07-26T15:46:23.570 INFO:teuthology.orchestra.run.smithi087.stdout:pg_num: 8 2021-07-26T15:46:23.581 INFO:tasks.ceph:Waiting until c2 daemons up and pgs clean... 2021-07-26T15:46:23.582 INFO:tasks.ceph.ceph_manager.c2:waiting for mgr available 2021-07-26T15:46:23.582 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 mgr dump --format=json 2021-07-26T15:46:23.857 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:23.867 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":4,"active_gid":4099,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6824","nonce":14122},{"type":"v1","addr":"172.21.15.87:6825","nonce":14122}]},"active_addr":"172.21.15.87:6825/14122","active_change":"2021-07-26T15:46:16.262300+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":1830887354}]},{"addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3375878480}]},{"addrvec":[{"type":"v2","addr":"172.21.15.87:0","nonce":3768829343}]}]}} 2021-07-26T15:46:23.870 INFO:tasks.ceph.ceph_manager.c2:mgr available! 2021-07-26T15:46:23.870 INFO:tasks.ceph.ceph_manager.c2:waiting for all up 2021-07-26T15:46:23.870 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-07-26T15:46:24.111 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:24.112 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":14,"fsid":"93bd2c70-9cf8-4f29-a5a4-17ad7b52319d","created":"2021-07-26T15:46:13.496849+0000","modified":"2021-07-26T15:46:23.780067+0000","last_up_change":"2021-07-26T15:46:18.523749+0000","last_in_change":"2021-07-26T15:46:18.523749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:46:16.347930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:46:21.565371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15d61128-bdd6-4955-bc42-6ec0ec732176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":14308},{"type":"v1","addr":"172.21.15.87:6817","nonce":14308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":14308},{"type":"v1","addr":"172.21.15.87:6819","nonce":14308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":14308},{"type":"v1","addr":"172.21.15.87:6823","nonce":14308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":14308},{"type":"v1","addr":"172.21.15.87:6821","nonce":14308}]},"public_addr":"172.21.15.87:6817/14308","cluster_addr":"172.21.15.87:6819/14308","heartbeat_back_addr":"172.21.15.87:6823/14308","heartbeat_front_addr":"172.21.15.87:6821/14308","state":["exists","up"]},{"osd":1,"uuid":"0f1dd4d1-2f99-4b2b-94d5-22ef9d9fb2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":14310},{"type":"v1","addr":"172.21.15.87:6801","nonce":14310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":14310},{"type":"v1","addr":"172.21.15.87:6803","nonce":14310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":14310},{"type":"v1","addr":"172.21.15.87:6807","nonce":14310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":14310},{"type":"v1","addr":"172.21.15.87:6805","nonce":14310}]},"public_addr":"172.21.15.87:6801/14310","cluster_addr":"172.21.15.87:6803/14310","heartbeat_back_addr":"172.21.15.87:6807/14310","heartbeat_front_addr":"172.21.15.87:6805/14310","state":["exists","up"]},{"osd":2,"uuid":"e4ed904c-3068-4c5b-80fa-723ce2296da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":14309},{"type":"v1","addr":"172.21.15.87:6809","nonce":14309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":14309},{"type":"v1","addr":"172.21.15.87:6811","nonce":14309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":14309},{"type":"v1","addr":"172.21.15.87:6815","nonce":14309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":14309},{"type":"v1","addr":"172.21.15.87:6813","nonce":14309}]},"public_addr":"172.21.15.87:6809/14309","cluster_addr":"172.21.15.87:6811/14309","heartbeat_back_addr":"172.21.15.87:6815/14309","heartbeat_front_addr":"172.21.15.87:6813/14309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.572686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.220986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.524728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:46:24.123 INFO:tasks.ceph.ceph_manager.c2:all up! 2021-07-26T15:46:24.124 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd dump --format=json 2021-07-26T15:46:24.366 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:24.367 INFO:teuthology.orchestra.run.smithi087.stdout:{"epoch":14,"fsid":"93bd2c70-9cf8-4f29-a5a4-17ad7b52319d","created":"2021-07-26T15:46:13.496849+0000","modified":"2021-07-26T15:46:23.780067+0000","last_up_change":"2021-07-26T15:46:18.523749+0000","last_in_change":"2021-07-26T15:46:18.523749+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-07-26T15:46:16.347930+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-07-26T15:46:21.565371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"15d61128-bdd6-4955-bc42-6ec0ec732176","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6816","nonce":14308},{"type":"v1","addr":"172.21.15.87:6817","nonce":14308}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6818","nonce":14308},{"type":"v1","addr":"172.21.15.87:6819","nonce":14308}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6822","nonce":14308},{"type":"v1","addr":"172.21.15.87:6823","nonce":14308}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6820","nonce":14308},{"type":"v1","addr":"172.21.15.87:6821","nonce":14308}]},"public_addr":"172.21.15.87:6817/14308","cluster_addr":"172.21.15.87:6819/14308","heartbeat_back_addr":"172.21.15.87:6823/14308","heartbeat_front_addr":"172.21.15.87:6821/14308","state":["exists","up"]},{"osd":1,"uuid":"0f1dd4d1-2f99-4b2b-94d5-22ef9d9fb2d1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6800","nonce":14310},{"type":"v1","addr":"172.21.15.87:6801","nonce":14310}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6802","nonce":14310},{"type":"v1","addr":"172.21.15.87:6803","nonce":14310}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6806","nonce":14310},{"type":"v1","addr":"172.21.15.87:6807","nonce":14310}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6804","nonce":14310},{"type":"v1","addr":"172.21.15.87:6805","nonce":14310}]},"public_addr":"172.21.15.87:6801/14310","cluster_addr":"172.21.15.87:6803/14310","heartbeat_back_addr":"172.21.15.87:6807/14310","heartbeat_front_addr":"172.21.15.87:6805/14310","state":["exists","up"]},{"osd":2,"uuid":"e4ed904c-3068-4c5b-80fa-723ce2296da7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6808","nonce":14309},{"type":"v1","addr":"172.21.15.87:6809","nonce":14309}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6810","nonce":14309},{"type":"v1","addr":"172.21.15.87:6811","nonce":14309}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6814","nonce":14309},{"type":"v1","addr":"172.21.15.87:6815","nonce":14309}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.87:6812","nonce":14309},{"type":"v1","addr":"172.21.15.87:6813","nonce":14309}]},"public_addr":"172.21.15.87:6809/14309","cluster_addr":"172.21.15.87:6811/14309","heartbeat_back_addr":"172.21.15.87:6815/14309","heartbeat_front_addr":"172.21.15.87:6813/14309","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.572686+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.220986+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2021-07-26T15:46:16.524728+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2021-07-26T15:46:24.379 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.0 flush_pg_stats 2021-07-26T15:46:24.522 INFO:teuthology.orchestra.run.smithi087.stdout:38654705668 2021-07-26T15:46:24.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.1 flush_pg_stats 2021-07-26T15:46:24.661 INFO:teuthology.orchestra.run.smithi087.stdout:34359738371 2021-07-26T15:46:24.661 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 tell osd.2 flush_pg_stats 2021-07-26T15:46:24.804 INFO:teuthology.orchestra.run.smithi087.stdout:34359738372 2021-07-26T15:46:24.805 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-07-26T15:46:25.048 INFO:teuthology.orchestra.run.smithi087.stdout:38654705667 2021-07-26T15:46:25.060 INFO:tasks.ceph.ceph_manager.c2:need seq 38654705668 got 38654705667 for osd.0 2021-07-26T15:46:26.061 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-07-26T15:46:26.317 INFO:teuthology.orchestra.run.smithi087.stdout:38654705667 2021-07-26T15:46:26.328 INFO:tasks.ceph.ceph_manager.c2:need seq 38654705668 got 38654705667 for osd.0 2021-07-26T15:46:27.330 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.0 2021-07-26T15:46:27.580 INFO:teuthology.orchestra.run.smithi087.stdout:38654705668 2021-07-26T15:46:27.592 INFO:tasks.ceph.ceph_manager.c2:need seq 38654705668 got 38654705668 for osd.0 2021-07-26T15:46:27.592 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.1 2021-07-26T15:46:27.830 INFO:teuthology.orchestra.run.smithi087.stdout:34359738371 2021-07-26T15:46:27.842 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738371 got 34359738371 for osd.1 2021-07-26T15:46:27.843 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 osd last-stat-seq osd.2 2021-07-26T15:46:28.081 INFO:teuthology.orchestra.run.smithi087.stdout:34359738372 2021-07-26T15:46:28.094 INFO:tasks.ceph.ceph_manager.c2:need seq 34359738372 got 34359738372 for osd.2 2021-07-26T15:46:28.094 INFO:tasks.ceph.ceph_manager.c2:waiting for clean 2021-07-26T15:46:28.096 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2021-07-26T15:46:28.331 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:28.334 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2021-07-26T15:46:28.344 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2021-07-26T15:46:28.273450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146104,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426696,"statfs":{"total":322122547200,"available":318900936704,"internally_reserved":3221225472,"allocated":360448,"data_stored":103800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.490958"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795155+0000","last_change":"2021-07-26T15:46:22.793476+0000","last_active":"2021-07-26T15:46:22.795155+0000","last_peered":"2021-07-26T15:46:22.795155+0000","last_clean":"2021-07-26T15:46:22.795155+0000","last_became_active":"2021-07-26T15:46:22.792836+0000","last_became_peered":"2021-07-26T15:46:22.792836+0000","last_unstale":"2021-07-26T15:46:22.795155+0000","last_undegraded":"2021-07-26T15:46:22.795155+0000","last_fullsized":"2021-07-26T15:46:22.795155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795199+0000","last_change":"2021-07-26T15:46:22.793496+0000","last_active":"2021-07-26T15:46:22.795199+0000","last_peered":"2021-07-26T15:46:22.795199+0000","last_clean":"2021-07-26T15:46:22.795199+0000","last_became_active":"2021-07-26T15:46:22.791897+0000","last_became_peered":"2021-07-26T15:46:22.791897+0000","last_unstale":"2021-07-26T15:46:22.795199+0000","last_undegraded":"2021-07-26T15:46:22.795199+0000","last_fullsized":"2021-07-26T15:46:22.795199+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795171+0000","last_change":"2021-07-26T15:46:22.793355+0000","last_active":"2021-07-26T15:46:22.795171+0000","last_peered":"2021-07-26T15:46:22.795171+0000","last_clean":"2021-07-26T15:46:22.795171+0000","last_became_active":"2021-07-26T15:46:22.792537+0000","last_became_peered":"2021-07-26T15:46:22.792537+0000","last_unstale":"2021-07-26T15:46:22.795171+0000","last_undegraded":"2021-07-26T15:46:22.795171+0000","last_fullsized":"2021-07-26T15:46:22.795171+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795165+0000","last_change":"2021-07-26T15:46:22.793495+0000","last_active":"2021-07-26T15:46:22.795165+0000","last_peered":"2021-07-26T15:46:22.795165+0000","last_clean":"2021-07-26T15:46:22.795165+0000","last_became_active":"2021-07-26T15:46:22.792774+0000","last_became_peered":"2021-07-26T15:46:22.792774+0000","last_unstale":"2021-07-26T15:46:22.795165+0000","last_undegraded":"2021-07-26T15:46:22.795165+0000","last_fullsized":"2021-07-26T15:46:22.795165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.792092+0000","last_change":"2021-07-26T15:46:22.792092+0000","last_active":"2021-07-26T15:46:22.792092+0000","last_peered":"2021-07-26T15:46:22.792092+0000","last_clean":"2021-07-26T15:46:22.792092+0000","last_became_active":"2021-07-26T15:46:22.791436+0000","last_became_peered":"2021-07-26T15:46:22.791436+0000","last_unstale":"2021-07-26T15:46:22.792092+0000","last_undegraded":"2021-07-26T15:46:22.792092+0000","last_fullsized":"2021-07-26T15:46:22.792092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795012+0000","last_change":"2021-07-26T15:46:22.792503+0000","last_active":"2021-07-26T15:46:22.795012+0000","last_peered":"2021-07-26T15:46:22.795012+0000","last_clean":"2021-07-26T15:46:22.795012+0000","last_became_active":"2021-07-26T15:46:22.792074+0000","last_became_peered":"2021-07-26T15:46:22.792074+0000","last_unstale":"2021-07-26T15:46:22.795012+0000","last_undegraded":"2021-07-26T15:46:22.795012+0000","last_fullsized":"2021-07-26T15:46:22.795012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795236+0000","last_change":"2021-07-26T15:46:22.792687+0000","last_active":"2021-07-26T15:46:22.795236+0000","last_peered":"2021-07-26T15:46:22.795236+0000","last_clean":"2021-07-26T15:46:22.795236+0000","last_became_active":"2021-07-26T15:46:22.792141+0000","last_became_peered":"2021-07-26T15:46:22.792141+0000","last_unstale":"2021-07-26T15:46:22.795236+0000","last_undegraded":"2021-07-26T15:46:22.795236+0000","last_fullsized":"2021-07-26T15:46:22.795236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795236+0000","last_change":"2021-07-26T15:46:22.792235+0000","last_active":"2021-07-26T15:46:22.795236+0000","last_peered":"2021-07-26T15:46:22.795236+0000","last_clean":"2021-07-26T15:46:22.795236+0000","last_became_active":"2021-07-26T15:46:22.791079+0000","last_became_peered":"2021-07-26T15:46:22.791079+0000","last_unstale":"2021-07-26T15:46:22.795236+0000","last_undegraded":"2021-07-26T15:46:22.795236+0000","last_fullsized":"2021-07-26T15:46:22.795236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.783383+0000","last_change":"2021-07-26T15:46:19.538361+0000","last_active":"2021-07-26T15:46:22.783383+0000","last_peered":"2021-07-26T15:46:22.783383+0000","last_clean":"2021-07-26T15:46:22.783383+0000","last_became_active":"2021-07-26T15:46:19.537056+0000","last_became_peered":"2021-07-26T15:46:19.537056+0000","last_unstale":"2021-07-26T15:46:22.783383+0000","last_undegraded":"2021-07-26T15:46:22.783383+0000","last_fullsized":"2021-07-26T15:46:22.783383+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:16.518189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:16.518189+0000","last_clean_scrub_stamp":"2021-07-26T15:46:16.518189+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":32280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]}]}} 2021-07-26T15:46:28.345 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 pg dump --format=json 2021-07-26T15:46:28.580 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:28.583 INFO:teuthology.orchestra.run.smithi087.stderr:dumped all 2021-07-26T15:46:28.593 INFO:teuthology.orchestra.run.smithi087.stdout:{"pg_ready":true,"pg_map":{"version":16,"stamp":"2021-07-26T15:46:28.273450+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":314572800,"kb_used":3146104,"kb_used_data":352,"kb_used_omap":0,"kb_used_meta":3145728,"kb_avail":311426696,"statfs":{"total":322122547200,"available":318900936704,"internally_reserved":3221225472,"allocated":360448,"data_stored":103800,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":3221225472},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.490958"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795155+0000","last_change":"2021-07-26T15:46:22.793476+0000","last_active":"2021-07-26T15:46:22.795155+0000","last_peered":"2021-07-26T15:46:22.795155+0000","last_clean":"2021-07-26T15:46:22.795155+0000","last_became_active":"2021-07-26T15:46:22.792836+0000","last_became_peered":"2021-07-26T15:46:22.792836+0000","last_unstale":"2021-07-26T15:46:22.795155+0000","last_undegraded":"2021-07-26T15:46:22.795155+0000","last_fullsized":"2021-07-26T15:46:22.795155+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795199+0000","last_change":"2021-07-26T15:46:22.793496+0000","last_active":"2021-07-26T15:46:22.795199+0000","last_peered":"2021-07-26T15:46:22.795199+0000","last_clean":"2021-07-26T15:46:22.795199+0000","last_became_active":"2021-07-26T15:46:22.791897+0000","last_became_peered":"2021-07-26T15:46:22.791897+0000","last_unstale":"2021-07-26T15:46:22.795199+0000","last_undegraded":"2021-07-26T15:46:22.795199+0000","last_fullsized":"2021-07-26T15:46:22.795199+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795171+0000","last_change":"2021-07-26T15:46:22.793355+0000","last_active":"2021-07-26T15:46:22.795171+0000","last_peered":"2021-07-26T15:46:22.795171+0000","last_clean":"2021-07-26T15:46:22.795171+0000","last_became_active":"2021-07-26T15:46:22.792537+0000","last_became_peered":"2021-07-26T15:46:22.792537+0000","last_unstale":"2021-07-26T15:46:22.795171+0000","last_undegraded":"2021-07-26T15:46:22.795171+0000","last_fullsized":"2021-07-26T15:46:22.795171+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795165+0000","last_change":"2021-07-26T15:46:22.793495+0000","last_active":"2021-07-26T15:46:22.795165+0000","last_peered":"2021-07-26T15:46:22.795165+0000","last_clean":"2021-07-26T15:46:22.795165+0000","last_became_active":"2021-07-26T15:46:22.792774+0000","last_became_peered":"2021-07-26T15:46:22.792774+0000","last_unstale":"2021-07-26T15:46:22.795165+0000","last_undegraded":"2021-07-26T15:46:22.795165+0000","last_fullsized":"2021-07-26T15:46:22.795165+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.792092+0000","last_change":"2021-07-26T15:46:22.792092+0000","last_active":"2021-07-26T15:46:22.792092+0000","last_peered":"2021-07-26T15:46:22.792092+0000","last_clean":"2021-07-26T15:46:22.792092+0000","last_became_active":"2021-07-26T15:46:22.791436+0000","last_became_peered":"2021-07-26T15:46:22.791436+0000","last_unstale":"2021-07-26T15:46:22.792092+0000","last_undegraded":"2021-07-26T15:46:22.792092+0000","last_fullsized":"2021-07-26T15:46:22.792092+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795012+0000","last_change":"2021-07-26T15:46:22.792503+0000","last_active":"2021-07-26T15:46:22.795012+0000","last_peered":"2021-07-26T15:46:22.795012+0000","last_clean":"2021-07-26T15:46:22.795012+0000","last_became_active":"2021-07-26T15:46:22.792074+0000","last_became_peered":"2021-07-26T15:46:22.792074+0000","last_unstale":"2021-07-26T15:46:22.795012+0000","last_undegraded":"2021-07-26T15:46:22.795012+0000","last_fullsized":"2021-07-26T15:46:22.795012+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795236+0000","last_change":"2021-07-26T15:46:22.792687+0000","last_active":"2021-07-26T15:46:22.795236+0000","last_peered":"2021-07-26T15:46:22.795236+0000","last_clean":"2021-07-26T15:46:22.795236+0000","last_became_active":"2021-07-26T15:46:22.792141+0000","last_became_peered":"2021-07-26T15:46:22.792141+0000","last_unstale":"2021-07-26T15:46:22.795236+0000","last_undegraded":"2021-07-26T15:46:22.795236+0000","last_fullsized":"2021-07-26T15:46:22.795236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.795236+0000","last_change":"2021-07-26T15:46:22.792235+0000","last_active":"2021-07-26T15:46:22.795236+0000","last_peered":"2021-07-26T15:46:22.795236+0000","last_clean":"2021-07-26T15:46:22.795236+0000","last_became_active":"2021-07-26T15:46:22.791079+0000","last_became_peered":"2021-07-26T15:46:22.791079+0000","last_unstale":"2021-07-26T15:46:22.795236+0000","last_undegraded":"2021-07-26T15:46:22.795236+0000","last_fullsized":"2021-07-26T15:46:22.795236+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:21.768425+0000","last_clean_scrub_stamp":"2021-07-26T15:46:21.768425+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":15,"reported_epoch":13,"state":"active+clean","last_fresh":"2021-07-26T15:46:22.783383+0000","last_change":"2021-07-26T15:46:19.538361+0000","last_active":"2021-07-26T15:46:22.783383+0000","last_peered":"2021-07-26T15:46:22.783383+0000","last_clean":"2021-07-26T15:46:22.783383+0000","last_became_active":"2021-07-26T15:46:19.537056+0000","last_became_peered":"2021-07-26T15:46:19.537056+0000","last_unstale":"2021-07-26T15:46:22.783383+0000","last_undegraded":"2021-07-26T15:46:22.783383+0000","last_fullsized":"2021-07-26T15:46:22.783383+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-07-26T15:46:16.518189+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-07-26T15:46:16.518189+0000","last_clean_scrub_stamp":"2021-07-26T15:46:16.518189+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048696,"kb_used_data":112,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808904,"statfs":{"total":107374182400,"available":106300317696,"internally_reserved":1073741824,"allocated":114688,"data_stored":32280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58099999999999996}]}]},{"osd":2,"up_from":8,"seq":34359738372,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":104857600,"kb_used":1048704,"kb_used_data":120,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":103808896,"statfs":{"total":107374182400,"available":106300309504,"internally_reserved":1073741824,"allocated":122880,"data_stored":35760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]}]}} 2021-07-26T15:46:28.594 INFO:tasks.ceph.ceph_manager.c2:clean! 2021-07-26T15:46:28.595 INFO:tasks.ceph:Waiting until ceph cluster c2 is healthy... 2021-07-26T15:46:28.595 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy 2021-07-26T15:46:28.595 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster c2 health --format=json 2021-07-26T15:46:28.882 INFO:teuthology.orchestra.run.smithi087.stdout: 2021-07-26T15:46:28.895 INFO:teuthology.orchestra.run.smithi087.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-07-26T15:46:28.896 INFO:tasks.ceph.ceph_manager.c2:wait_until_healthy done 2021-07-26T15:46:28.896 INFO:teuthology.run_tasks:Running task parallel... 2021-07-26T15:46:28.908 INFO:teuthology.task.parallel:starting parallel... 2021-07-26T15:46:28.908 INFO:teuthology.task.parallel:In parallel, running task sequential... 2021-07-26T15:46:28.909 INFO:teuthology.task.sequential:In sequential, running task install.upgrade... 2021-07-26T15:46:28.910 INFO:teuthology.task.install:project ceph config {'c2.client.0': None, 'c2.client.1': None, 'c2.mgr.x': None, 'c2.mon.a': None, 'c2.osd.0': None, 'c2.osd.1': None, 'c2.osd.2': None} overrides {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'} 2021-07-26T15:46:28.910 WARNING:teuthology.task.install:remote ubuntu@smithi087.front.sepia.ceph.com came up twice (role c2.client.1) 2021-07-26T15:46:28.911 WARNING:teuthology.task.install:remote ubuntu@smithi087.front.sepia.ceph.com came up twice (role c2.mgr.x) 2021-07-26T15:46:28.911 WARNING:teuthology.task.install:remote ubuntu@smithi087.front.sepia.ceph.com came up twice (role c2.mon.a) 2021-07-26T15:46:28.911 WARNING:teuthology.task.install:remote ubuntu@smithi087.front.sepia.ceph.com came up twice (role c2.osd.0) 2021-07-26T15:46:28.912 WARNING:teuthology.task.install:remote ubuntu@smithi087.front.sepia.ceph.com came up twice (role c2.osd.1) 2021-07-26T15:46:28.912 WARNING:teuthology.task.install:remote ubuntu@smithi087.front.sepia.ceph.com came up twice (role c2.osd.2) 2021-07-26T15:46:28.912 INFO:teuthology.task.install:remote ubuntu@smithi087.front.sepia.ceph.com config {'branch': 'octopus', 'sha1': 'bccf07c244ef1754a7e8d345570b6a04f2ee5a7e'} 2021-07-26T15:46:28.913 INFO:teuthology.task.install:extra packages: [] 2021-07-26T15:46:28.913 DEBUG:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2021-07-26T15:46:28.961 INFO:teuthology.orchestra.run.smithi087.stdout:Ubuntu 2021-07-26T15:46:28.969 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:46:28.988 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-07-26T15:46:28.988 INFO:teuthology.task.install:Upgrading ceph deb packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse 2021-07-26T15:46:28.989 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-query -W -f '${Version}' ceph-common 2021-07-26T15:46:29.014 INFO:teuthology.orchestra.run.smithi087.stdout:15.2.13-213-g0f589fd5-1focal 2021-07-26T15:46:29.014 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:46:29.015 DEBUG:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2021-07-26T15:46:29.112 INFO:teuthology.orchestra.run.smithi087.stdout:Ubuntu 2021-07-26T15:46:29.114 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:46:29.118 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:46:29.119 INFO:teuthology.packaging:ref: None 2021-07-26T15:46:29.119 INFO:teuthology.packaging:tag: None 2021-07-26T15:46:29.119 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:46:29.120 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:46:29.120 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:46:29.364 INFO:teuthology.task.install:Ceph deb upgrade from 15.2.13-213-g0f589fd5-1focal to 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:46:29.365 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-key list | grep Ceph 2021-07-26T15:46:29.471 INFO:teuthology.orchestra.run.smithi087.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-07-26T15:46:29.540 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-07-26T15:46:29.541 INFO:teuthology.orchestra.run.smithi087.stdout:uid [ unknown] Ceph.com (release key) 2021-07-26T15:46:29.541 DEBUG:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2021-07-26T15:46:29.601 INFO:teuthology.orchestra.run.smithi087.stdout:Ubuntu 2021-07-26T15:46:29.613 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:46:29.614 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:46:29.614 INFO:teuthology.packaging:ref: None 2021-07-26T15:46:29.614 INFO:teuthology.packaging:tag: None 2021-07-26T15:46:29.615 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:46:29.615 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:46:29.616 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:46:29.849 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default/ 2021-07-26T15:46:29.849 INFO:teuthology.task.install.deb:Package version is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:46:29.981 DEBUG:teuthology.orchestra.run.smithi087:> set -ex 2021-07-26T15:46:29.981 DEBUG:teuthology.orchestra.run.smithi087:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-07-26T15:46:30.006 DEBUG:teuthology.orchestra.run.smithi087:> sudo apt-get update 2021-07-26T15:46:30.214 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-07-26T15:46:30.257 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal InRelease 2021-07-26T15:46:30.282 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:3 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release 2021-07-26T15:46:30.305 INFO:teuthology.orchestra.run.smithi087.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/octopus/0f589fd5a12a7ee844fceabe951140b18faf866b/ubuntu/focal/flavors/default focal Release.gpg 2021-07-26T15:46:30.335 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-07-26T15:46:30.416 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-07-26T15:46:30.497 INFO:teuthology.orchestra.run.smithi087.stdout:Hit:7 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-07-26T15:46:31.636 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-07-26T15:46:31.656 DEBUG:teuthology.orchestra.run.smithi087:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=15.2.13-213-g0f589fd5-1focal cephadm=15.2.13-213-g0f589fd5-1focal ceph-mds=15.2.13-213-g0f589fd5-1focal ceph-mgr=15.2.13-213-g0f589fd5-1focal ceph-common=15.2.13-213-g0f589fd5-1focal ceph-fuse=15.2.13-213-g0f589fd5-1focal ceph-test=15.2.13-213-g0f589fd5-1focal radosgw=15.2.13-213-g0f589fd5-1focal python3-rados=15.2.13-213-g0f589fd5-1focal python3-rgw=15.2.13-213-g0f589fd5-1focal python3-cephfs=15.2.13-213-g0f589fd5-1focal python3-rbd=15.2.13-213-g0f589fd5-1focal libcephfs2=15.2.13-213-g0f589fd5-1focal libcephfs-dev=15.2.13-213-g0f589fd5-1focal librados2=15.2.13-213-g0f589fd5-1focal librbd1=15.2.13-213-g0f589fd5-1focal rbd-fuse=15.2.13-213-g0f589fd5-1focal 2021-07-26T15:46:31.720 INFO:teuthology.orchestra.run.smithi087.stdout:Reading package lists... 2021-07-26T15:46:31.893 INFO:teuthology.orchestra.run.smithi087.stdout:Building dependency tree... 2021-07-26T15:46:31.893 INFO:teuthology.orchestra.run.smithi087.stdout:Reading state information... 2021-07-26T15:46:32.019 INFO:teuthology.orchestra.run.smithi087.stdout:ceph is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.020 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-common is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.020 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-fuse is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.020 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-mds is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.020 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-mgr is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.020 INFO:teuthology.orchestra.run.smithi087.stdout:ceph-test is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.021 INFO:teuthology.orchestra.run.smithi087.stdout:cephadm is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.021 INFO:teuthology.orchestra.run.smithi087.stdout:libcephfs-dev is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.021 INFO:teuthology.orchestra.run.smithi087.stdout:libcephfs2 is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.021 INFO:teuthology.orchestra.run.smithi087.stdout:librados2 is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.022 INFO:teuthology.orchestra.run.smithi087.stdout:librados2 set to manually installed. 2021-07-26T15:46:32.022 INFO:teuthology.orchestra.run.smithi087.stdout:librbd1 is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.022 INFO:teuthology.orchestra.run.smithi087.stdout:librbd1 set to manually installed. 2021-07-26T15:46:32.022 INFO:teuthology.orchestra.run.smithi087.stdout:python3-cephfs is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.023 INFO:teuthology.orchestra.run.smithi087.stdout:python3-rados is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.023 INFO:teuthology.orchestra.run.smithi087.stdout:python3-rbd is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.023 INFO:teuthology.orchestra.run.smithi087.stdout:python3-rgw is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.024 INFO:teuthology.orchestra.run.smithi087.stdout:radosgw is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.024 INFO:teuthology.orchestra.run.smithi087.stdout:rbd-fuse is already the newest version (15.2.13-213-g0f589fd5-1focal). 2021-07-26T15:46:32.024 INFO:teuthology.orchestra.run.smithi087.stdout:The following packages were automatically installed and are no longer required: 2021-07-26T15:46:32.024 INFO:teuthology.orchestra.run.smithi087.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2021-07-26T15:46:32.025 INFO:teuthology.orchestra.run.smithi087.stdout:Use 'sudo apt autoremove' to remove them. 2021-07-26T15:46:32.055 INFO:teuthology.orchestra.run.smithi087.stdout:0 upgraded, 0 newly installed, 0 to remove and 143 not upgraded. 2021-07-26T15:46:32.055 INFO:teuthology.orchestra.run.smithi087.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-07-26T15:46:32.057 DEBUG:teuthology.orchestra.run.smithi087:> sudo lsb_release -is 2021-07-26T15:46:32.104 INFO:teuthology.orchestra.run.smithi087.stdout:Ubuntu 2021-07-26T15:46:32.109 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-07-26T15:46:32.109 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-07-26T15:46:32.110 INFO:teuthology.packaging:ref: None 2021-07-26T15:46:32.110 INFO:teuthology.packaging:tag: None 2021-07-26T15:46:32.110 INFO:teuthology.packaging:branch: octopus 2021-07-26T15:46:32.111 INFO:teuthology.packaging:sha1: bccf07c244ef1754a7e8d345570b6a04f2ee5a7e 2021-07-26T15:46:32.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=octopus 2021-07-26T15:46:32.349 DEBUG:teuthology.orchestra.run.smithi087:> dpkg-query -W -f '${Version}' ceph 2021-07-26T15:46:32.372 INFO:teuthology.orchestra.run.smithi087.stdout:15.2.13-213-g0f589fd5-1focal 2021-07-26T15:46:32.373 INFO:teuthology.packaging:The installed version of ceph is 15.2.13-213-g0f589fd5-1focal 2021-07-26T15:46:32.373 INFO:teuthology.task.install:The correct ceph version 15.2.13-213-g0f589fd5-1focal is installed. 2021-07-26T15:46:32.373 DEBUG:teuthology.parallel:result is None 2021-07-26T15:46:32.374 INFO:teuthology.run_tasks:Running task rgw... 2021-07-26T15:46:32.394 DEBUG:tasks.rgw:config is {'c1.client.0': {'port': 8000}, 'c2.client.0': {'port': 8000}, 'c2.client.1': {'port': 8001}} 2021-07-26T15:46:32.395 DEBUG:tasks.rgw:client list is dict_keys(['c1.client.0', 'c2.client.0', 'c2.client.1']) 2021-07-26T15:46:32.395 INFO:tasks.rgw:Creating data pools 2021-07-26T15:46:32.396 DEBUG:tasks.rgw:Obtaining remote for client c1.client.0 2021-07-26T15:46:32.397 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c1 2021-07-26T15:46:33.536 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'default.rgw.buckets.data' created 2021-07-26T15:46:33.549 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c1 2021-07-26T15:46:34.558 INFO:teuthology.orchestra.run.smithi067.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-07-26T15:46:34.570 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c1 2021-07-26T15:46:35.560 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'default.rgw.buckets.index' created 2021-07-26T15:46:35.574 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c1 2021-07-26T15:46:36.573 INFO:teuthology.orchestra.run.smithi067.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-07-26T15:46:36.592 DEBUG:tasks.rgw:Obtaining remote for client c2.client.0 2021-07-26T15:46:36.593 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:46:37.498 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'default.rgw.buckets.data' created 2021-07-26T15:46:37.510 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-07-26T15:46:38.515 INFO:teuthology.orchestra.run.smithi087.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-07-26T15:46:38.527 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-07-26T15:46:39.508 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'default.rgw.buckets.index' created 2021-07-26T15:46:39.518 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-07-26T15:46:40.521 INFO:teuthology.orchestra.run.smithi087.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-07-26T15:46:40.538 DEBUG:tasks.rgw:Obtaining remote for client c2.client.1 2021-07-26T15:46:40.538 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:46:40.775 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'default.rgw.buckets.data' already exists 2021-07-26T15:46:40.783 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster c2 2021-07-26T15:46:41.512 INFO:teuthology.orchestra.run.smithi087.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2021-07-26T15:46:41.523 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster c2 2021-07-26T15:46:41.767 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'default.rgw.buckets.index' already exists 2021-07-26T15:46:41.776 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster c2 2021-07-26T15:46:42.521 INFO:teuthology.orchestra.run.smithi087.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2021-07-26T15:46:42.531 DEBUG:tasks.rgw:Pools created 2021-07-26T15:46:42.531 INFO:tasks.rgw:Configuring compression type = random 2021-07-26T15:46:42.532 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'list'] 2021-07-26T15:46:42.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'list'] 2021-07-26T15:46:42.533 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user list 2021-07-26T15:46:42.571 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:42.571 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:42.581 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:42.580+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.459 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.452+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.460 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.452+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.460 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.456+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.460 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.456+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.460 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.456+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.461 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.456+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.461 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.456+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.476 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.477 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.487 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.488 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.488 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.490 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.491 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 10 cannot find current period zonegroup using local zonegroup 2021-07-26T15:46:44.491 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.503 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.503 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.503 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.503 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 10 Creating default zonegroup 2021-07-26T15:46:44.504 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 20 get_system_obj_state: rctx=0x7ffcfd8c5660 obj=:.pools.avail state=0x55dac865d820 s->prefetch_data=0 2021-07-26T15:46:44.504 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.472+0000 7f5ce8007980 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-07-26T15:46:44.509 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.484+0000 7f5ce8007980 10 WARNING: store->list_zones() returned r=-2 2021-07-26T15:46:44.510 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.484+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.510 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.488+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.510 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.492+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.510 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.492+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.511 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.492+0000 7f5ce8007980 10 could not read realm id: (2) No such file or directory 2021-07-26T15:46:44.511 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.492+0000 7f5ce8007980 10 WARNING: failed to set zone as default, r=-22 2021-07-26T15:46:44.511 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.492+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.511 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.492+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.511 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.496+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.512 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.496+0000 7f5ce8007980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:46:44.512 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.496+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.512 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:46:44.512 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 20 zonegroup default 2021-07-26T15:46:44.512 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.513 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:44.513 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 10 Cannot find current period zone using local zone 2021-07-26T15:46:44.513 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 10 Using default name default 2021-07-26T15:46:44.513 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.514 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:46:44.514 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:44.514 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:46:44.531 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 20 zone default found 2021-07-26T15:46:44.532 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:44.500+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:46.467 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:46.464+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:46.467 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:46.464+0000 7f5ce8007980 20 rados->read ofs=0 len=0 2021-07-26T15:46:46.468 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:46.464+0000 7f5ce8007980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:46.464+0000 7f5ce8007980 20 started sync module instance, tier type = 2021-07-26T15:46:46.469 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:46.464+0000 7f5ce8007980 20 started zone id=6e3ca1b3-cc05-48d3-8082-cdf5edc5bde8 (name=default) with tier type = 2021-07-26T15:46:48.532 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.528+0000 7f5ce8007980 20 add_watcher() i=0 2021-07-26T15:46:48.532 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.528+0000 7f5ce8007980 20 add_watcher() i=1 2021-07-26T15:46:48.532 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.528+0000 7f5ce8007980 20 add_watcher() i=2 2021-07-26T15:46:48.532 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.528+0000 7f5ce8007980 20 add_watcher() i=3 2021-07-26T15:46:48.533 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.528+0000 7f5ce8007980 20 add_watcher() i=4 2021-07-26T15:46:48.533 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.528+0000 7f5ce8007980 20 add_watcher() i=5 2021-07-26T15:46:48.533 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.528+0000 7f5ce8007980 20 add_watcher() i=6 2021-07-26T15:46:48.534 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.532+0000 7f5ce8007980 20 add_watcher() i=7 2021-07-26T15:46:48.534 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.532+0000 7f5ce8007980 2 all 8 watchers are set, enabling cache 2021-07-26T15:46:48.534 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.532+0000 7f5ce8007980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:46:48.535 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.532+0000 7f5ce8007980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:46:48.535 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:48.532+0000 7f5cb6fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:46:52.510 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.508+0000 7f5ce8007980 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2021-07-26T15:46:52.609 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.608+0000 7f5c257fa700 20 reqs_thread_entry: start 2021-07-26T15:46:52.609 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.608+0000 7f5ce8007980 20 init_complete bucket index max shards: 11 2021-07-26T15:46:52.609 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.608+0000 7f5c16ffd700 20 reqs_thread_entry: start 2021-07-26T15:46:52.610 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.608+0000 7f5c157fa700 20 reqs_thread_entry: start 2021-07-26T15:46:52.635 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.628+0000 7f5cb6fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:46:52.635 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.632+0000 7f5ce8007980 20 remove_watcher() i=0 2021-07-26T15:46:52.636 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.632+0000 7f5ce8007980 2 removed watcher, disabling cache 2021-07-26T15:46:52.636 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.636+0000 7f5ce8007980 20 remove_watcher() i=1 2021-07-26T15:46:52.639 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.636+0000 7f5ce8007980 20 remove_watcher() i=2 2021-07-26T15:46:52.642 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.640+0000 7f5ce8007980 20 remove_watcher() i=3 2021-07-26T15:46:52.644 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.644+0000 7f5ce8007980 20 remove_watcher() i=4 2021-07-26T15:46:52.647 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.644+0000 7f5ce8007980 20 remove_watcher() i=5 2021-07-26T15:46:52.650 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.648+0000 7f5ce8007980 20 remove_watcher() i=6 2021-07-26T15:46:52.652 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.652+0000 7f5ce8007980 20 remove_watcher() i=7 2021-07-26T15:46:52.662 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2021-07-26T15:46:52.662 DEBUG:tasks.util.rgw: json result: [] 2021-07-26T15:46:52.663 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:46:52.663 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:46:52.664 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-07-26T15:46:52.703 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:52.704 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:52.715 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.712+0000 7f70b5cbb980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:46:52.715 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.712+0000 7f70b5cbb980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:46:52.722 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.720+0000 7f6ffbfff700 20 reqs_thread_entry: start 2021-07-26T15:46:52.723 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.720+0000 7f70b5cbb980 20 rados->read ofs=0 len=0 2021-07-26T15:46:52.724 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.724+0000 7f70b5cbb980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:46:52.724 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.724+0000 7f70b5cbb980 20 rados->read ofs=0 len=0 2021-07-26T15:46:52.725 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.724+0000 7f70b5cbb980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:46:52.725 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.724+0000 7f70b5cbb980 20 rados->read ofs=0 len=0 2021-07-26T15:46:52.726 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.724+0000 7f70b5cbb980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:52.726 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.724+0000 7f70b5cbb980 20 rados->read ofs=0 len=0 2021-07-26T15:46:52.727 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.724+0000 7f70b5cbb980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:46:52.727 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.724+0000 7f70b5cbb980 20 rados->read ofs=0 len=0 2021-07-26T15:46:52.727 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:46:52.724+0000 7f70b5cbb980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:46:52.739 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"6e3ca1b3-cc05-48d3-8082-cdf5edc5bde8","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-07-26T15:46:52.739 DEBUG:tasks.util.rgw: json result: {'id': '6e3ca1b3-cc05-48d3-8082-cdf5edc5bde8', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-07-26T15:46:52.740 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['user', 'list'] 2021-07-26T15:46:52.740 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'user', 'list'] 2021-07-26T15:46:52.740 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 user list 2021-07-26T15:46:52.775 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:46:52.776 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:46:52.788 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:52.782+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.568 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.566+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.568 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.566+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.569 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.566+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.569 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.566+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.570 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.566+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.570 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.566+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.571 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.566+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.585 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.578+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.585 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.578+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.585 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.578+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.586 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.578+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.586 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.578+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.586 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.578+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.586 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.578+0000 7f0e7cf15980 10 cannot find current period zonegroup using local zonegroup 2021-07-26T15:46:54.587 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.582+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.587 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.582+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.587 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.582+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.587 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.582+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.587 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.582+0000 7f0e7cf15980 10 Creating default zonegroup 2021-07-26T15:46:54.588 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.582+0000 7f0e7cf15980 20 get_system_obj_state: rctx=0x7fff2dca66d0 obj=:.pools.avail state=0x561efebf2820 s->prefetch_data=0 2021-07-26T15:46:54.588 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.582+0000 7f0e7cf15980 10 couldn't find old data placement pools config, setting up new ones for the zone 2021-07-26T15:46:54.600 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.594+0000 7f0e7cf15980 10 WARNING: store->list_zones() returned r=-2 2021-07-26T15:46:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.594+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.601 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.594+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.606 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.602+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.606 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.602+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.607 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.602+0000 7f0e7cf15980 10 could not read realm id: (2) No such file or directory 2021-07-26T15:46:54.608 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.602+0000 7f0e7cf15980 10 WARNING: failed to set zone as default, r=-22 2021-07-26T15:46:54.608 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.602+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.609 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.602+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.612 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.613 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:46:54.613 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.614 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:46:54.614 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 20 zonegroup default 2021-07-26T15:46:54.615 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.616 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:54.616 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 10 Cannot find current period zone using local zone 2021-07-26T15:46:54.616 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 10 Using default name default 2021-07-26T15:46:54.617 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.617 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:46:54.617 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.610+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:54.618 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.614+0000 7f0e7cf15980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:46:54.618 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.614+0000 7f0e7cf15980 20 zone default found 2021-07-26T15:46:54.618 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:54.614+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:56.576 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:56.574+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:56.577 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:56.574+0000 7f0e7cf15980 20 rados->read ofs=0 len=0 2021-07-26T15:46:56.577 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:56.574+0000 7f0e7cf15980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:46:56.578 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:56.574+0000 7f0e7cf15980 20 started sync module instance, tier type = 2021-07-26T15:46:56.578 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:56.574+0000 7f0e7cf15980 20 started zone id=2c81af9a-ac85-4827-bf70-e5e8032dd1e7 (name=default) with tier type = 2021-07-26T15:46:58.620 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.614+0000 7f0e7cf15980 20 add_watcher() i=0 2021-07-26T15:46:58.620 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.614+0000 7f0e7cf15980 20 add_watcher() i=1 2021-07-26T15:46:58.620 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.614+0000 7f0e7cf15980 20 add_watcher() i=2 2021-07-26T15:46:58.621 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.614+0000 7f0e7cf15980 20 add_watcher() i=3 2021-07-26T15:46:58.621 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.614+0000 7f0e7cf15980 20 add_watcher() i=4 2021-07-26T15:46:58.621 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.614+0000 7f0e7cf15980 20 add_watcher() i=5 2021-07-26T15:46:58.621 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.614+0000 7f0e7cf15980 20 add_watcher() i=6 2021-07-26T15:46:58.623 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.618+0000 7f0e7cf15980 20 add_watcher() i=7 2021-07-26T15:46:58.623 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.618+0000 7f0e7cf15980 2 all 8 watchers are set, enabling cache 2021-07-26T15:46:58.623 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.618+0000 7f0e7cf15980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:46:58.624 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.618+0000 7f0e7cf15980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:46:58.624 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:46:58.618+0000 7f0e4bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:47:02.593 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.590+0000 7f0e7cf15980 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2021-07-26T15:47:02.701 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.694+0000 7f0dba7fc700 20 reqs_thread_entry: start 2021-07-26T15:47:02.701 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.694+0000 7f0da7fff700 20 reqs_thread_entry: start 2021-07-26T15:47:02.702 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.694+0000 7f0e7cf15980 20 init_complete bucket index max shards: 11 2021-07-26T15:47:02.702 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.694+0000 7f0da67fc700 20 reqs_thread_entry: start 2021-07-26T15:47:02.725 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.722+0000 7f0e4bfdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:47:02.729 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.722+0000 7f0e7cf15980 20 remove_watcher() i=0 2021-07-26T15:47:02.730 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.722+0000 7f0e7cf15980 2 removed watcher, disabling cache 2021-07-26T15:47:02.731 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.726+0000 7f0e7cf15980 20 remove_watcher() i=1 2021-07-26T15:47:02.736 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.730+0000 7f0e7cf15980 20 remove_watcher() i=2 2021-07-26T15:47:02.737 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.730+0000 7f0e7cf15980 20 remove_watcher() i=3 2021-07-26T15:47:02.738 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.734+0000 7f0e7cf15980 20 remove_watcher() i=4 2021-07-26T15:47:02.740 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.738+0000 7f0e7cf15980 20 remove_watcher() i=5 2021-07-26T15:47:02.742 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.738+0000 7f0e7cf15980 20 remove_watcher() i=6 2021-07-26T15:47:02.745 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.742+0000 7f0e7cf15980 20 remove_watcher() i=7 2021-07-26T15:47:02.754 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:47:02.755 DEBUG:tasks.util.rgw: json result: [] 2021-07-26T15:47:02.755 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:47:02.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:47:02.756 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-07-26T15:47:02.843 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:02.844 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:02.855 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.850+0000 7f074abaf980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:47:02.856 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.850+0000 7f074abaf980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:47:02.864 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.858+0000 7f074abaf980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.864 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.858+0000 7f06b0ff9700 20 reqs_thread_entry: start 2021-07-26T15:47:02.864 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.858+0000 7f074abaf980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:47:02.865 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.858+0000 7f074abaf980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.865 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.858+0000 7f074abaf980 20 rados_obj.operate() r=0 bl.length=839 2021-07-26T15:47:02.865 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.858+0000 7f074abaf980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.858+0000 7f074abaf980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:47:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.858+0000 7f074abaf980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.862+0000 7f074abaf980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:47:02.866 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.862+0000 7f074abaf980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.867 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.862+0000 7f074abaf980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:47:02.874 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"2c81af9a-ac85-4827-bf70-e5e8032dd1e7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-07-26T15:47:02.876 DEBUG:tasks.util.rgw: json result: {'id': '2c81af9a-ac85-4827-bf70-e5e8032dd1e7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-07-26T15:47:02.876 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['user', 'list'] 2021-07-26T15:47:02.876 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'user', 'list'] 2021-07-26T15:47:02.877 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 user list 2021-07-26T15:47:02.911 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:02.912 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:02.924 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.922+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.927 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.922+0000 7f4d5f3ec980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:47:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.922+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.926+0000 7f4d5f3ec980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:47:02.928 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.926+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.929 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.926+0000 7f4d5f3ec980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:47:02.929 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.926+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.929 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.926+0000 7f4d5f3ec980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:47:02.949 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.946+0000 7f4d5f3ec980 20 RGWRados::pool_iterate: got zonegroup_info.cd64ecb6-dc15-4238-afe1-b843e091efd2 2021-07-26T15:47:02.950 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.946+0000 7f4d5f3ec980 20 RGWRados::pool_iterate: got zone_info.2c81af9a-ac85-4827-bf70-e5e8032dd1e7 2021-07-26T15:47:02.950 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.946+0000 7f4d5f3ec980 20 RGWRados::pool_iterate: got zone_names.default 2021-07-26T15:47:02.950 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.946+0000 7f4d5f3ec980 20 RGWRados::pool_iterate: got zonegroups_names.default 2021-07-26T15:47:02.950 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.946+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.952 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.946+0000 7f4d5f3ec980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:47:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.946+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.946+0000 7f4d5f3ec980 20 rados_obj.operate() r=0 bl.length=855 2021-07-26T15:47:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.946+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.953 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.946+0000 7f4d5f3ec980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:47:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.946+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:47:02.954 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:47:02.956 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 10 cannot find current period zonegroup using local zonegroup 2021-07-26T15:47:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:47:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:47:02.957 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:47:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 zonegroup default 2021-07-26T15:47:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.958 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:47:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 10 Cannot find current period zone using local zone 2021-07-26T15:47:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.950+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:47:02.959 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.961 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:47:02.961 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.961 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 rados_obj.operate() r=0 bl.length=855 2021-07-26T15:47:02.962 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 zone default found 2021-07-26T15:47:02.962 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.962 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:47:02.962 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 rados->read ofs=0 len=0 2021-07-26T15:47:02.962 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:47:02.963 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 started sync module instance, tier type = 2021-07-26T15:47:02.963 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.954+0000 7f4d5f3ec980 20 started zone id=2c81af9a-ac85-4827-bf70-e5e8032dd1e7 (name=default) with tier type = 2021-07-26T15:47:02.992 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.986+0000 7f4d5f3ec980 20 add_watcher() i=0 2021-07-26T15:47:02.992 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.986+0000 7f4d5f3ec980 20 add_watcher() i=1 2021-07-26T15:47:02.992 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.986+0000 7f4d5f3ec980 20 add_watcher() i=2 2021-07-26T15:47:02.993 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.986+0000 7f4d5f3ec980 20 add_watcher() i=3 2021-07-26T15:47:02.993 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.986+0000 7f4d5f3ec980 20 add_watcher() i=4 2021-07-26T15:47:02.993 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.986+0000 7f4d5f3ec980 20 add_watcher() i=5 2021-07-26T15:47:02.993 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.986+0000 7f4d5f3ec980 20 add_watcher() i=6 2021-07-26T15:47:02.994 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.990+0000 7f4d5f3ec980 20 add_watcher() i=7 2021-07-26T15:47:02.995 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.990+0000 7f4d5f3ec980 2 all 8 watchers are set, enabling cache 2021-07-26T15:47:02.995 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.990+0000 7f4d5f3ec980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:47:02.995 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.990+0000 7f4d5f3ec980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:47:02.996 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:02.990+0000 7f4d2dfe3700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:47:03.080 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.074+0000 7f4c9ffff700 20 reqs_thread_entry: start 2021-07-26T15:47:03.080 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.078+0000 7f4d5f3ec980 20 init_complete bucket index max shards: 11 2021-07-26T15:47:03.081 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.078+0000 7f4c9dffb700 20 reqs_thread_entry: start 2021-07-26T15:47:03.081 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.078+0000 7f4c8bfff700 20 reqs_thread_entry: start 2021-07-26T15:47:03.108 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.102+0000 7f4d2dfe3700 2 RGWDataChangesLog::ChangesRenewThread: start 2021-07-26T15:47:03.109 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.102+0000 7f4d5f3ec980 20 remove_watcher() i=0 2021-07-26T15:47:03.109 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.102+0000 7f4d5f3ec980 2 removed watcher, disabling cache 2021-07-26T15:47:03.111 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.106+0000 7f4d5f3ec980 20 remove_watcher() i=1 2021-07-26T15:47:03.113 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.110+0000 7f4d5f3ec980 20 remove_watcher() i=2 2021-07-26T15:47:03.116 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.114+0000 7f4d5f3ec980 20 remove_watcher() i=3 2021-07-26T15:47:03.118 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.114+0000 7f4d5f3ec980 20 remove_watcher() i=4 2021-07-26T15:47:03.121 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.118+0000 7f4d5f3ec980 20 remove_watcher() i=5 2021-07-26T15:47:03.124 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.118+0000 7f4d5f3ec980 20 remove_watcher() i=6 2021-07-26T15:47:03.125 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.122+0000 7f4d5f3ec980 20 remove_watcher() i=7 2021-07-26T15:47:03.134 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:47:03.135 DEBUG:tasks.util.rgw: json result: [] 2021-07-26T15:47:03.135 INFO:tasks.util.rgw:rgwadmin: c2.client.1 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:47:03.136 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.1', '--cluster', 'c2', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2021-07-26T15:47:03.136 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.1 --cluster c2 zone placement modify --rgw-zone default --placement-id default-placement --compression random 2021-07-26T15:47:03.215 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:03.215 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:03.227 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.222+0000 7f97d5f9d980 20 check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2021-07-26T15:47:03.227 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.222+0000 7f97d5f9d980 20 check_secure_mon_conn(): mode 1 is insecure 2021-07-26T15:47:03.236 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.230+0000 7f97d5f9d980 20 rados->read ofs=0 len=0 2021-07-26T15:47:03.236 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.230+0000 7f9717fff700 20 reqs_thread_entry: start 2021-07-26T15:47:03.236 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.230+0000 7f97d5f9d980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:47:03.236 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.230+0000 7f97d5f9d980 20 rados->read ofs=0 len=0 2021-07-26T15:47:03.237 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.234+0000 7f97d5f9d980 20 rados_obj.operate() r=0 bl.length=855 2021-07-26T15:47:03.237 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.234+0000 7f97d5f9d980 20 rados->read ofs=0 len=0 2021-07-26T15:47:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.234+0000 7f97d5f9d980 20 rados_obj.operate() r=-2 bl.length=0 2021-07-26T15:47:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.234+0000 7f97d5f9d980 20 rados->read ofs=0 len=0 2021-07-26T15:47:03.238 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.234+0000 7f97d5f9d980 20 rados_obj.operate() r=0 bl.length=46 2021-07-26T15:47:03.239 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.234+0000 7f97d5f9d980 20 rados->read ofs=0 len=0 2021-07-26T15:47:03.239 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:03.234+0000 7f97d5f9d980 20 rados_obj.operate() r=0 bl.length=358 2021-07-26T15:47:03.247 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"2c81af9a-ac85-4827-bf70-e5e8032dd1e7","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-07-26T15:47:03.247 DEBUG:tasks.util.rgw: json result: {'id': '2c81af9a-ac85-4827-bf70-e5e8032dd1e7', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0}}], 'realm_id': ''} 2021-07-26T15:47:03.247 INFO:tasks.rgw:Starting rgw... 2021-07-26T15:47:03.248 INFO:tasks.rgw:rgw c1.client.0 config is {'port': 8000} 2021-07-26T15:47:03.248 INFO:tasks.rgw:Using beast as radosgw frontend 2021-07-26T15:47:03.249 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-07-26T15:47:03.249 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-07-26T15:47:03.252 INFO:tasks.rgw.c1.client.0:Started 2021-07-26T15:47:03.252 INFO:tasks.rgw:rgw c2.client.0 config is {'port': 8000} 2021-07-26T15:47:03.253 INFO:tasks.rgw:Using beast as radosgw frontend 2021-07-26T15:47:03.255 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-07-26T15:47:03.256 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-07-26T15:47:03.259 INFO:tasks.rgw.c2.client.0:Started 2021-07-26T15:47:03.260 INFO:tasks.rgw:rgw c2.client.1 config is {'port': 8001} 2021-07-26T15:47:03.260 INFO:tasks.rgw:Using beast as radosgw frontend 2021-07-26T15:47:03.260 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-07-26T15:47:03.261 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-07-26T15:47:03.264 INFO:tasks.rgw.c2.client.1:Started 2021-07-26T15:47:03.265 INFO:tasks.rgw:Polling c1.client.0 until it starts accepting connections on http://smithi067.front.sepia.ceph.com:8000/ 2021-07-26T15:47:03.265 DEBUG:teuthology.orchestra.run.smithi067:> curl http://smithi067.front.sepia.ceph.com:8000/ 2021-07-26T15:47:03.293 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:47:03.293 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:47:03.294 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:47:03.294 INFO:teuthology.orchestra.run.smithi067.stderr:curl: (7) Failed to connect to smithi067.front.sepia.ceph.com port 8000: Connection refused 2021-07-26T15:47:03.294 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:47:04.296 DEBUG:teuthology.orchestra.run.smithi067:> curl http://smithi067.front.sepia.ceph.com:8000/ 2021-07-26T15:47:04.312 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:47:04.313 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:47:04.314 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 104k 0 --:--:-- --:--:-- --:--:-- 104k 2021-07-26T15:47:04.316 INFO:teuthology.orchestra.run.smithi067.stdout:anonymous 2021-07-26T15:47:04.316 INFO:tasks.rgw:Polling c2.client.0 until it starts accepting connections on http://smithi087.front.sepia.ceph.com:8000/ 2021-07-26T15:47:04.317 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:8000/ 2021-07-26T15:47:04.343 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:47:04.343 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:47:04.345 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2021-07-26T15:47:04.345 INFO:teuthology.orchestra.run.smithi087.stdout:anonymous 2021-07-26T15:47:04.346 INFO:tasks.rgw:Polling c2.client.1 until it starts accepting connections on http://smithi087.front.sepia.ceph.com:8001/ 2021-07-26T15:47:04.346 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:8001/ 2021-07-26T15:47:04.400 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:47:04.400 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:47:04.401 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2021-07-26T15:47:04.402 INFO:teuthology.orchestra.run.smithi087.stdout:anonymous 2021-07-26T15:47:04.403 INFO:teuthology.run_tasks:Running task rgw-multisite... 2021-07-26T15:47:04.563 INFO:tasks.rgw_multisite:creating realm.. 2021-07-26T15:47:04.563 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:04.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'realm', 'create', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:04.564 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 realm create --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:04.603 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:04.604 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:04.653 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"f77102bb-4347-429e-a853-57b537d7aec4","name":"test-realm","current_period":"f58d99ee-7dd4-4d39-856a-a1db9f5e041b","epoch":1} 2021-07-26T15:47:04.654 INFO:tasks.rgw_multisite:creating master zonegroup.. 2021-07-26T15:47:04.655 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:04.655 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'set', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:04.656 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup set --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:04.731 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:04.732 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:04.755 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:47:04.752+0000 7f26f42ad980 -1 old format 2021-07-26T15:47:04.772 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}} 2021-07-26T15:47:04.772 INFO:tasks.rgw_multisite:creating master zone.. 2021-07-26T15:47:04.773 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--endpoints', 'http://smithi067.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:04.774 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--master', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--endpoints', 'http://smithi067.front.sepia.ceph.com:8000', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:04.774 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --master --access-key U7VF01BMRTS2Z3FS --secret A8MVHLS39VJAUzl4NGxU8neu1LhIglID --endpoints http://smithi067.front.sepia.ceph.com:8000 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:04.820 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:04.820 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:04.893 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4"} 2021-07-26T15:47:04.894 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool create test-zone1.rgw.buckets.data 64 64 --cluster c1 2021-07-26T15:47:05.562 INFO:teuthology.orchestra.run.smithi067.stderr:pool 'test-zone1.rgw.buckets.data' created 2021-07-26T15:47:05.583 DEBUG:teuthology.orchestra.run.smithi067:> sudo ceph osd pool application enable test-zone1.rgw.buckets.data rgw --cluster c1 2021-07-26T15:47:06.587 INFO:teuthology.orchestra.run.smithi067.stderr:enabled application 'rgw' on pool 'test-zone1.rgw.buckets.data' 2021-07-26T15:47:06.605 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:06.606 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'placement', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:06.607 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone placement --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:06.641 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:06.642 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:06.671 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-07-26T15:47:06.673 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:06.673 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:06.674 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:06.754 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:06.755 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:14.863 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","epoch":1,"predecessor_uuid":"f58d99ee-7dd4-4d39-856a-a1db9f5e041b","sync_status":[],"period_map":{"id":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"false","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":2} 2021-07-26T15:47:14.864 DEBUG:tasks.rgw.c1.client.0:waiting for process to exit 2021-07-26T15:47:14.864 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:47:14.865 INFO:tasks.rgw.c1.client.0.smithi067.stdout:2021-07-26T15:47:14.864+0000 7f7e83fff700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground (PID: 15566) UID: 0 2021-07-26T15:47:14.865 INFO:tasks.rgw.c1.client.0.smithi067.stdout:2021-07-26T15:47:14.864+0000 7f7e9443d980 -1 shutting down 2021-07-26T15:47:16.420 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 is failed for ~0s 2021-07-26T15:47:20.967 INFO:tasks.rgw.c1.client.0:Stopped 2021-07-26T15:47:20.968 INFO:tasks.rgw.c1.client.0:Restarting daemon 2021-07-26T15:47:20.968 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c1 -k /etc/ceph/c1.client.0.keyring --log-file /var/log/ceph/rgw.c1.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c1.client.0.sock --foreground --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c1.client.0.stdout 2>&1 2021-07-26T15:47:20.980 INFO:tasks.rgw.c1.client.0:Started 2021-07-26T15:47:20.981 DEBUG:teuthology.orchestra.run.smithi067:> curl http://smithi067.front.sepia.ceph.com:8000 2021-07-26T15:47:21.006 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:47:21.007 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:47:21.007 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:47:21.007 INFO:teuthology.orchestra.run.smithi067.stderr:curl: (7) Failed to connect to smithi067.front.sepia.ceph.com port 8000: Connection refused 2021-07-26T15:47:21.015 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:47:22.017 DEBUG:teuthology.orchestra.run.smithi067:> curl http://smithi067.front.sepia.ceph.com:8000 2021-07-26T15:47:22.035 INFO:teuthology.orchestra.run.smithi067.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:47:22.035 INFO:teuthology.orchestra.run.smithi067.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:47:22.036 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c1.rgw.client.0 has been restored 2021-07-26T15:47:22.072 INFO:teuthology.orchestra.run.smithi067.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 6114 0 --:--:-- --:--:-- --:--:-- 6114 2021-07-26T15:47:22.074 INFO:teuthology.orchestra.run.smithi067.stdout:anonymous 2021-07-26T15:47:22.083 INFO:tasks.rgw_multisite:creating admin user.. 2021-07-26T15:47:22.084 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:22.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'realm-admin', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Realm Admin', '--system', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:22.085 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid realm-admin --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Realm Admin' --system --access-key U7VF01BMRTS2Z3FS --secret A8MVHLS39VJAUzl4NGxU8neu1LhIglID --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:22.149 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:22.150 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:22.335 INFO:teuthology.orchestra.run.smithi067.stdout:{"user_id":"realm-admin","display_name":"Realm Admin","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"realm-admin","access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","system":"true","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-07-26T15:47:22.359 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-07-26T15:47:22.359 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi067.front.sepia.ceph.com:8000', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:22.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi067.front.sepia.ceph.com:8000', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:22.360 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi067.front.sepia.ceph.com:8000 --access-key U7VF01BMRTS2Z3FS --secret A8MVHLS39VJAUzl4NGxU8neu1LhIglID --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:22.406 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:22.476 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"f77102bb-4347-429e-a853-57b537d7aec4","name":"test-realm","current_period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","epoch":2} 2021-07-26T15:47:22.482 INFO:tasks.rgw_multisite:creating zone.. 2021-07-26T15:47:22.483 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--endpoints', 'http://smithi087.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:22.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--default', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--endpoints', 'http://smithi087.front.sepia.ceph.com:8000', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:22.484 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --default --access-key U7VF01BMRTS2Z3FS --secret A8MVHLS39VJAUzl4NGxU8neu1LhIglID --endpoints http://smithi087.front.sepia.ceph.com:8000 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:22.564 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:22.565 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:22.619 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:22.609+0000 7f810b872980 0 failed reading obj info from .rgw.root:zone_info.6ccbe144-1255-4ce6-93aa-fdbfdac85106: (2) No such file or directory 2021-07-26T15:47:22.620 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:22.609+0000 7f810b872980 0 WARNING: could not read zone params for zone id=6ccbe144-1255-4ce6-93aa-fdbfdac85106 name=test-zone1 2021-07-26T15:47:22.631 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4"} 2021-07-26T15:47:22.632 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool create test-zone2.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:47:23.547 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'test-zone2.rgw.buckets.data' created 2021-07-26T15:47:23.548 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool application enable test-zone2.rgw.buckets.data rgw --cluster c2 2021-07-26T15:47:24.559 INFO:teuthology.orchestra.run.smithi087.stderr:enabled application 'rgw' on pool 'test-zone2.rgw.buckets.data' 2021-07-26T15:47:24.579 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:24.579 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:24.580 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:24.618 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:24.618 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:24.645 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2021-07-26T15:47:24.646 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:24.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:24.647 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:24.682 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:24.683 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:32.737 INFO:teuthology.orchestra.run.smithi087.stderr:Sending period to new master zone 6ccbe144-1255-4ce6-93aa-fdbfdac85106 2021-07-26T15:47:32.814 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","epoch":2,"predecessor_uuid":"f58d99ee-7dd4-4d39-856a-a1db9f5e041b","sync_status":[],"period_map":{"id":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":2} 2021-07-26T15:47:32.816 DEBUG:tasks.rgw.c2.client.0:waiting for process to exit 2021-07-26T15:47:32.816 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:47:32.817 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:47:32.809+0000 7efd1f7fe700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8000 -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground (PID: 16221) UID: 0 2021-07-26T15:47:32.817 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:47:32.809+0000 7efd2ffa1980 -1 shutting down 2021-07-26T15:47:36.030 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2021-07-26T15:47:38.919 INFO:tasks.rgw.c2.client.0:Stopped 2021-07-26T15:47:38.921 INFO:tasks.rgw.c2.client.0:Restarting daemon 2021-07-26T15:47:38.921 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8000' -n client.0 --cluster c2 -k /etc/ceph/c2.client.0.keyring --log-file /var/log/ceph/rgw.c2.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.0.sock --foreground --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.0.stdout 2>&1 2021-07-26T15:47:38.924 INFO:tasks.rgw.c2.client.0:Started 2021-07-26T15:47:38.925 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:8000 2021-07-26T15:47:38.943 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:47:38.943 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:47:38.944 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:47:38.945 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:47:38.946 INFO:teuthology.orchestra.run.smithi087.stderr:curl: (7) Failed to connect to smithi087.front.sepia.ceph.com port 8000: Connection refused 2021-07-26T15:47:39.947 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:8000 2021-07-26T15:47:39.964 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:47:39.965 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:47:39.966 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 208k 0 --:--:-- --:--:-- --:--:-- 208k 2021-07-26T15:47:39.966 INFO:teuthology.orchestra.run.smithi087.stdout:anonymous 2021-07-26T15:47:39.967 INFO:tasks.rgw_multisite:pulling realm configuration to c2 2021-07-26T15:47:39.967 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi067.front.sepia.ceph.com:8000', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--url', 'http://smithi067.front.sepia.ceph.com:8000', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:39.968 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'realm', 'pull', '--rgw-realm', 'test-realm', '--url', 'http://smithi067.front.sepia.ceph.com:8000', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--url', 'http://smithi067.front.sepia.ceph.com:8000', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:39.968 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 realm pull --rgw-realm test-realm --url http://smithi067.front.sepia.ceph.com:8000 --access-key U7VF01BMRTS2Z3FS --secret A8MVHLS39VJAUzl4NGxU8neu1LhIglID --url http://smithi067.front.sepia.ceph.com:8000 --access-key U7VF01BMRTS2Z3FS --secret A8MVHLS39VJAUzl4NGxU8neu1LhIglID --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:40.020 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:40.020 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:40.061 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:47:40.053+0000 7f2628608700 -1 rgw realm watcher: RGWRealmWatcher::handle_error oid=realms.f77102bb-4347-429e-a853-57b537d7aec4.control err=-107 2021-07-26T15:47:40.083 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"f77102bb-4347-429e-a853-57b537d7aec4","name":"test-realm","current_period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","epoch":2} 2021-07-26T15:47:40.084 INFO:tasks.rgw_multisite:creating zone.. 2021-07-26T15:47:40.084 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--endpoints', 'http://smithi087.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:40.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--endpoints', 'http://smithi087.front.sepia.ceph.com:8001', '--tier-type', 'pubsub', '--sync-from-all=0', '--sync-from', 'test-zone1', '--tier-config', 'start_with_full_sync=false,event_retention_days=7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:40.085 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key U7VF01BMRTS2Z3FS --secret A8MVHLS39VJAUzl4NGxU8neu1LhIglID --endpoints http://smithi087.front.sepia.ceph.com:8001 --tier-type pubsub --sync-from-all=0 --sync-from test-zone1 --tier-config start_with_full_sync=false,event_retention_days=7 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:40.134 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:40.134 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:40.197 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:40.189+0000 7f4bd231c980 0 failed reading obj info from .rgw.root:zone_info.6ccbe144-1255-4ce6-93aa-fdbfdac85106: (2) No such file or directory 2021-07-26T15:47:40.197 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:47:40.189+0000 7f4bd231c980 0 WARNING: could not read zone params for zone id=6ccbe144-1255-4ce6-93aa-fdbfdac85106 name=test-zone1 2021-07-26T15:47:40.207 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","roles_pool":"test-zone3.rgw.meta:roles","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4"} 2021-07-26T15:47:40.208 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool create test-zone3.rgw.buckets.data 64 64 --cluster c2 2021-07-26T15:47:40.621 INFO:teuthology.orchestra.run.smithi087.stderr:pool 'test-zone3.rgw.buckets.data' created 2021-07-26T15:47:40.632 DEBUG:teuthology.orchestra.run.smithi087:> sudo ceph osd pool application enable test-zone3.rgw.buckets.data rgw --cluster c2 2021-07-26T15:47:41.621 INFO:teuthology.orchestra.run.smithi087.stderr:enabled application 'rgw' on pool 'test-zone3.rgw.buckets.data' 2021-07-26T15:47:41.639 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:41.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'placement', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', 'modify', '--placement-id', 'default-placement', '--compression', 'random', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:41.641 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone placement --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm modify --placement-id default-placement --compression random --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:41.678 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:41.679 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:41.704 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","domain_root":"test-zone3.rgw.meta:root","control_pool":"test-zone3.rgw.control","gc_pool":"test-zone3.rgw.log:gc","lc_pool":"test-zone3.rgw.log:lc","log_pool":"test-zone3.rgw.log","intent_log_pool":"test-zone3.rgw.log:intent","usage_log_pool":"test-zone3.rgw.log:usage","roles_pool":"test-zone3.rgw.meta:roles","reshard_pool":"test-zone3.rgw.log:reshard","user_keys_pool":"test-zone3.rgw.meta:users.keys","user_email_pool":"test-zone3.rgw.meta:users.email","user_swift_pool":"test-zone3.rgw.meta:users.swift","user_uid_pool":"test-zone3.rgw.meta:users.uid","otp_pool":"test-zone3.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone3.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone3.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone3.rgw.buckets.non-ec","index_type":0}}],"tier_config":{"event_retention_days":7,"start_with_full_sync":false},"realm_id":""} 2021-07-26T15:47:41.704 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:41.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:41.705 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:41.739 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 has been restored 2021-07-26T15:47:41.787 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:41.788 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:49.781 INFO:teuthology.orchestra.run.smithi087.stderr:Sending period to new master zone 6ccbe144-1255-4ce6-93aa-fdbfdac85106 2021-07-26T15:47:49.872 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","epoch":3,"predecessor_uuid":"f58d99ee-7dd4-4d39-856a-a1db9f5e041b","sync_status":[],"period_map":{"id":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","val":1630018487},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":2} 2021-07-26T15:47:49.873 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-07-26T15:47:49.873 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:47:49.874 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T15:47:49.865+0000 7fa3a9530700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground (PID: 16223) UID: 0 2021-07-26T15:47:49.874 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T15:47:49.865+0000 7fa3ad90a980 -1 shutting down 2021-07-26T15:47:53.060 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 is failed for ~0s 2021-07-26T15:47:55.976 INFO:tasks.rgw.c2.client.1:Stopped 2021-07-26T15:47:55.976 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-07-26T15:47:55.977 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-07-26T15:47:55.982 INFO:tasks.rgw.c2.client.1:Started 2021-07-26T15:47:55.982 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:8001 2021-07-26T15:47:56.002 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:47:56.003 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:47:56.004 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:47:56.004 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:47:56.004 INFO:teuthology.orchestra.run.smithi087.stderr:curl: (7) Failed to connect to smithi087.front.sepia.ceph.com port 8001: Connection refused 2021-07-26T15:47:57.006 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:8001 2021-07-26T15:47:57.032 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:47:57.032 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:47:57.034 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 130k 0 --:--:-- --:--:-- --:--:-- 130k 2021-07-26T15:47:57.035 INFO:teuthology.orchestra.run.smithi087.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-0060fed92d-10e4-test-zone3","HostId":"10e4-test-zone3-test-zonegroup"} 2021-07-26T15:47:57.036 INFO:tasks.rgw_multisite:rgw multisite configuration completed 2021-07-26T15:47:57.036 INFO:teuthology.run_tasks:Running task rgw-multisite-tests... 2021-07-26T15:47:57.056 INFO:tasks.rgw_multisite_tests:cloning suite branch octopus from https://github.com/ceph/ceph.git... 2021-07-26T15:47:57.057 DEBUG:teuthology.repo_utils:Setting repo remote to https://github.com/ceph/ceph.git 2021-07-26T15:47:57.073 INFO:teuthology.repo_utils:Fetching octopus from origin 2021-07-26T15:47:58.217 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/github.com_ceph_ceph_octopus to origin/octopus 2021-07-26T15:47:58.460 INFO:tasks.rgw_multisite_tests:importing tests from /home/teuthworker/src/github.com_ceph_ceph_octopus/src/test/rgw/rgw_multi 2021-07-26T15:47:58.489 INFO:tasks.rgw_multisite_tests:creating test user.. 2021-07-26T15:47:58.490 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:58.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'user', 'create', '--uid', 'rgw-multisite-test-user', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--display-name', 'Multisite Test User', '--gen-access-key', '--gen-secret', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:47:58.492 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 user create --uid rgw-multisite-test-user --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --display-name 'Multisite Test User' --gen-access-key --gen-secret --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:47:58.537 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:58.538 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:58.715 INFO:teuthology.orchestra.run.smithi067.stdout:{"user_id":"rgw-multisite-test-user","display_name":"Multisite Test User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"rgw-multisite-test-user","access_key":"BYTNTBPOKTRCUMQUQAO0","secret_key":"qejWd3k6O4tE4G2BBjnCQIJnmY5VdVqnF3Wlqkva"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[]} 2021-07-26T15:47:58.742 INFO:rgw_multi.tests:meta checkpoint 2021-07-26T15:47:58.743 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:58.743 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:58.744 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:47:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:58.784 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:58.957 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:47:58.987 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314478.708636_31.1","last_update":"2021-07-26T15:47:58.708636Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:47:58.988 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:47:58.988 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:58.989 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:47:58.989 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:47:59.027 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:47:59.028 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:47:59.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 has been restored 2021-07-26T15:47:59.216 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:47:59.217 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:48:04.219 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:04.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:04.220 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:04.259 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:04.469 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:04.469 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:48:09.471 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:09.471 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:09.472 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:09.511 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:09.511 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:09.705 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:09.705 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:48:14.706 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:14.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:14.708 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:14.746 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:14.747 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:14.929 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:14.930 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:48:19.933 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:19.934 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:19.934 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:19.974 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:19.974 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:20.176 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:20.177 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:48:25.178 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:25.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:25.179 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:25.225 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:25.225 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:25.407 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:25.407 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:48:30.408 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:30.409 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:30.409 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:30.451 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:30.452 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:30.630 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:30.631 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:48:35.632 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:35.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:35.633 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:35.676 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:35.676 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:35.874 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:35.875 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:48:40.876 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:40.877 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:40.878 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:40.919 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:40.920 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:41.126 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:41.127 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:48:46.128 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:46.128 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:46.129 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:46.171 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:46.171 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:46.371 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:46.371 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:48:51.373 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:51.373 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:51.374 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:51.414 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:51.415 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:51.641 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:51.642 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:48:56.644 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:56.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:48:56.646 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:48:56.686 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:48:56.687 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:48:56.898 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:48:56.899 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:49:01.900 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:01.901 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:01.902 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:01.940 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:01.941 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:02.124 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:02.125 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:49:07.126 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:07.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:07.128 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:07.167 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:07.167 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:07.356 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:07.357 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:49:12.358 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:12.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:12.359 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:12.398 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:12.399 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:12.601 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:12.602 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:49:17.603 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:17.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:17.604 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:17.648 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:17.649 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:17.832 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:17.833 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:49:22.833 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:22.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:22.835 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:22.875 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:22.876 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:23.069 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:23.070 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:49:28.071 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:28.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:28.072 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:28.113 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:28.304 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:28.305 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:49:33.306 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:33.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:33.308 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:33.348 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:33.534 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:33.535 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:49:38.535 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:38.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:38.537 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:38.577 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:38.577 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:38.767 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:38.767 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:49:43.768 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:43.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:43.770 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:43.808 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:43.809 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:44.002 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:44.002 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:49:49.004 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:49.004 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:49.005 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:49.044 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:49.045 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:49.226 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:49.227 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314478.708636_31.1 target= 2021-07-26T15:49:54.228 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:54.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:54.230 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:54.270 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:54.270 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:54.471 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:54.472 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:49:54.472 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:49:54.473 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:54.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:54.474 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:54.551 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:54.552 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:54.729 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:54.730 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:49:54.730 INFO:rgw_multi.tests:meta checkpoint 2021-07-26T15:49:54.731 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:54.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:54.731 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:54.769 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:54.769 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:54.952 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:49:54.983 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314478.708636_31.1","last_update":"2021-07-26T15:47:58.708636Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:49:54.983 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:49:54.984 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:54.984 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:54.985 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:55.024 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:55.024 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:55.224 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:55.225 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:49:55.225 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:49:55.226 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:55.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:49:55.227 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:49:55.308 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:49:55.308 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:49:55.504 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:49:55.505 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:49:55.506 INFO:tasks.rgw_multisite_tests:running rgw multisite tests on '/home/teuthworker/src/github.com_ceph_ceph_octopus/src/test/rgw/rgw_multi' with args=['tests.py', 'tests_ps.py'] 2021-07-26T15:49:55.566 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-1 2021-07-26T15:49:59.618 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-2 2021-07-26T15:50:03.646 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:03.647 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:03.647 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:03.687 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:03.687 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:03.857 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:03.891 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314478.708636_31.1","last_update":"2021-07-26T15:47:58.708636Z"},{"marker":"1_1627314599.655223_59.1","last_update":"2021-07-26T15:49:59.655223Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:03.891 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:03.892 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:03.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:03.893 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:03.935 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:03.935 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:04.113 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314599.655223_59.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:49:59.655223Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:04.113 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:04.114 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:04.114 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:04.115 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:04.115 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:04.195 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:04.195 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:04.393 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314599.655223_59.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:49:59.655223Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:04.393 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:04.414 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_create ... ok 2021-07-26T15:50:04.415 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-3 2021-07-26T15:50:04.449 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-4 2021-07-26T15:50:04.496 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:04.497 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:04.497 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:04.534 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:04.535 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:04.696 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:04.728 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314478.708636_31.1","last_update":"2021-07-26T15:47:58.708636Z"},{"marker":"1_1627314604.481638_69.1","last_update":"2021-07-26T15:50:04.481638Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:04.728 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:04.729 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:04.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:04.730 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:04.769 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:04.976 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314604.481638_69.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:04.481638Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:04.977 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:04.978 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:04.978 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:04.979 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:04.979 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:05.058 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:05.059 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:05.243 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314604.481638_69.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:04.481638Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:05.244 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:05.476 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:05.476 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:05.477 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:05.515 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:05.516 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:05.665 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:05.697 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314478.708636_31.1","last_update":"2021-07-26T15:47:58.708636Z"},{"marker":"1_1627314605.429662_89.1","last_update":"2021-07-26T15:50:05.429662Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:05.698 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:05.698 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:05.699 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:05.700 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:05.743 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:05.935 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314605.429662_89.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:05.429662Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:05.936 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:05.936 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:05.937 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:05.937 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:05.938 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:06.017 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:06.018 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:06.217 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314605.429662_89.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:05.429662Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:06.218 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:06.241 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_recreate ... ok 2021-07-26T15:50:06.242 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-5 2021-07-26T15:50:06.271 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-6 2021-07-26T15:50:06.323 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:06.324 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:06.325 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:06.365 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:06.366 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:06.526 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:06.558 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314478.708636_31.1","last_update":"2021-07-26T15:47:58.708636Z"},{"marker":"1_1627314606.306561_100.1","last_update":"2021-07-26T15:50:06.306561Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:06.558 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:06.559 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:06.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:06.560 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:06.603 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:06.802 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314606.306561_100.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:06.306561Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:06.802 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:06.803 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:06.803 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:06.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:06.805 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:06.843 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:06.843 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:07.040 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314606.306561_100.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:06.306561Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:07.041 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:07.158 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:07.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:07.160 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:07.199 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:07.199 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:07.378 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:07.409 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314478.708636_31.1","last_update":"2021-07-26T15:47:58.708636Z"},{"marker":"1_1627314607.134933_105.1","last_update":"2021-07-26T15:50:07.134933Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:07.410 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:07.410 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:07.411 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:07.411 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:07.451 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:07.451 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:07.649 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314607.134933_105.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:07.134933Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:07.649 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:07.650 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:07.650 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:07.651 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:07.651 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:07.689 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:07.690 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:07.885 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314607.134933_105.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:07.134933Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:07.886 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:07.893 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_remove ... ok 2021-07-26T15:50:07.893 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-7 2021-07-26T15:50:07.927 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-8 2021-07-26T15:50:08.383 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:08.384 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:08.384 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:08.422 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:08.422 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:08.589 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:08.617 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314478.708636_31.1","last_update":"2021-07-26T15:47:58.708636Z"},{"marker":"1_1627314607.956772_114.1","last_update":"2021-07-26T15:50:07.956772Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:08.618 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:08.619 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:08.619 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:08.620 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:08.659 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:08.660 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:08.855 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314607.956772_114.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:07.956772Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:08.856 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:08.856 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:08.857 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:08.857 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:08.858 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:08.935 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:08.935 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:09.129 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314478.708636_31.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:47:58.708636Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314607.956772_114.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:07.956772Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:09.130 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:09.130 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:09.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:09.131 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-7 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:09.172 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:09.173 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:09.380 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.6.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.8.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.6.5"},{"key":8,"val":"00000000001.9.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:09.381 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-7 2021-07-26T15:50:09.381 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:09.382 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:09.383 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-7 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:09.427 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:09.428 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:09.643 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.6.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"_myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.8.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"&","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.6.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":":","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.9.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:09.643 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-7 2021-07-26T15:50:09.644 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-7 zones={test-zone2, test-zone1} 2021-07-26T15:50:09.652 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:09.700 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:50:09.701 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:50:09.701 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:50:09.702 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:50:09.702 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:09.709 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:50:09.709 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:50:09.710 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:50:09.710 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:50:09.765 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:50:09.819 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:50:09.931 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:50:10.039 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:50:10.091 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:50:10.200 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:50:10.313 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:50:10.368 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:50:10.518 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:50:10.637 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:10.697 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:10.811 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:10.913 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-7 zones={test-zone2, test-zone1} 2021-07-26T15:50:10.914 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:10.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-7', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:10.915 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-7 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:10.953 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:10.953 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:11.159 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.6.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.8.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.6.5"},{"key":8,"val":"00000000001.9.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:11.160 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-7 2021-07-26T15:50:11.161 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:11.163 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-7', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:11.164 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-7 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:11.208 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:11.208 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:11.429 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.6.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.8.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.6.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.9.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:11.430 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-7 2021-07-26T15:50:11.430 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-8', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:11.434 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-8', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:11.434 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-8 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:11.514 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:11.514 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:11.694 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.4.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.12.5"},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.4.5"},{"key":8,"val":"00000000001.10.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:11.694 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-8 2021-07-26T15:50:11.695 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-8', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:11.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-8', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:11.696 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-8 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:11.741 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:11.741 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:11.959 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.4.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"_myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.12.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"&","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.4.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":":","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.10.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:11.960 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-8 2021-07-26T15:50:11.960 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-8 zones={test-zone1, test-zone2} 2021-07-26T15:50:11.969 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:11.974 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:50:11.975 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:50:11.975 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:50:11.976 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:50:11.976 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:12.027 DEBUG:tasks.rgw_multi.zone_rados:o=& 2021-07-26T15:50:12.028 DEBUG:tasks.rgw_multi.zone_rados:o=: 2021-07-26T15:50:12.028 DEBUG:tasks.rgw_multi.zone_rados:o=_myobj 2021-07-26T15:50:12.029 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:50:12.084 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:50:12.141 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:50:12.256 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=& 2021-07-26T15:50:12.357 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:50:12.415 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:50:12.565 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=: 2021-07-26T15:50:12.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:50:12.719 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:50:12.827 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=_myobj 2021-07-26T15:50:12.929 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:12.983 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:13.091 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:13.196 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-8 zones={test-zone1, test-zone2} 2021-07-26T15:50:13.197 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_sync ... ok 2021-07-26T15:50:13.198 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-9 2021-07-26T15:50:13.225 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-10 2021-07-26T15:50:13.359 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:50:13.353+0000 7f28337fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:13.360 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T15:50:13.353+0000 7f02677ee700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:13.361 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:50:13.357+0000 7f283d7fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:13.362 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T15:50:13.357+0000 7f026b7f6700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:50:13.375 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:13.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:13.377 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:13.420 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:13.421 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:13.616 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:13.643 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314613.256073_46.1","last_update":"2021-07-26T15:50:13.256073Z"},{"marker":"1_1627314613.226456_122.1","last_update":"2021-07-26T15:50:13.226456Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:13.644 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:13.645 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:13.645 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:13.646 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:13.686 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:13.686 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:13.881 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314613.256073_46.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:13.256073Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:13.882 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:13.882 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:13.883 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:13.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:13.884 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:13.922 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:13.922 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:14.111 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314613.256073_46.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:13.256073Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:14.112 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:14.113 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:14.113 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:14.114 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:14.156 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:14.156 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:14.357 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.11.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:14.358 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-9 2021-07-26T15:50:14.359 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:14.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:14.362 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:14.405 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:14.405 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:14.614 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.11.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:14.615 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-9 2021-07-26T15:50:14.615 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-9 zones={test-zone2, test-zone1} 2021-07-26T15:50:14.626 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:14.675 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:50:14.676 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:14.681 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:50:14.740 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:14.800 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:14.911 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:15.019 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-9 zones={test-zone2, test-zone1} 2021-07-26T15:50:15.020 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:15.020 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:15.021 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:15.061 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:15.061 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:15.255 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.11.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:15.256 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-9 2021-07-26T15:50:15.257 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:15.257 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:15.259 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:15.303 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:15.304 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:15.508 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.11.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:15.509 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-9 2021-07-26T15:50:15.510 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:15.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:15.511 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:15.596 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:15.596 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:15.803 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.10.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:15.803 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-10 2021-07-26T15:50:15.804 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:15.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:15.805 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:15.851 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:15.852 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:16.078 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.10.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:16.079 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-10 2021-07-26T15:50:16.079 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-10 zones={test-zone1, test-zone2} 2021-07-26T15:50:16.089 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:16.135 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:50:16.136 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:16.143 DEBUG:tasks.rgw_multi.zone_rados:o=myobj 2021-07-26T15:50:16.196 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:16.252 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:16.361 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=myobj 2021-07-26T15:50:16.465 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-10 zones={test-zone1, test-zone2} 2021-07-26T15:50:16.482 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:16.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:16.484 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:16.523 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:16.524 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:16.705 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.13.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:16.706 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-9 2021-07-26T15:50:16.706 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:16.707 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:16.707 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:16.749 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:16.749 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:16.954 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.13.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:16.955 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-9 2021-07-26T15:50:16.956 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-9 zones={test-zone2, test-zone1} 2021-07-26T15:50:16.965 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:17.011 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:17.073 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-9 zones={test-zone2, test-zone1} 2021-07-26T15:50:17.074 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:17.074 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-9', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:17.075 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-9 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:17.114 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:17.115 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:17.306 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.13.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:17.307 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-9 2021-07-26T15:50:17.307 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:17.308 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-9', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:17.308 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-9 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:17.352 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:17.353 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:17.562 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.13.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:17.562 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-9 2021-07-26T15:50:17.577 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:17.578 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-10', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:17.579 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-10 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:17.645 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:17.645 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:17.840 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.14.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:17.841 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-10 2021-07-26T15:50:17.841 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:17.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-10', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:17.842 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-10 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:17.885 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:17.886 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:18.100 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"myobj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.14.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:18.100 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-10 2021-07-26T15:50:18.101 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-10 zones={test-zone1, test-zone2} 2021-07-26T15:50:18.110 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:18.159 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:18.221 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-10 zones={test-zone1, test-zone2} 2021-07-26T15:50:18.221 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_object_delete ... ok 2021-07-26T15:50:18.222 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-11 2021-07-26T15:50:18.257 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-12 2021-07-26T15:50:18.340 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:18.341 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:18.341 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:18.380 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:18.380 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:18.541 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:18.571 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314618.337553_65.1","last_update":"2021-07-26T15:50:18.337553Z"},{"marker":"1_1627314613.226456_122.1","last_update":"2021-07-26T15:50:13.226456Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:18.571 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:18.572 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:18.573 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:18.573 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:18.617 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:18.617 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:18.800 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314618.337553_65.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:18.337553Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:18.801 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:18.802 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:18.802 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:18.803 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:18.803 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:18.842 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:18.843 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:19.046 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314618.337553_65.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:18.337553Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:19.048 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:19.095 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:19.096 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:19.096 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:19.137 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:19.137 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:19.328 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.14.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:19.329 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:19.329 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:19.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:19.330 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:19.376 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:19.578 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"-xuLNsvNYqV9QtN8X1Hyj0DaHFoLz.8","ns":""},"count":1},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:19.579 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:19.580 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:19.580 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:19.581 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:19.623 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:19.838 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.16.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:19.838 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:19.839 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:19.839 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:19.840 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:19.885 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:19.885 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:20.083 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:20.084 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:20.131 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:20.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:20.133 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:20.173 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:20.173 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:20.376 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.12.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:20.377 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-12 2021-07-26T15:50:20.377 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:20.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:20.379 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:20.422 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:20.614 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"fSz6EWZYCd4yZXGk9hq8lsSMFvVcpD9","ns":""},"count":1},"inc_marker":{"position":"00000000003.14.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:20.615 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-12 2021-07-26T15:50:21.356 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:21.356 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:21.358 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:21.400 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:21.401 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:21.611 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.33.5"},{"key":2,"val":""},{"key":3,"val":"00000000006.15.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.16.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:21.612 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:21.613 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:21.613 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:21.614 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:21.659 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:21.659 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:21.871 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"SFDs4kl4Cy9BIDwFnPacpVnuK7BJwUC","ns":""},"count":2},"inc_marker":{"position":"00000000010.33.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"RyrKx72AzBZv9McLhgtqlHWxVpM2FDT","ns":""},"count":1},"inc_marker":{"position":"00000000006.15.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"-xuLNsvNYqV9QtN8X1Hyj0DaHFoLz.8","ns":""},"count":1},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:21.871 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:21.872 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:21.872 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:21.873 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:21.914 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:21.914 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:22.124 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.33.5"},{"key":2,"val":""},{"key":3,"val":"00000000006.15.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.16.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:22.124 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:22.125 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:22.126 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:22.126 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:22.170 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:22.170 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:22.388 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.33.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.15.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:22.389 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:22.389 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:22.390 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:22.390 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:22.472 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:22.648 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000005.30.5"},{"key":2,"val":""},{"key":3,"val":"00000000010.24.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.12.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:22.649 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-11 2021-07-26T15:50:22.649 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:22.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:22.651 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:22.694 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:22.695 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:22.916 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"SFDs4kl4Cy9BIDwFnPacpVnuK7BJwUC","ns":""},"count":1},"inc_marker":{"position":"00000000005.30.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"RyrKx72AzBZv9McLhgtqlHWxVpM2FDT","ns":""},"count":1},"inc_marker":{"position":"00000000010.24.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"-xuLNsvNYqV9QtN8X1Hyj0DaHFoLz.8","ns":""},"count":1},"inc_marker":{"position":"00000000002.12.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:22.917 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-11 2021-07-26T15:50:22.917 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-11 zones={test-zone2, test-zone1} 2021-07-26T15:50:22.926 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:22.933 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:22.934 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:50:22.935 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:50:22.935 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:22.941 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:22.942 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:50:22.942 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:50:22.996 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:23.009 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:23.076 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:23.137 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:23.192 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:23.313 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:23.417 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:23.473 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:23.585 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:23.693 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-11 zones={test-zone2, test-zone1} 2021-07-26T15:50:23.694 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:23.695 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:23.695 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:23.735 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:23.945 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.23.5"},{"key":2,"val":""},{"key":3,"val":"00000000006.20.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.12.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:23.946 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-12 2021-07-26T15:50:23.947 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:23.947 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:23.948 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:23.992 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:23.993 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:24.204 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"OtkNUgqcS0bmtN2AT0goZKDtwmj-zUa","ns":""},"count":1},"inc_marker":{"position":"00000000010.23.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"szx6OjVvv6dKrTu..fgcannxUqaFjIa","ns":""},"count":1},"inc_marker":{"position":"00000000006.20.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"fSz6EWZYCd4yZXGk9hq8lsSMFvVcpD9","ns":""},"count":1},"inc_marker":{"position":"00000000002.12.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:24.205 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-12 2021-07-26T15:50:24.205 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:24.206 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:24.206 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:24.248 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:24.249 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:24.447 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000010.23.5"},{"key":2,"val":""},{"key":3,"val":"00000000006.20.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.12.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:24.448 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-12 2021-07-26T15:50:24.449 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:24.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:24.450 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:24.492 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:24.493 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:24.694 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.23.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.20.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.12.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:24.695 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-12 2021-07-26T15:50:24.696 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:24.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:24.697 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:24.775 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:24.776 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:24.968 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.7.10"},{"key":2,"val":""},{"key":3,"val":"00000000010.30.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.14.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:24.969 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-12 2021-07-26T15:50:24.969 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:24.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:24.970 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:25.017 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:25.017 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:25.237 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"OtkNUgqcS0bmtN2AT0goZKDtwmj-zUa","ns":""},"count":1},"inc_marker":{"position":"00000000002.7.10"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"TCzPLOJp07dsEFuwKaFg1wv-FeUdzGq","ns":""},"count":1},"inc_marker":{"position":"00000000010.30.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"fSz6EWZYCd4yZXGk9hq8lsSMFvVcpD9","ns":""},"count":1},"inc_marker":{"position":"00000000003.14.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:25.238 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-12 2021-07-26T15:50:25.238 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-12 zones={test-zone2, test-zone1} 2021-07-26T15:50:25.252 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:25.299 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:25.300 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:50:25.300 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:50:25.301 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:25.307 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:25.308 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:50:25.309 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:50:25.364 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:25.376 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:25.452 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:25.513 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:25.567 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:25.678 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:25.780 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:25.837 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:25.957 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:26.056 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-12 zones={test-zone2, test-zone1} 2021-07-26T15:50:26.329 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:26.330 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:26.330 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:26.375 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:26.557 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.37.5"},{"key":2,"val":""},{"key":3,"val":"00000000007.18.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.16.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:26.557 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:26.558 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:26.559 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:26.559 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:26.606 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:26.607 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:26.791 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"SFDs4kl4Cy9BIDwFnPacpVnuK7BJwUC","ns":""},"count":2},"inc_marker":{"position":"00000000011.37.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"RyrKx72AzBZv9McLhgtqlHWxVpM2FDT","ns":""},"count":1},"inc_marker":{"position":"00000000007.18.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"-xuLNsvNYqV9QtN8X1Hyj0DaHFoLz.8","ns":""},"count":1},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:26.791 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:26.792 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:26.792 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:26.793 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:26.833 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:27.057 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.37.5"},{"key":2,"val":""},{"key":3,"val":"00000000007.18.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.16.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:27.058 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:27.059 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:27.060 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:27.061 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:27.106 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:27.106 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:27.315 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.37.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000007.18.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.16.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:27.316 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-11 2021-07-26T15:50:27.317 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:27.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-11', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:27.318 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-11 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:27.399 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:27.399 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:27.586 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000006.33.5"},{"key":2,"val":""},{"key":3,"val":"00000000011.29.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.12.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:27.587 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-11 2021-07-26T15:50:27.587 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:27.588 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-11', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:27.588 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-11 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:27.632 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:27.633 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:27.843 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"SFDs4kl4Cy9BIDwFnPacpVnuK7BJwUC","ns":""},"count":1},"inc_marker":{"position":"00000000006.33.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"RyrKx72AzBZv9McLhgtqlHWxVpM2FDT","ns":""},"count":1},"inc_marker":{"position":"00000000011.29.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"-xuLNsvNYqV9QtN8X1Hyj0DaHFoLz.8","ns":""},"count":1},"inc_marker":{"position":"00000000002.12.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:27.844 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-11 2021-07-26T15:50:27.844 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-11 zones={test-zone2, test-zone1} 2021-07-26T15:50:27.852 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:27.902 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:27.903 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:50:27.904 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:50:27.904 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:27.910 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:27.911 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:50:27.911 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:50:27.922 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:27.933 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:27.999 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:28.061 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:28.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:28.237 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:28.344 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:28.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:28.512 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:28.617 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-11 zones={test-zone2, test-zone1} 2021-07-26T15:50:28.618 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:28.618 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:28.619 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:28.659 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:28.660 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:28.859 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.27.5"},{"key":2,"val":""},{"key":3,"val":"00000000007.23.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.12.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:28.860 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-12 2021-07-26T15:50:28.860 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:28.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:28.861 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:28.904 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:28.905 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:29.099 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"OtkNUgqcS0bmtN2AT0goZKDtwmj-zUa","ns":""},"count":1},"inc_marker":{"position":"00000000011.27.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"szx6OjVvv6dKrTu..fgcannxUqaFjIa","ns":""},"count":1},"inc_marker":{"position":"00000000007.23.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"fSz6EWZYCd4yZXGk9hq8lsSMFvVcpD9","ns":""},"count":1},"inc_marker":{"position":"00000000002.12.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:29.100 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-12 2021-07-26T15:50:29.101 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:29.102 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:29.103 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:29.145 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:29.145 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:29.355 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000011.27.5"},{"key":2,"val":""},{"key":3,"val":"00000000007.23.5"},{"key":4,"val":""},{"key":5,"val":"00000000002.12.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:29.355 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-12 2021-07-26T15:50:29.356 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:29.357 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:29.358 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:29.403 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:29.403 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:29.609 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.27.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000007.23.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.12.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:29.609 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-12 2021-07-26T15:50:29.610 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:29.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-12', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:29.611 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-12 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:29.697 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:29.697 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:29.890 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000003.10.5"},{"key":2,"val":""},{"key":3,"val":"00000000011.35.5"},{"key":4,"val":""},{"key":5,"val":"00000000003.14.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:29.891 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-12 2021-07-26T15:50:29.892 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:29.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-12', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:29.893 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-12 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:29.937 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:29.937 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:30.157 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone1","instance":"OtkNUgqcS0bmtN2AT0goZKDtwmj-zUa","ns":""},"count":1},"inc_marker":{"position":"00000000003.10.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj-test-zone2","instance":"TCzPLOJp07dsEFuwKaFg1wv-FeUdzGq","ns":""},"count":1},"inc_marker":{"position":"00000000011.35.5"}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"fSz6EWZYCd4yZXGk9hq8lsSMFvVcpD9","ns":""},"count":1},"inc_marker":{"position":"00000000003.14.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:30.158 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-12 2021-07-26T15:50:30.159 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-12 zones={test-zone2, test-zone1} 2021-07-26T15:50:30.170 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:30.176 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:30.176 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:50:30.177 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:50:30.179 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:30.185 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:30.185 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone1 2021-07-26T15:50:30.186 DEBUG:tasks.rgw_multi.zone_rados:o=obj-test-zone2 2021-07-26T15:50:30.197 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:30.208 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:30.276 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:30.336 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:30.402 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:30.515 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone1 2021-07-26T15:50:30.625 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:30.686 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:30.800 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj-test-zone2 2021-07-26T15:50:30.905 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-12 zones={test-zone2, test-zone1} 2021-07-26T15:50:30.906 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_versioned_object_incremental_sync ... ok 2021-07-26T15:50:30.947 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:30.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:30.948 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:30.988 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:30.989 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:31.155 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:31.187 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314630.950552_87.1","last_update":"2021-07-26T15:50:30.950552Z"},{"marker":"1_1627314613.226456_122.1","last_update":"2021-07-26T15:50:13.226456Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:31.187 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:31.188 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:31.188 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:31.189 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:31.230 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:31.230 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:31.412 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314630.950552_87.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:30.950552Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:31.412 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:31.413 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:31.414 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:31.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:31.415 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:31.493 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:31.494 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:31.668 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314630.950552_87.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:30.950552Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:31.669 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:31.723 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:31.725 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:31.726 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:31.770 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:31.770 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:31.961 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.14.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:31.962 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-13 2021-07-26T15:50:31.962 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:31.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:31.963 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:32.006 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:32.007 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:32.200 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"KB-4Mvj8L4fAU.vdEAS14D7VRjpQ6c-","ns":""},"count":1},"inc_marker":{"position":"00000000003.14.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:32.201 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-13 2021-07-26T15:50:32.201 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:32.202 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:32.202 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:32.244 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:32.245 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:32.455 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.14.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:32.456 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-13 2021-07-26T15:50:32.456 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:32.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:32.458 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:32.501 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:32.502 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:32.688 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.14.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:32.688 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-13 2021-07-26T15:50:32.689 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:32.690 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:32.690 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:32.769 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:32.770 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:32.957 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.22.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:32.957 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-13 2021-07-26T15:50:32.958 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:32.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:32.959 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:33.005 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:33.006 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:33.217 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"KB-4Mvj8L4fAU.vdEAS14D7VRjpQ6c-","ns":""},"count":1},"inc_marker":{"position":"00000000002.22.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:33.217 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-13 2021-07-26T15:50:33.218 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-13 zones={test-zone2, test-zone1} 2021-07-26T15:50:33.227 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:33.275 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:33.276 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:33.282 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:33.336 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:33.348 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:33.411 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:33.469 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-13 zones={test-zone2, test-zone1} 2021-07-26T15:50:34.455 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:34.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:34.457 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:34.498 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:34.703 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.14.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000031.100.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:34.704 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-13 2021-07-26T15:50:34.704 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:34.705 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:34.705 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:34.749 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:34.750 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:34.937 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"KB-4Mvj8L4fAU.vdEAS14D7VRjpQ6c-","ns":""},"count":1},"inc_marker":{"position":"00000000003.14.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"DPNJyAWIpQ9eBpXhXhXhr6tVHEenuId","ns":""},"count":1},"inc_marker":{"position":"00000000031.100.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:34.937 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-13 2021-07-26T15:50:34.938 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:34.938 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:34.939 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:34.980 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:34.981 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:35.185 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000003.14.9"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000031.100.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:35.185 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-13 2021-07-26T15:50:35.186 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:35.186 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:35.187 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:35.232 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:35.232 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:35.419 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.14.9"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000031.100.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:35.420 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-13 2021-07-26T15:50:35.421 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:35.421 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-13', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:35.422 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-13 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:35.461 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:35.462 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:35.648 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000002.22.10"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000040.91.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:35.649 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-13 2021-07-26T15:50:35.649 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:35.650 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-13', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:35.650 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-13 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:35.696 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:35.920 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"dummy","instance":"KB-4Mvj8L4fAU.vdEAS14D7VRjpQ6c-","ns":""},"count":1},"inc_marker":{"position":"00000000002.22.10"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"zoi2hmXanSh7xk422qKnEpccphJAW6a","ns":""},"count":2},"inc_marker":{"position":"00000000040.91.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:35.921 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-13 2021-07-26T15:50:35.921 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-13 zones={test-zone2, test-zone1} 2021-07-26T15:50:35.930 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:35.939 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:35.940 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.941 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.941 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.941 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.942 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.943 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.943 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.944 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.944 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.945 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.945 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.946 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.946 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.947 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.947 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.948 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.948 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.949 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.949 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.949 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.950 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:35.959 DEBUG:tasks.rgw_multi.zone_rados:o=dummy 2021-07-26T15:50:35.960 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.960 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.961 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.961 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.962 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.962 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.962 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.963 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.963 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.964 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.964 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.965 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.965 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.967 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.968 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.969 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:35.985 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:35.996 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:36.065 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=dummy 2021-07-26T15:50:36.129 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:36.188 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:36.303 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:36.403 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:36.463 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:36.572 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:36.674 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:36.727 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:36.838 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:36.947 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:37.000 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:37.119 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:37.222 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:37.275 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:37.387 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:37.527 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:37.580 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:37.693 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:37.793 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:37.847 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:37.962 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:38.065 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:38.125 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:38.235 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:38.337 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:38.391 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:38.503 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:38.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:38.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:38.778 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:38.881 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:38.936 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:39.046 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:39.150 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:39.205 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:39.323 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:39.430 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:39.491 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:39.607 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:39.713 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:39.767 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:39.882 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:39.981 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:40.039 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:40.151 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:40.257 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:40.314 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:40.430 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:40.537 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:40.591 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:40.703 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:40.805 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:40.861 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:40.970 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:41.073 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:41.131 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:41.247 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:41.360 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:41.416 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:41.525 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:41.625 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-13 zones={test-zone2, test-zone1} 2021-07-26T15:50:41.626 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:41.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:41.627 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:41.664 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:41.665 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:41.886 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314631.690288_38.1","last_update":"2021-07-26T15:50:31.690288Z"},{"marker":"1_1627314608.554116_66.1","last_update":"2021-07-26T15:50:08.554116Z"},{"marker":"1_1627314623.990344_48.2","last_update":"2021-07-26T15:50:23.990344Z"},{"marker":"1_1627314633.486908_80.1","last_update":"2021-07-26T15:50:33.486908Z"}] 2021-07-26T15:50:41.886 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:50:41.887 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:41.887 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:41.888 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:41.929 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:42.123 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314631.690288_38.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:31.690288Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314608.554116_66.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:08.554116Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314623.990344_48.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:23.990344Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314633.486908_80.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:33.486908Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:42.123 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:50:42.124 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.125 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:42.164 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:42.164 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:42.366 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314631.690288_38.1","last_update":"2021-07-26T15:50:31.690288Z"},{"marker":"1_1627314608.554116_66.1","last_update":"2021-07-26T15:50:08.554116Z"},{"marker":"1_1627314623.990344_48.2","last_update":"2021-07-26T15:50:23.990344Z"},{"marker":"1_1627314633.486908_80.1","last_update":"2021-07-26T15:50:33.486908Z"}] 2021-07-26T15:50:42.366 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:50:42.367 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.368 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.369 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:42.411 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:42.412 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:42.585 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314631.690288_38.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:31.690288Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314608.554116_66.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:08.554116Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314623.990344_48.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:23.990344Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314633.486908_80.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:33.486908Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:42.586 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:50:42.586 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.588 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:42.630 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:42.630 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:42.806 INFO:teuthology.orchestra.run.smithi087.stdout:[{"marker":"1_1627314631.835464_26.1","last_update":"2021-07-26T15:50:31.835464Z"},{"marker":"1_1627314608.347064_70.1","last_update":"2021-07-26T15:50:08.347064Z"},{"marker":"1_1627314624.108949_55.2","last_update":"2021-07-26T15:50:24.108949Z"},{"marker":"1_1627314633.532812_87.1","last_update":"2021-07-26T15:50:33.532812Z"}] 2021-07-26T15:50:42.806 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:50:42.807 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.807 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:42.808 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:42.851 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:42.852 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:43.056 INFO:teuthology.orchestra.run.smithi067.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8946806699955972168},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314631.835464_26.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:31.835464Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314608.347064_70.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:08.347064Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314624.108949_55.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:24.108949Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314633.532812_87.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:33.532812Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:50:43.057 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:50:43.057 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_concurrent_versioned_object_incremental_sync ... ok 2021-07-26T15:50:43.098 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.100 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:43.137 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:43.137 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:43.307 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:43.346 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314643.098669_123.1","last_update":"2021-07-26T15:50:43.098669Z"},{"marker":"1_1627314613.226456_122.1","last_update":"2021-07-26T15:50:13.226456Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:43.346 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:43.347 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.347 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.348 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:43.389 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:43.572 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314643.098669_123.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:43.098669Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:43.573 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:43.573 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:43.574 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.574 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.575 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:43.615 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:43.616 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:43.787 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314643.098669_123.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:43.098669Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:43.788 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:43.835 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.836 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:43.836 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:43.877 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:43.877 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:44.079 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.18.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:44.079 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:44.080 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.081 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.082 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:44.125 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:44.125 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:44.317 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.18.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:44.317 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:44.318 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.319 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.319 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:44.362 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:44.362 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:44.552 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.18.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:44.553 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:44.553 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.554 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.555 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:44.597 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:44.597 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:44.775 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.18.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:44.776 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:44.777 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:44.778 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:44.816 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:44.817 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:45.006 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.13.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:45.007 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-14 2021-07-26T15:50:45.007 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.008 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.009 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:45.052 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:45.052 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:45.275 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.13.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:45.276 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-14 2021-07-26T15:50:45.277 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-14 zones={test-zone2, test-zone1} 2021-07-26T15:50:45.285 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:45.331 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:45.332 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:45.337 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:45.389 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:45.401 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:45.467 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:45.525 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-14 zones={test-zone2, test-zone1} 2021-07-26T15:50:45.537 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.537 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.538 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:45.577 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:45.577 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:45.752 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:45.784 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314645.540388_129.1","last_update":"2021-07-26T15:50:45.540388Z"},{"marker":"1_1627314613.226456_122.1","last_update":"2021-07-26T15:50:13.226456Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:45.785 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:45.786 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.786 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:45.787 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:45.829 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:45.829 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:46.007 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314645.540388_129.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:45.540388Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:46.008 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:46.008 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:46.009 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.010 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:46.046 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:46.213 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314645.540388_129.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:45.540388Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:46.213 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:46.268 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.269 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.270 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:46.322 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:46.565 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:46.566 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.21.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:46.567 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:46.567 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.568 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.569 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:46.610 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:46.611 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:46.802 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000003.21.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:46.803 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:46.803 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.804 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:46.805 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:46.847 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:46.848 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:47.056 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.21.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:47.056 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:47.057 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:47.057 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:47.058 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:47.103 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:47.103 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:47.289 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.21.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:47.290 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:47.291 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:47.291 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:47.292 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:47.331 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:47.331 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:47.513 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.17.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:47.514 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-14 2021-07-26T15:50:47.515 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:47.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:47.516 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:47.558 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:47.558 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:47.783 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000003.17.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:47.783 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-14 2021-07-26T15:50:47.784 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-14 zones={test-zone2, test-zone1} 2021-07-26T15:50:47.793 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:47.839 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:47.840 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:47.841 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:47.847 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:47.848 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:47.904 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:47.915 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:47.984 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:48.040 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:48.052 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:48.116 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:48.173 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-14 zones={test-zone2, test-zone1} 2021-07-26T15:50:48.182 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.183 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.184 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:48.220 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:48.221 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:48.388 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:48.419 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314648.186385_137.1","last_update":"2021-07-26T15:50:48.186385Z"},{"marker":"1_1627314613.226456_122.1","last_update":"2021-07-26T15:50:13.226456Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:48.419 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:48.421 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.421 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.422 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:48.464 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:48.464 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:48.623 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314648.186385_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:48.186385Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:48.624 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:48.624 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:48.625 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.626 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:48.664 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:48.664 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:48.839 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314648.186385_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:48.186385Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:48.840 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:48.887 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.888 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:48.890 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:48.937 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:49.128 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.25.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:49.129 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:49.130 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:49.131 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:49.133 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:49.176 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:49.176 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:49.360 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000005.25.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:49.361 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:49.364 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:49.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:49.367 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:49.409 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:49.409 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:49.604 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.25.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:49.605 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:49.606 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:49.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:49.608 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:49.654 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:49.654 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:49.826 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000005.25.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:49.827 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-14 2021-07-26T15:50:49.828 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:49.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-14', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:49.829 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-14 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:49.869 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:49.869 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:50.041 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000005.22.17"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:50.042 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-14 2021-07-26T15:50:50.043 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:50.043 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-14', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:50.044 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-14 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:50.100 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:50.101 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:50.292 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000005.22.17"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:50.294 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-14 2021-07-26T15:50:50.294 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-14 zones={test-zone2, test-zone1} 2021-07-26T15:50:50.307 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:50.355 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:50.356 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:50.356 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:50.362 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:50.363 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:50.416 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:50.430 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:50.496 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:50.556 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:50.568 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:50.629 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:50.688 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-14 zones={test-zone2, test-zone1} 2021-07-26T15:50:50.689 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_version_suspended_incremental_sync ... ok 2021-07-26T15:50:50.689 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-15 2021-07-26T15:50:50.716 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-16 2021-07-26T15:50:50.796 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:50.796 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:50.797 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:50.835 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:50.835 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:51.007 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:51.038 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314650.789514_153.1","last_update":"2021-07-26T15:50:50.789514Z"},{"marker":"1_1627314613.226456_122.1","last_update":"2021-07-26T15:50:13.226456Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:51.038 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:51.039 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:51.039 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:51.040 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:51.079 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:51.079 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:51.264 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314650.789514_153.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:50.789514Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:51.265 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:51.265 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:51.266 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:51.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:51.267 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:51.305 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:51.305 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:51.496 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314650.789514_153.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:50.789514Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:51.497 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:51.634 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:51.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:51.636 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:51.674 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:51.674 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:51.866 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.44.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:51.866 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-15 2021-07-26T15:50:51.867 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:51.867 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:51.868 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:51.911 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:51.912 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:52.112 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"nl-DfwiIGDqt9Q1RFr6GMFJBW7U77-U","ns":""},"count":1},"inc_marker":{"position":"00000000003.44.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:52.112 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-15 2021-07-26T15:50:52.113 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.114 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:52.158 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:52.351 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.44.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:52.352 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-15 2021-07-26T15:50:52.353 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.354 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.355 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:52.401 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:52.401 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:52.591 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.44.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:52.592 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-15 2021-07-26T15:50:52.592 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-15', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.593 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-15 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:52.633 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:52.634 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:52.817 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.41.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:52.817 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-15 2021-07-26T15:50:52.818 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-15', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:52.819 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-15 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:52.863 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:52.864 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:53.079 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"nl-DfwiIGDqt9Q1RFr6GMFJBW7U77-U","ns":""},"count":1},"inc_marker":{"position":"00000000002.41.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:53.080 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-15 2021-07-26T15:50:53.081 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-15 zones={test-zone2, test-zone1} 2021-07-26T15:50:53.089 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:53.135 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:53.136 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:53.137 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:53.142 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:53.143 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:53.196 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:53.204 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:53.214 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:53.279 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-15 zones={test-zone2, test-zone1} 2021-07-26T15:50:53.280 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:53.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:53.281 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:53.320 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:53.321 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:53.527 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.5.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:53.528 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-16 2021-07-26T15:50:53.528 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:53.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:53.530 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:53.572 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:53.572 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:53.762 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"n86wZJfTChp2usfeKXUzhbNppa1lksP","ns":""},"count":2},"inc_marker":{"position":"00000000002.5.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:53.763 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-16 2021-07-26T15:50:53.764 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:53.765 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:53.765 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:53.805 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:53.806 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:54.001 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.5.5"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:54.002 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-16 2021-07-26T15:50:54.003 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:54.003 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:54.004 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:54.047 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:54.242 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.5.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:54.243 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-16 2021-07-26T15:50:54.243 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:54.244 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-16', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:54.244 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-16 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:54.280 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:54.281 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:54.464 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.11.11"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:54.464 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-16 2021-07-26T15:50:54.465 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:54.465 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-16', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:54.466 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-16 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:54.510 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:54.511 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:54.724 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"n86wZJfTChp2usfeKXUzhbNppa1lksP","ns":""},"count":2},"inc_marker":{"position":"00000000003.11.11"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:54.725 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-16 2021-07-26T15:50:54.726 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-16 zones={test-zone2, test-zone1} 2021-07-26T15:50:54.734 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:54.783 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:54.784 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:54.784 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:54.791 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:54.791 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:54.844 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:54.855 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:54.866 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:54.931 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-16 zones={test-zone2, test-zone1} 2021-07-26T15:50:54.931 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_delete_marker_full_sync ... ok 2021-07-26T15:50:54.932 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-17 2021-07-26T15:50:54.957 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-18 2021-07-26T15:50:55.074 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:55.075 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:55.075 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:55.119 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:55.119 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:55.284 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:50:55.315 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314655.070296_176.1","last_update":"2021-07-26T15:50:55.070296Z"},{"marker":"1_1627314613.226456_122.1","last_update":"2021-07-26T15:50:13.226456Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:50:55.315 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:50:55.316 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:55.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:55.317 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:55.357 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:55.357 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:55.547 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314655.070296_176.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:55.070296Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:55.548 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:50:55.548 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:50:55.549 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:55.550 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:55.550 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:55.588 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:55.588 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:55.790 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314655.070296_176.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:50:55.070296Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:50:55.791 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:50:55.928 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:55.929 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:55.930 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:55.973 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:55.973 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:56.145 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.107.6"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:56.145 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-17 2021-07-26T15:50:56.146 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:56.146 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:56.147 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:56.193 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:56.193 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:56.400 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000003.107.6"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:56.400 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-17 2021-07-26T15:50:56.401 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:56.401 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:56.402 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:56.443 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:56.443 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:56.639 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000003.107.6"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:56.639 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-17 2021-07-26T15:50:56.640 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:56.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:56.641 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:56.685 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:56.685 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:56.892 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.107.6"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:56.893 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-17 2021-07-26T15:50:56.893 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:56.894 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-17', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:56.894 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-17 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:56.974 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:56.974 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:57.181 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.94.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:57.181 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-17 2021-07-26T15:50:57.182 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:57.182 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-17', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:57.183 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-17 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:57.229 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:57.435 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"null","ns":""},"count":1},"inc_marker":{"position":"00000000001.94.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:57.436 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-17 2021-07-26T15:50:57.436 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-17 zones={test-zone2, test-zone1} 2021-07-26T15:50:57.446 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:57.495 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:57.495 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:57.502 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:57.556 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:57.562 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-17 zones={test-zone2, test-zone1} 2021-07-26T15:50:57.563 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:57.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:57.566 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:57.606 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:57.607 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:57.796 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.15.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:57.797 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-18 2021-07-26T15:50:57.798 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:57.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:57.799 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:57.844 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:57.845 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:58.060 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"zXG-Xq3Ip7ge3w8WvkmbGUqNJoIuK66","ns":""},"count":1},"inc_marker":{"position":"00000000002.15.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:58.061 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-18 2021-07-26T15:50:58.062 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:58.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:58.063 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:58.106 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:58.107 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:58.297 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000002.15.12"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:58.298 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-18 2021-07-26T15:50:58.299 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:58.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:58.300 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:58.342 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:58.343 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:58.561 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.15.12"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:58.562 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-18 2021-07-26T15:50:58.563 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:58.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-18', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:58.564 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-18 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:58.643 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:58.643 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:58.835 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000004.29.8"},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T15:50:58.836 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-18 2021-07-26T15:50:58.837 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:58.838 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-18', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:50:58.839 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-18 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:50:58.885 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:50:58.886 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:50:59.103 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.29.8"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T15:50:59.104 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-18 2021-07-26T15:50:59.104 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-18 zones={test-zone2, test-zone1} 2021-07-26T15:50:59.113 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:50:59.159 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:59.159 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:59.160 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:50:59.165 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:59.166 DEBUG:tasks.rgw_multi.zone_rados:o=obj 2021-07-26T15:50:59.220 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj 2021-07-26T15:50:59.221 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_suspended_delete_marker_full_sync ... FAIL 2021-07-26T15:50:59.222 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-19 2021-07-26T15:50:59.247 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-20 2021-07-26T15:50:59.419 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_versioning ... ok 2021-07-26T15:50:59.420 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-21 2021-07-26T15:50:59.448 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-22 2021-07-26T15:50:59.623 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_acl ... ok 2021-07-26T15:50:59.624 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-23 2021-07-26T15:50:59.651 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-24 2021-07-26T15:51:00.815 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_cors ... ok 2021-07-26T15:51:00.816 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-25 2021-07-26T15:51:00.848 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-26 2021-07-26T15:51:00.895 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:00.896 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:00.896 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:00.935 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:00.935 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:01.103 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:51:01.135 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314660.881070_230.1","last_update":"2021-07-26T15:51:00.881070Z"},{"marker":"1_1627314613.226456_122.1","last_update":"2021-07-26T15:50:13.226456Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:51:01.136 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:51:01.138 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:01.139 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:01.139 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:01.178 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:01.179 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:01.381 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314660.881070_230.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:51:00.881070Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:51:01.382 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:51:01.382 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:51:01.383 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:01.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:01.384 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:01.461 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:01.461 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:01.652 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314660.881070_230.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:51:00.881070Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:51:01.652 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:51:01.874 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_delete_notempty ... ok 2021-07-26T15:51:01.875 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-27 2021-07-26T15:51:01.902 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-28 2021-07-26T15:51:01.950 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:01.950 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:01.951 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:01.991 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:01.992 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:02.156 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=1199c4c8-86c9-46c2-aada-9f8c593dcbf1 2021-07-26T15:51:02.186 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314661.936828_241.1","last_update":"2021-07-26T15:51:01.936828Z"},{"marker":"1_1627314613.226456_122.1","last_update":"2021-07-26T15:50:13.226456Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:51:02.191 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:51:02.192 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:02.192 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:02.193 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:02.231 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:02.231 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:02.437 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314661.936828_241.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:51:01.936828Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:51:02.437 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:51:02.438 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:51:02.439 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:02.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:51:02.441 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:51:02.525 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:02.525 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:02.687 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","realm_epoch":2},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314661.936828_241.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:51:01.936828Z","realm_epoch":2}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:51:02.688 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:51:02.689 DEBUG:tasks.rgw.c2.client.1:waiting for process to exit 2021-07-26T15:51:02.689 INFO:teuthology.orchestra.run:waiting for 300 2021-07-26T15:51:02.690 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T15:51:02.685+0000 7f02954b6700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 18919) UID: 0 2021-07-26T15:51:02.690 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T15:51:02.685+0000 7f029908f980 -1 shutting down 2021-07-26T15:51:07.425 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 is failed for ~0s 2021-07-26T15:51:08.792 INFO:tasks.rgw.c2.client.1:Stopped 2021-07-26T15:51:08.793 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:08.793 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:08.794 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:51:08.834 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:08.834 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:08.862 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:51:08.857+0000 7fdd6ed7b980 0 NOTICE: overriding master zone: 6ccbe144-1255-4ce6-93aa-fdbfdac85106 2021-07-26T15:51:08.866 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:51:08.861+0000 7fdd6ed7b980 0 failed reading obj info from .rgw.root:zone_info.6ccbe144-1255-4ce6-93aa-fdbfdac85106: (2) No such file or directory 2021-07-26T15:51:08.866 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:51:08.861+0000 7fdd6ed7b980 0 WARNING: could not read zone params for zone id=6ccbe144-1255-4ce6-93aa-fdbfdac85106 name=test-zone1 2021-07-26T15:51:08.878 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4"} 2021-07-26T15:51:08.879 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:08.879 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:51:08.880 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:51:08.957 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:51:08.957 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:51:09.228 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"720812a8-530e-4f10-b564-196342c4e7e0","epoch":1,"predecessor_uuid":"1199c4c8-86c9-46c2-aada-9f8c593dcbf1","sync_status":["1_1627314661.936828_241.1","1_1627314613.226456_122.1","",""],"period_map":{"id":"720812a8-530e-4f10-b564-196342c4e7e0","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","val":1630018487},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639}]},"master_zonegroup":"test-zonegroup","master_zone":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":3} 2021-07-26T15:51:09.228 INFO:rgw_multi.tests:Set master zone=test-zone2, waiting 60s for reconfiguration.. 2021-07-26T15:51:13.031 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.1 has been restored 2021-07-26T15:52:09.229 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-29 2021-07-26T15:52:09.284 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-30 2021-07-26T15:52:09.314 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:09.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:09.316 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:09.356 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:09.356 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:09.530 INFO:teuthology.orchestra.run.smithi087.stderr:No --period given, using current period=720812a8-530e-4f10-b564-196342c4e7e0 2021-07-26T15:52:09.560 INFO:teuthology.orchestra.run.smithi087.stdout:[{"marker":"1_1627314729.313225_187.1","last_update":"2021-07-26T15:52:09.313225Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:52:09.561 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone1 2021-07-26T15:52:09.562 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:09.563 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:52:09.564 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 metadata sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:52:09.608 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:09.608 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:09.799 INFO:teuthology.orchestra.run.smithi067.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"720812a8-530e-4f10-b564-196342c4e7e0","realm_epoch":3},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314729.313225_187.1","next_step_marker":"","total_entries":55,"pos":0,"timestamp":"2021-07-26T15:52:09.313225Z","realm_epoch":3}},{"key":1,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":3}}]},"full_sync":{"total":55,"complete":55}} 2021-07-26T15:52:09.800 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone1 2021-07-26T15:52:09.801 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:52:09.801 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'modify', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--master', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:52:09.802 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone modify --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --master --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:52:09.838 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:09.838 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:09.866 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:52:09.872+0000 7fc214c90980 0 NOTICE: overriding master zone: 0e23b0cd-74e4-432d-b357-04b2074bdc2e 2021-07-26T15:52:09.867 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:52:09.872+0000 7fc214c90980 0 failed reading obj info from .rgw.root:zone_info.0e23b0cd-74e4-432d-b357-04b2074bdc2e: (2) No such file or directory 2021-07-26T15:52:09.868 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:52:09.872+0000 7fc214c90980 0 WARNING: could not read zone params for zone id=0e23b0cd-74e4-432d-b357-04b2074bdc2e name=test-zone2 2021-07-26T15:52:09.868 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:52:09.872+0000 7fc214c90980 0 failed reading obj info from .rgw.root:zone_info.10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c: (2) No such file or directory 2021-07-26T15:52:09.868 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:52:09.872+0000 7fc214c90980 0 WARNING: could not read zone params for zone id=10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c name=test-zone3 2021-07-26T15:52:09.881 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","domain_root":"test-zone1.rgw.meta:root","control_pool":"test-zone1.rgw.control","gc_pool":"test-zone1.rgw.log:gc","lc_pool":"test-zone1.rgw.log:lc","log_pool":"test-zone1.rgw.log","intent_log_pool":"test-zone1.rgw.log:intent","usage_log_pool":"test-zone1.rgw.log:usage","roles_pool":"test-zone1.rgw.meta:roles","reshard_pool":"test-zone1.rgw.log:reshard","user_keys_pool":"test-zone1.rgw.meta:users.keys","user_email_pool":"test-zone1.rgw.meta:users.email","user_swift_pool":"test-zone1.rgw.meta:users.swift","user_uid_pool":"test-zone1.rgw.meta:users.uid","otp_pool":"test-zone1.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone1.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone1.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone1.rgw.buckets.non-ec","index_type":0}}],"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4"} 2021-07-26T15:52:09.882 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:52:09.883 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:52:09.883 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:52:09.963 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:52:09.963 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:52:10.228 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","epoch":1,"predecessor_uuid":"720812a8-530e-4f10-b564-196342c4e7e0","sync_status":["1_1627314729.313225_187.1","","",""],"period_map":{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","val":1630018487},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:52:10.229 INFO:rgw_multi.tests:Set master zone=test-zone1, waiting 60s for reconfiguration.. 2021-07-26T15:53:10.232 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-31 2021-07-26T15:53:10.272 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-32 2021-07-26T15:53:10.325 INFO:tasks.rgw.c2.client.1:Restarting daemon 2021-07-26T15:53:10.326 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=8001' -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm | sudo tee /var/log/ceph/rgw.c2.client.1.stdout 2>&1 2021-07-26T15:53:10.328 INFO:tasks.rgw.c2.client.1:Started 2021-07-26T15:53:10.329 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:8001 2021-07-26T15:53:10.344 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:53:10.344 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:53:10.354 DEBUG:teuthology.orchestra.run:got remote process result: 7 2021-07-26T15:53:10.355 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2021-07-26T15:53:10.355 INFO:teuthology.orchestra.run.smithi087.stderr:curl: (7) Failed to connect to smithi087.front.sepia.ceph.com port 8001: Connection refused 2021-07-26T15:53:11.357 DEBUG:teuthology.orchestra.run.smithi087:> curl http://smithi087.front.sepia.ceph.com:8001 2021-07-26T15:53:11.374 INFO:teuthology.orchestra.run.smithi087.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2021-07-26T15:53:11.374 INFO:teuthology.orchestra.run.smithi087.stderr: Dload Upload Total Spent Left Speed 2021-07-26T15:53:11.376 INFO:teuthology.orchestra.run.smithi087.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 134 100 134 0 0 130k 0 --:--:-- --:--:-- --:--:-- 130k 2021-07-26T15:53:11.377 INFO:teuthology.orchestra.run.smithi087.stdout:{"Code":"MethodNotAllowed","RequestId":"tx000000000000000000001-0060feda67-13a6-test-zone3","HostId":"13a6-test-zone3-test-zonegroup"} 2021-07-26T15:53:11.377 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:11.378 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:11.378 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:11.419 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:11.419 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:11.591 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T15:53:11.636 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314790.305792_127.1","last_update":"2021-07-26T15:53:10.305792Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:53:11.637 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:53:11.637 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:11.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:11.638 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:11.679 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:11.680 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:11.842 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314790.305792_127.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:10.305792Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:53:11.843 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:53:11.844 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:53:11.844 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:11.845 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:11.846 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:11.885 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:11.885 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:12.072 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314790.305792_127.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:10.305792Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:53:12.073 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:53:12.074 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-27 zones={test-zone2, test-zone1} 2021-07-26T15:53:12.089 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:12.140 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:12.204 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-27 zones={test-zone2, test-zone1} 2021-07-26T15:53:12.204 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-27 zones={test-zone1, test-zone2} 2021-07-26T15:53:12.214 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:12.263 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:12.321 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-27 zones={test-zone1, test-zone2} 2021-07-26T15:53:12.322 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-28 zones={test-zone2, test-zone1} 2021-07-26T15:53:12.336 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:12.383 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:12.440 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-28 zones={test-zone2, test-zone1} 2021-07-26T15:53:12.440 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-28 zones={test-zone1, test-zone2} 2021-07-26T15:53:12.449 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:12.499 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:12.555 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-28 zones={test-zone1, test-zone2} 2021-07-26T15:53:12.555 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-29 zones={test-zone2, test-zone1} 2021-07-26T15:53:12.563 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:12.611 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:12.668 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-29 zones={test-zone2, test-zone1} 2021-07-26T15:53:12.669 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-29 zones={test-zone1, test-zone2} 2021-07-26T15:53:12.679 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:12.727 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:12.788 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-29 zones={test-zone1, test-zone2} 2021-07-26T15:53:12.789 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-30 zones={test-zone2, test-zone1} 2021-07-26T15:53:12.798 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:12.847 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:12.909 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-30 zones={test-zone2, test-zone1} 2021-07-26T15:53:12.910 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-30 zones={test-zone1, test-zone2} 2021-07-26T15:53:12.919 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:12.967 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:13.024 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-30 zones={test-zone1, test-zone2} 2021-07-26T15:53:13.025 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-31 zones={test-zone2, test-zone1} 2021-07-26T15:53:13.034 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:13.079 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:13.141 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-31 zones={test-zone2, test-zone1} 2021-07-26T15:53:13.141 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-31 zones={test-zone1, test-zone2} 2021-07-26T15:53:13.150 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:13.195 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:13.252 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-31 zones={test-zone1, test-zone2} 2021-07-26T15:53:13.253 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-32 zones={test-zone2, test-zone1} 2021-07-26T15:53:13.263 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:13.315 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:13.374 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-32 zones={test-zone2, test-zone1} 2021-07-26T15:53:13.375 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-32 zones={test-zone1, test-zone2} 2021-07-26T15:53:13.383 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T15:53:13.431 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T15:53:13.489 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-32 zones={test-zone1, test-zone2} 2021-07-26T15:53:13.491 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:13.491 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:13.493 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 1199c4c8-86c9-46c2-aada-9f8c593dcbf1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:13.533 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:13.534 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:13.733 INFO:teuthology.orchestra.run.smithi067.stdout:[{"id":"1_1627314478.700993_29.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:47:58.700993213Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D4bNoxPZQXKdemSmOEIfdDg","ver":1},"status":{"status":"write"}}},{"id":"1_1627314478.708636_31.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:47:58.708636223Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D4bNoxPZQXKdemSmOEIfdDg","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.243124_32.1","section":"bucket.instance","name":"ldpzkr-10:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.14","timestamp":"2021-07-26T15:50:13.243124319Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CHYdvBfWWG8j9J8iMVOLrxa","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.249182_44.1","section":"bucket.instance","name":"ldpzkr-10:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.14","timestamp":"2021-07-26T15:50:13.249182965Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CHYdvBfWWG8j9J8iMVOLrxa","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.251100_45.1","section":"bucket","name":"ldpzkr-10","timestamp":"2021-07-26T15:50:13.251100565Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6M8ivcoEM7shIa2D0ygsHo","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.256073_46.1","section":"bucket","name":"ldpzkr-10","timestamp":"2021-07-26T15:50:13.256073019Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6M8ivcoEM7shIa2D0ygsHo","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.245089_47.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.245089086Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.250248_55.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.250248184Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.251835_56.1","section":"bucket","name":"ldpzkr-11","timestamp":"2021-07-26T15:50:18.251835547Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Rh8NDZPZQ5JynPmOn3DfvM7","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.258309_57.1","section":"bucket","name":"ldpzkr-11","timestamp":"2021-07-26T15:50:18.258309198Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Rh8NDZPZQ5JynPmOn3DfvM7","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.280304_58.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.280304412Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.286025_59.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.286025440Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.288319_60.1","section":"bucket","name":"ldpzkr-12","timestamp":"2021-07-26T15:50:18.288319544Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ya8YLY_3VOeIkbONZ3E_Nmi","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.293209_61.1","section":"bucket","name":"ldpzkr-12","timestamp":"2021-07-26T15:50:18.293209754Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ya8YLY_3VOeIkbONZ3E_Nmi","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.317905_62.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.317905206Z","data":{"read_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":2},"status":{"status":"write"}}},{"id":"1_1627314618.325182_63.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.325182597Z","data":{"read_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314618.330756_64.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.330756281Z","data":{"read_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":2},"status":{"status":"write"}}},{"id":"1_1627314618.337553_65.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.337553748Z","data":{"read_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314630.924578_66.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.924578167Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"status":{"status":"write"}}},{"id":"1_1627314630.929934_83.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.929934793Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314630.931834_84.1","section":"bucket","name":"ldpzkr-13","timestamp":"2021-07-26T15:50:30.931834061Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBaActxDLrZMRKg2ft0tf57","ver":1},"status":{"status":"write"}}},{"id":"1_1627314630.937761_85.1","section":"bucket","name":"ldpzkr-13","timestamp":"2021-07-26T15:50:30.937761177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBaActxDLrZMRKg2ft0tf57","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314630.943831_86.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.943831019Z","data":{"read_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":2},"status":{"status":"write"}}},{"id":"1_1627314630.950552_87.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.950552996Z","data":{"read_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314643.077874_114.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:43.077874341Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"status":{"status":"write"}}},{"id":"1_1627314643.086997_121.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:43.086997864Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314643.089501_122.1","section":"bucket","name":"ldpzkr-14","timestamp":"2021-07-26T15:50:43.089501995Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_n2jdXkRYGAB8lNNgfNQ-OjS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314643.098669_123.1","section":"bucket","name":"ldpzkr-14","timestamp":"2021-07-26T15:50:43.098669117Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_n2jdXkRYGAB8lNNgfNQ-OjS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314645.533369_124.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:45.533369001Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"status":{"status":"write"}}},{"id":"1_1627314645.540388_129.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:45.540388460Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314648.180923_134.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:48.180923290Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":3},"status":{"status":"write"}}},{"id":"1_1627314648.186385_137.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:48.186385294Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314650.706781_138.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.706781479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.711421_143.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.711421950Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.713734_144.1","section":"bucket","name":"ldpzkr-15","timestamp":"2021-07-26T15:50:50.713734507Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_z_4iD1kD4zC8z5aa8hvum66","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.718384_145.1","section":"bucket","name":"ldpzkr-15","timestamp":"2021-07-26T15:50:50.718384721Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_z_4iD1kD4zC8z5aa8hvum66","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.734786_146.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.734786911Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.739675_147.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.739675997Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.741475_148.1","section":"bucket","name":"ldpzkr-16","timestamp":"2021-07-26T15:50:50.741475869Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nUsCJ9uq31V5QxtFTswld61","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.745743_149.1","section":"bucket","name":"ldpzkr-16","timestamp":"2021-07-26T15:50:50.745743051Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nUsCJ9uq31V5QxtFTswld61","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.767356_150.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.767356531Z","data":{"read_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":2},"status":{"status":"write"}}},{"id":"1_1627314650.774176_151.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.774176682Z","data":{"read_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314650.781682_152.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.781682881Z","data":{"read_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":2},"status":{"status":"write"}}},{"id":"1_1627314650.789514_153.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.789514878Z","data":{"read_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314654.949415_154.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:54.949415177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.954908_162.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:54.954908009Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314654.956473_163.1","section":"bucket","name":"ldpzkr-17","timestamp":"2021-07-26T15:50:54.956473640Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8r1bq-j62bn-gIA_jutcOtL","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.960341_164.1","section":"bucket","name":"ldpzkr-17","timestamp":"2021-07-26T15:50:54.960341832Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8r1bq-j62bn-gIA_jutcOtL","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314654.975203_165.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:54.975203993Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.980157_166.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:54.980157796Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314654.981860_167.1","section":"bucket","name":"ldpzkr-18","timestamp":"2021-07-26T15:50:54.981860530Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6MP46g7sL15CYF0kotVrN-","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.986750_168.1","section":"bucket","name":"ldpzkr-18","timestamp":"2021-07-26T15:50:54.986750756Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6MP46g7sL15CYF0kotVrN-","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314655.019818_169.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.019818491Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"status":{"status":"write"}}},{"id":"1_1627314655.028091_170.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.028091781Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314655.032524_171.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.032524796Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":3},"status":{"status":"write"}}},{"id":"1_1627314655.039220_172.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.039220558Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314655.046008_173.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.046008507Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"status":{"status":"write"}}},{"id":"1_1627314655.052682_174.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.052682998Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314655.063174_175.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.063174559Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":3},"status":{"status":"write"}}},{"id":"1_1627314655.070296_176.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.070296374Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314659.238996_177.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.238996030Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.243533_185.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.243533949Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.245091_186.1","section":"bucket","name":"ldpzkr-19","timestamp":"2021-07-26T15:50:59.245091609Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S-M2I7GUc5SnfNeNl4Hqa5g","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.249579_187.1","section":"bucket","name":"ldpzkr-19","timestamp":"2021-07-26T15:50:59.249579334Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S-M2I7GUc5SnfNeNl4Hqa5g","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.269938_188.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.269938912Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.276000_189.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.276000057Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.277780_190.1","section":"bucket","name":"ldpzkr-20","timestamp":"2021-07-26T15:50:59.277780826Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8YTJaLLwUmfgXcPKBByxFgV","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.283509_191.1","section":"bucket","name":"ldpzkr-20","timestamp":"2021-07-26T15:50:59.283509006Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8YTJaLLwUmfgXcPKBByxFgV","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.306956_192.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.306956599Z","data":{"read_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.313863_193.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.313863802Z","data":{"read_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.364584_194.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.364584148Z","data":{"read_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.372588_195.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.372588226Z","data":{"read_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.439181_196.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.439181344Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.443838_197.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.443838384Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.445318_198.1","section":"bucket","name":"ldpzkr-21","timestamp":"2021-07-26T15:50:59.445318213Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_26VTESQsQpzIfReHYUyXYB-","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.450250_199.1","section":"bucket","name":"ldpzkr-21","timestamp":"2021-07-26T15:50:59.450250693Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_26VTESQsQpzIfReHYUyXYB-","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.469755_200.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.469755872Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.476715_201.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.476715367Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.478788_202.1","section":"bucket","name":"ldpzkr-22","timestamp":"2021-07-26T15:50:59.478788207Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XfNKsrf3-iM0-gjiyNs9thW","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.485056_203.1","section":"bucket","name":"ldpzkr-22","timestamp":"2021-07-26T15:50:59.485056774Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XfNKsrf3-iM0-gjiyNs9thW","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.511027_204.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.511027906Z","data":{"read_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.519050_205.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.519050696Z","data":{"read_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.569930_206.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.569930114Z","data":{"read_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.577836_207.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.577836116Z","data":{"read_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.643371_208.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.643371103Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.647958_209.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.647958317Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.649706_210.1","section":"bucket","name":"ldpzkr-23","timestamp":"2021-07-26T15:50:59.649706644Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D1iVS-JVde1n5j3VJLe3kDH","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.653727_211.1","section":"bucket","name":"ldpzkr-23","timestamp":"2021-07-26T15:50:59.653727676Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D1iVS-JVde1n5j3VJLe3kDH","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.669325_213.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:50:59.669325317Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.674543_214.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:50:59.674543032Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.676480_215.1","section":"bucket","name":"ldpzkr-24","timestamp":"2021-07-26T15:50:59.676480975Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P24-K8SpoKjzvL7PtSl-lh2","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.680725_216.1","section":"bucket","name":"ldpzkr-24","timestamp":"2021-07-26T15:50:59.680725147Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P24-K8SpoKjzvL7PtSl-lh2","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.703821_217.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.703821654Z","data":{"read_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.710419_218.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.710419718Z","data":{"read_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314660.761078_221.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:51:00.761078944Z","data":{"read_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":2},"status":{"status":"write"}}},{"id":"1_1627314660.769698_222.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:51:00.769698866Z","data":{"read_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314660.837923_223.1","section":"bucket.instance","name":"ldpzkr-25:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.29","timestamp":"2021-07-26T15:51:00.837923878Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q0usZEZ-LWfFxCvVGVVuT-H","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.841807_224.1","section":"bucket.instance","name":"ldpzkr-25:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.29","timestamp":"2021-07-26T15:51:00.841807315Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q0usZEZ-LWfFxCvVGVVuT-H","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314660.843189_225.1","section":"bucket","name":"ldpzkr-25","timestamp":"2021-07-26T15:51:00.843189256Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XMm664KMYovNwj_0wnJ2ctB","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.847087_226.1","section":"bucket","name":"ldpzkr-25","timestamp":"2021-07-26T15:51:00.847087496Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XMm664KMYovNwj_0wnJ2ctB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314660.870361_227.1","section":"bucket.instance","name":"ldpzkr-26:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.30","timestamp":"2021-07-26T15:51:00.870361553Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BLWqcxxbz8-hlAUzBx7pm_","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.874973_228.1","section":"bucket.instance","name":"ldpzkr-26:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.30","timestamp":"2021-07-26T15:51:00.874973673Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BLWqcxxbz8-hlAUzBx7pm_","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314660.876645_229.1","section":"bucket","name":"ldpzkr-26","timestamp":"2021-07-26T15:51:00.876645436Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tbNoLcCHQR8S_qrqEuD0Cnd","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.881070_230.1","section":"bucket","name":"ldpzkr-26","timestamp":"2021-07-26T15:51:00.881070871Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tbNoLcCHQR8S_qrqEuD0Cnd","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.890488_234.1","section":"bucket.instance","name":"ldpzkr-27:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.31","timestamp":"2021-07-26T15:51:01.890488478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XhuTFg08GcVuU8186XSItcR","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.895004_235.1","section":"bucket.instance","name":"ldpzkr-27:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.31","timestamp":"2021-07-26T15:51:01.895004076Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XhuTFg08GcVuU8186XSItcR","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.896887_236.1","section":"bucket","name":"ldpzkr-27","timestamp":"2021-07-26T15:51:01.896887362Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iBUiXG9JriyJvZCvwgmLPz1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.901530_237.1","section":"bucket","name":"ldpzkr-27","timestamp":"2021-07-26T15:51:01.901530492Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iBUiXG9JriyJvZCvwgmLPz1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.922063_238.1","section":"bucket.instance","name":"ldpzkr-28:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.32","timestamp":"2021-07-26T15:51:01.922063058Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g0VJkRq6PKDCpGcSUesB5cE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.926724_239.1","section":"bucket.instance","name":"ldpzkr-28:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.32","timestamp":"2021-07-26T15:51:01.926724028Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g0VJkRq6PKDCpGcSUesB5cE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.929014_240.1","section":"bucket","name":"ldpzkr-28","timestamp":"2021-07-26T15:51:01.929014693Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZGL2gWFqkcLfPZU66DjgzEm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.936828_241.1","section":"bucket","name":"ldpzkr-28","timestamp":"2021-07-26T15:51:01.936828719Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZGL2gWFqkcLfPZU66DjgzEm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.606025_49.1","section":"bucket.instance","name":"ldpzkr-1:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.1","timestamp":"2021-07-26T15:49:59.606025152Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P3weeO8PelBz2nGVxFxHgJa","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.611284_53.1","section":"bucket.instance","name":"ldpzkr-1:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.1","timestamp":"2021-07-26T15:49:59.611284661Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P3weeO8PelBz2nGVxFxHgJa","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.613140_54.1","section":"bucket","name":"ldpzkr-1","timestamp":"2021-07-26T15:49:59.613140868Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uDmWXoUipTim55z7US-i1Fm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.617693_55.1","section":"bucket","name":"ldpzkr-1","timestamp":"2021-07-26T15:49:59.617693844Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uDmWXoUipTim55z7US-i1Fm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.641095_56.1","section":"bucket.instance","name":"ldpzkr-2:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.2","timestamp":"2021-07-26T15:49:59.641095518Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_w1F3bHEYDDu7vnfk2MC1Gav","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.646995_57.1","section":"bucket.instance","name":"ldpzkr-2:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.2","timestamp":"2021-07-26T15:49:59.646995383Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_w1F3bHEYDDu7vnfk2MC1Gav","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.649112_58.1","section":"bucket","name":"ldpzkr-2","timestamp":"2021-07-26T15:49:59.649112762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X3NJYXL8XNpdlVxkT9Q5Llc","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.655223_59.1","section":"bucket","name":"ldpzkr-2","timestamp":"2021-07-26T15:49:59.655223546Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X3NJYXL8XNpdlVxkT9Q5Llc","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.433234_60.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.3","timestamp":"2021-07-26T15:50:04.433234187Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cSZnlFPZ9OLVBWRPaq6UUA4","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.438430_62.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.3","timestamp":"2021-07-26T15:50:04.438430685Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cSZnlFPZ9OLVBWRPaq6UUA4","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.440332_63.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:04.440332578Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HTQeOW0XnTrIcA5-RDtuZeq","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.449641_64.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:04.449641142Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HTQeOW0XnTrIcA5-RDtuZeq","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.471922_66.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.4","timestamp":"2021-07-26T15:50:04.471922414Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MPmZnfHysmL6ou2IZBjAdSH","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.475995_67.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.4","timestamp":"2021-07-26T15:50:04.475995581Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MPmZnfHysmL6ou2IZBjAdSH","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.477405_68.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:04.477405640Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOwmayxsYiHx4VUOeqk71Si","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.481638_69.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:04.481638857Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOwmayxsYiHx4VUOeqk71Si","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.275314_72.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.5","timestamp":"2021-07-26T15:50:05.275314934Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B3GwZXZoR9ACx5K5b1m-Dm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.280572_73.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.5","timestamp":"2021-07-26T15:50:05.280572462Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B3GwZXZoR9ACx5K5b1m-Dm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.282741_74.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.282741415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_93XmHdXEdiuA-BdOESWcs7m","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.287119_75.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.287119608Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_93XmHdXEdiuA-BdOESWcs7m","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314605.314084_77.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.6","timestamp":"2021-07-26T15:50:05.314084749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ka6SOFFSNH-DQYh5ysJzWzP","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.318954_78.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.6","timestamp":"2021-07-26T15:50:05.318954457Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ka6SOFFSNH-DQYh5ysJzWzP","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.320814_79.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.320814541Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_viazGXWENU_GxWz_zhx9itE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.324072_80.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.324072030Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_viazGXWENU_GxWz_zhx9itE","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314605.352256_81.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.7","timestamp":"2021-07-26T15:50:05.352256318Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9eez3dLlpqJGl0U2ixQYVBy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.360599_82.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.7","timestamp":"2021-07-26T15:50:05.360599989Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9eez3dLlpqJGl0U2ixQYVBy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.363400_83.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.363400118Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GEuuXor-U89rfJI5tTZJR0S","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.367998_84.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.367998724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GEuuXor-U89rfJI5tTZJR0S","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314605.416977_86.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.8","timestamp":"2021-07-26T15:50:05.416977185Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Ab-VI7aBOhJSGG1CI57-x4","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.424456_87.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.8","timestamp":"2021-07-26T15:50:05.424456010Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Ab-VI7aBOhJSGG1CI57-x4","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.426356_88.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.426356320Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ox9y1KGUJz641oNHtdQfsCJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.429662_89.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.429662676Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ox9y1KGUJz641oNHtdQfsCJ","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314606.258337_93.1","section":"bucket.instance","name":"ldpzkr-5:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.9","timestamp":"2021-07-26T15:50:06.258337801Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X7RHz0WW2_FEDyRwAUA1ACj","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.263690_94.1","section":"bucket.instance","name":"ldpzkr-5:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.9","timestamp":"2021-07-26T15:50:06.263690643Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X7RHz0WW2_FEDyRwAUA1ACj","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314606.265567_95.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:06.265567855Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.272020_96.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:06.272020492Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314606.292633_97.1","section":"bucket.instance","name":"ldpzkr-6:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.10","timestamp":"2021-07-26T15:50:06.292633415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7ov6MLPnWen_c4DQk3iDXRE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.297834_98.1","section":"bucket.instance","name":"ldpzkr-6:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.10","timestamp":"2021-07-26T15:50:06.297834416Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7ov6MLPnWen_c4DQk3iDXRE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314606.299936_99.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:06.299936007Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.306561_100.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:06.306561199Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.082877_101.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:07.082877332Z","data":{"read_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":2},"status":{"status":"remove"}}},{"id":"1_1627314607.088730_103.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:07.088730582Z","data":{"read_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314607.129399_104.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:07.129399418Z","data":{"read_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":2},"status":{"status":"remove"}}},{"id":"1_1627314607.134933_105.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:07.134933308Z","data":{"read_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314607.913587_106.1","section":"bucket.instance","name":"ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11","timestamp":"2021-07-26T15:50:07.913587580Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uziwhsZeWnGryKQlsrnPI7o","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.919215_108.1","section":"bucket.instance","name":"ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11","timestamp":"2021-07-26T15:50:07.919215749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uziwhsZeWnGryKQlsrnPI7o","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.921025_109.1","section":"bucket","name":"ldpzkr-7","timestamp":"2021-07-26T15:50:07.921025552Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SeWKLNwX2b9MlpRrmKmAZ2S","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.927503_110.1","section":"bucket","name":"ldpzkr-7","timestamp":"2021-07-26T15:50:07.927503571Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SeWKLNwX2b9MlpRrmKmAZ2S","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.945419_111.1","section":"bucket.instance","name":"ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12","timestamp":"2021-07-26T15:50:07.945419467Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-k-eP3PMGEEpNWXsELxcpXz","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.950522_112.1","section":"bucket.instance","name":"ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12","timestamp":"2021-07-26T15:50:07.950522818Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-k-eP3PMGEEpNWXsELxcpXz","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.952243_113.1","section":"bucket","name":"ldpzkr-8","timestamp":"2021-07-26T15:50:07.952243991Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bRcQV_NBIHJ6zoXN1N2e4j1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.956772_114.1","section":"bucket","name":"ldpzkr-8","timestamp":"2021-07-26T15:50:07.956772749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bRcQV_NBIHJ6zoXN1N2e4j1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.216144_115.1","section":"bucket.instance","name":"ldpzkr-9:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.13","timestamp":"2021-07-26T15:50:13.216144820Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iK2vCG_AvVJ1Jk1iPVXy9v1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.220881_120.1","section":"bucket.instance","name":"ldpzkr-9:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.13","timestamp":"2021-07-26T15:50:13.220881647Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iK2vCG_AvVJ1Jk1iPVXy9v1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.222477_121.1","section":"bucket","name":"ldpzkr-9","timestamp":"2021-07-26T15:50:13.222477718Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lwiw_VRx2v3BRFkutzz7l-U","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.226456_122.1","section":"bucket","name":"ldpzkr-9","timestamp":"2021-07-26T15:50:13.226456798Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lwiw_VRx2v3BRFkutzz7l-U","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:53:13.735 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:13.736 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:13.736 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 1199c4c8-86c9-46c2-aada-9f8c593dcbf1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:13.774 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:13.774 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:13.982 INFO:teuthology.orchestra.run.smithi087.stdout:[{"id":"1_1627314478.700993_29.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:47:58.700993213Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D4bNoxPZQXKdemSmOEIfdDg","ver":1},"status":{"status":"write"}}},{"id":"1_1627314478.708636_31.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:47:58.708636223Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D4bNoxPZQXKdemSmOEIfdDg","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.243124_32.1","section":"bucket.instance","name":"ldpzkr-10:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.14","timestamp":"2021-07-26T15:50:13.243124319Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CHYdvBfWWG8j9J8iMVOLrxa","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.249182_44.1","section":"bucket.instance","name":"ldpzkr-10:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.14","timestamp":"2021-07-26T15:50:13.249182965Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CHYdvBfWWG8j9J8iMVOLrxa","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.251100_45.1","section":"bucket","name":"ldpzkr-10","timestamp":"2021-07-26T15:50:13.251100565Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6M8ivcoEM7shIa2D0ygsHo","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.256073_46.1","section":"bucket","name":"ldpzkr-10","timestamp":"2021-07-26T15:50:13.256073019Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6M8ivcoEM7shIa2D0ygsHo","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.245089_47.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.245089086Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.250248_55.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.250248184Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.251835_56.1","section":"bucket","name":"ldpzkr-11","timestamp":"2021-07-26T15:50:18.251835547Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Rh8NDZPZQ5JynPmOn3DfvM7","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.258309_57.1","section":"bucket","name":"ldpzkr-11","timestamp":"2021-07-26T15:50:18.258309198Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Rh8NDZPZQ5JynPmOn3DfvM7","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.280304_58.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.280304412Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.286025_59.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.286025440Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.288319_60.1","section":"bucket","name":"ldpzkr-12","timestamp":"2021-07-26T15:50:18.288319544Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ya8YLY_3VOeIkbONZ3E_Nmi","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.293209_61.1","section":"bucket","name":"ldpzkr-12","timestamp":"2021-07-26T15:50:18.293209754Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ya8YLY_3VOeIkbONZ3E_Nmi","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.317905_62.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.317905206Z","data":{"read_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":2},"status":{"status":"write"}}},{"id":"1_1627314618.325182_63.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.325182597Z","data":{"read_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314618.330756_64.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.330756281Z","data":{"read_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":2},"status":{"status":"write"}}},{"id":"1_1627314618.337553_65.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.337553748Z","data":{"read_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314630.924578_66.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.924578167Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"status":{"status":"write"}}},{"id":"1_1627314630.929934_83.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.929934793Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314630.931834_84.1","section":"bucket","name":"ldpzkr-13","timestamp":"2021-07-26T15:50:30.931834061Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBaActxDLrZMRKg2ft0tf57","ver":1},"status":{"status":"write"}}},{"id":"1_1627314630.937761_85.1","section":"bucket","name":"ldpzkr-13","timestamp":"2021-07-26T15:50:30.937761177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBaActxDLrZMRKg2ft0tf57","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314630.943831_86.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.943831019Z","data":{"read_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":2},"status":{"status":"write"}}},{"id":"1_1627314630.950552_87.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.950552996Z","data":{"read_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314643.077874_114.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:43.077874341Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"status":{"status":"write"}}},{"id":"1_1627314643.086997_121.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:43.086997864Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314643.089501_122.1","section":"bucket","name":"ldpzkr-14","timestamp":"2021-07-26T15:50:43.089501995Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_n2jdXkRYGAB8lNNgfNQ-OjS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314643.098669_123.1","section":"bucket","name":"ldpzkr-14","timestamp":"2021-07-26T15:50:43.098669117Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_n2jdXkRYGAB8lNNgfNQ-OjS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314645.533369_124.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:45.533369001Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"status":{"status":"write"}}},{"id":"1_1627314645.540388_129.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:45.540388460Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314648.180923_134.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:48.180923290Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":3},"status":{"status":"write"}}},{"id":"1_1627314648.186385_137.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:48.186385294Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314650.706781_138.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.706781479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.711421_143.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.711421950Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.713734_144.1","section":"bucket","name":"ldpzkr-15","timestamp":"2021-07-26T15:50:50.713734507Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_z_4iD1kD4zC8z5aa8hvum66","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.718384_145.1","section":"bucket","name":"ldpzkr-15","timestamp":"2021-07-26T15:50:50.718384721Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_z_4iD1kD4zC8z5aa8hvum66","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.734786_146.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.734786911Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.739675_147.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.739675997Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.741475_148.1","section":"bucket","name":"ldpzkr-16","timestamp":"2021-07-26T15:50:50.741475869Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nUsCJ9uq31V5QxtFTswld61","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.745743_149.1","section":"bucket","name":"ldpzkr-16","timestamp":"2021-07-26T15:50:50.745743051Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nUsCJ9uq31V5QxtFTswld61","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.767356_150.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.767356531Z","data":{"read_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":2},"status":{"status":"write"}}},{"id":"1_1627314650.774176_151.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.774176682Z","data":{"read_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314650.781682_152.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.781682881Z","data":{"read_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":2},"status":{"status":"write"}}},{"id":"1_1627314650.789514_153.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.789514878Z","data":{"read_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314654.949415_154.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:54.949415177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.954908_162.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:54.954908009Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314654.956473_163.1","section":"bucket","name":"ldpzkr-17","timestamp":"2021-07-26T15:50:54.956473640Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8r1bq-j62bn-gIA_jutcOtL","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.960341_164.1","section":"bucket","name":"ldpzkr-17","timestamp":"2021-07-26T15:50:54.960341832Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8r1bq-j62bn-gIA_jutcOtL","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314654.975203_165.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:54.975203993Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.980157_166.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:54.980157796Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314654.981860_167.1","section":"bucket","name":"ldpzkr-18","timestamp":"2021-07-26T15:50:54.981860530Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6MP46g7sL15CYF0kotVrN-","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.986750_168.1","section":"bucket","name":"ldpzkr-18","timestamp":"2021-07-26T15:50:54.986750756Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6MP46g7sL15CYF0kotVrN-","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314655.019818_169.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.019818491Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"status":{"status":"write"}}},{"id":"1_1627314655.028091_170.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.028091781Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314655.032524_171.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.032524796Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":3},"status":{"status":"write"}}},{"id":"1_1627314655.039220_172.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.039220558Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314655.046008_173.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.046008507Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"status":{"status":"write"}}},{"id":"1_1627314655.052682_174.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.052682998Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314655.063174_175.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.063174559Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":3},"status":{"status":"write"}}},{"id":"1_1627314655.070296_176.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.070296374Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314659.238996_177.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.238996030Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.243533_185.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.243533949Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.245091_186.1","section":"bucket","name":"ldpzkr-19","timestamp":"2021-07-26T15:50:59.245091609Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S-M2I7GUc5SnfNeNl4Hqa5g","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.249579_187.1","section":"bucket","name":"ldpzkr-19","timestamp":"2021-07-26T15:50:59.249579334Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S-M2I7GUc5SnfNeNl4Hqa5g","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.269938_188.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.269938912Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.276000_189.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.276000057Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.277780_190.1","section":"bucket","name":"ldpzkr-20","timestamp":"2021-07-26T15:50:59.277780826Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8YTJaLLwUmfgXcPKBByxFgV","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.283509_191.1","section":"bucket","name":"ldpzkr-20","timestamp":"2021-07-26T15:50:59.283509006Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8YTJaLLwUmfgXcPKBByxFgV","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.306956_192.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.306956599Z","data":{"read_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.313863_193.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.313863802Z","data":{"read_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.364584_194.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.364584148Z","data":{"read_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.372588_195.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.372588226Z","data":{"read_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.439181_196.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.439181344Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.443838_197.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.443838384Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.445318_198.1","section":"bucket","name":"ldpzkr-21","timestamp":"2021-07-26T15:50:59.445318213Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_26VTESQsQpzIfReHYUyXYB-","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.450250_199.1","section":"bucket","name":"ldpzkr-21","timestamp":"2021-07-26T15:50:59.450250693Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_26VTESQsQpzIfReHYUyXYB-","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.469755_200.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.469755872Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.476715_201.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.476715367Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.478788_202.1","section":"bucket","name":"ldpzkr-22","timestamp":"2021-07-26T15:50:59.478788207Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XfNKsrf3-iM0-gjiyNs9thW","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.485056_203.1","section":"bucket","name":"ldpzkr-22","timestamp":"2021-07-26T15:50:59.485056774Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XfNKsrf3-iM0-gjiyNs9thW","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.511027_204.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.511027906Z","data":{"read_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.519050_205.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.519050696Z","data":{"read_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.569930_206.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.569930114Z","data":{"read_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.577836_207.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.577836116Z","data":{"read_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.643371_208.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.643371103Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.647958_209.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.647958317Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.649706_210.1","section":"bucket","name":"ldpzkr-23","timestamp":"2021-07-26T15:50:59.649706644Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D1iVS-JVde1n5j3VJLe3kDH","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.653727_211.1","section":"bucket","name":"ldpzkr-23","timestamp":"2021-07-26T15:50:59.653727676Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D1iVS-JVde1n5j3VJLe3kDH","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.669325_213.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:50:59.669325317Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.674543_214.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:50:59.674543032Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.676480_215.1","section":"bucket","name":"ldpzkr-24","timestamp":"2021-07-26T15:50:59.676480975Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P24-K8SpoKjzvL7PtSl-lh2","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.680725_216.1","section":"bucket","name":"ldpzkr-24","timestamp":"2021-07-26T15:50:59.680725147Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P24-K8SpoKjzvL7PtSl-lh2","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.703821_217.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.703821654Z","data":{"read_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.710419_218.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.710419718Z","data":{"read_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314660.761078_221.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:51:00.761078944Z","data":{"read_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":2},"status":{"status":"write"}}},{"id":"1_1627314660.769698_222.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:51:00.769698866Z","data":{"read_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314660.837923_223.1","section":"bucket.instance","name":"ldpzkr-25:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.29","timestamp":"2021-07-26T15:51:00.837923878Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q0usZEZ-LWfFxCvVGVVuT-H","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.841807_224.1","section":"bucket.instance","name":"ldpzkr-25:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.29","timestamp":"2021-07-26T15:51:00.841807315Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q0usZEZ-LWfFxCvVGVVuT-H","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314660.843189_225.1","section":"bucket","name":"ldpzkr-25","timestamp":"2021-07-26T15:51:00.843189256Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XMm664KMYovNwj_0wnJ2ctB","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.847087_226.1","section":"bucket","name":"ldpzkr-25","timestamp":"2021-07-26T15:51:00.847087496Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XMm664KMYovNwj_0wnJ2ctB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314660.870361_227.1","section":"bucket.instance","name":"ldpzkr-26:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.30","timestamp":"2021-07-26T15:51:00.870361553Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BLWqcxxbz8-hlAUzBx7pm_","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.874973_228.1","section":"bucket.instance","name":"ldpzkr-26:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.30","timestamp":"2021-07-26T15:51:00.874973673Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BLWqcxxbz8-hlAUzBx7pm_","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314660.876645_229.1","section":"bucket","name":"ldpzkr-26","timestamp":"2021-07-26T15:51:00.876645436Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tbNoLcCHQR8S_qrqEuD0Cnd","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.881070_230.1","section":"bucket","name":"ldpzkr-26","timestamp":"2021-07-26T15:51:00.881070871Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tbNoLcCHQR8S_qrqEuD0Cnd","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.890488_234.1","section":"bucket.instance","name":"ldpzkr-27:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.31","timestamp":"2021-07-26T15:51:01.890488478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XhuTFg08GcVuU8186XSItcR","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.895004_235.1","section":"bucket.instance","name":"ldpzkr-27:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.31","timestamp":"2021-07-26T15:51:01.895004076Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XhuTFg08GcVuU8186XSItcR","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.896887_236.1","section":"bucket","name":"ldpzkr-27","timestamp":"2021-07-26T15:51:01.896887362Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iBUiXG9JriyJvZCvwgmLPz1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.901530_237.1","section":"bucket","name":"ldpzkr-27","timestamp":"2021-07-26T15:51:01.901530492Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iBUiXG9JriyJvZCvwgmLPz1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.922063_238.1","section":"bucket.instance","name":"ldpzkr-28:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.32","timestamp":"2021-07-26T15:51:01.922063058Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g0VJkRq6PKDCpGcSUesB5cE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.926724_239.1","section":"bucket.instance","name":"ldpzkr-28:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.32","timestamp":"2021-07-26T15:51:01.926724028Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g0VJkRq6PKDCpGcSUesB5cE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.929014_240.1","section":"bucket","name":"ldpzkr-28","timestamp":"2021-07-26T15:51:01.929014693Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZGL2gWFqkcLfPZU66DjgzEm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.936828_241.1","section":"bucket","name":"ldpzkr-28","timestamp":"2021-07-26T15:51:01.936828719Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZGL2gWFqkcLfPZU66DjgzEm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.606025_49.1","section":"bucket.instance","name":"ldpzkr-1:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.1","timestamp":"2021-07-26T15:49:59.606025152Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P3weeO8PelBz2nGVxFxHgJa","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.611284_53.1","section":"bucket.instance","name":"ldpzkr-1:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.1","timestamp":"2021-07-26T15:49:59.611284661Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P3weeO8PelBz2nGVxFxHgJa","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.613140_54.1","section":"bucket","name":"ldpzkr-1","timestamp":"2021-07-26T15:49:59.613140868Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uDmWXoUipTim55z7US-i1Fm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.617693_55.1","section":"bucket","name":"ldpzkr-1","timestamp":"2021-07-26T15:49:59.617693844Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uDmWXoUipTim55z7US-i1Fm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.641095_56.1","section":"bucket.instance","name":"ldpzkr-2:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.2","timestamp":"2021-07-26T15:49:59.641095518Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_w1F3bHEYDDu7vnfk2MC1Gav","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.646995_57.1","section":"bucket.instance","name":"ldpzkr-2:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.2","timestamp":"2021-07-26T15:49:59.646995383Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_w1F3bHEYDDu7vnfk2MC1Gav","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.649112_58.1","section":"bucket","name":"ldpzkr-2","timestamp":"2021-07-26T15:49:59.649112762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X3NJYXL8XNpdlVxkT9Q5Llc","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.655223_59.1","section":"bucket","name":"ldpzkr-2","timestamp":"2021-07-26T15:49:59.655223546Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X3NJYXL8XNpdlVxkT9Q5Llc","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.433234_60.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.3","timestamp":"2021-07-26T15:50:04.433234187Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cSZnlFPZ9OLVBWRPaq6UUA4","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.438430_62.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.3","timestamp":"2021-07-26T15:50:04.438430685Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cSZnlFPZ9OLVBWRPaq6UUA4","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.440332_63.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:04.440332578Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HTQeOW0XnTrIcA5-RDtuZeq","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.449641_64.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:04.449641142Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HTQeOW0XnTrIcA5-RDtuZeq","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.471922_66.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.4","timestamp":"2021-07-26T15:50:04.471922414Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MPmZnfHysmL6ou2IZBjAdSH","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.475995_67.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.4","timestamp":"2021-07-26T15:50:04.475995581Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MPmZnfHysmL6ou2IZBjAdSH","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.477405_68.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:04.477405640Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOwmayxsYiHx4VUOeqk71Si","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.481638_69.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:04.481638857Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOwmayxsYiHx4VUOeqk71Si","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.275314_72.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.5","timestamp":"2021-07-26T15:50:05.275314934Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B3GwZXZoR9ACx5K5b1m-Dm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.280572_73.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.5","timestamp":"2021-07-26T15:50:05.280572462Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B3GwZXZoR9ACx5K5b1m-Dm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.282741_74.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.282741415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_93XmHdXEdiuA-BdOESWcs7m","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.287119_75.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.287119608Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_93XmHdXEdiuA-BdOESWcs7m","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314605.314084_77.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.6","timestamp":"2021-07-26T15:50:05.314084749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ka6SOFFSNH-DQYh5ysJzWzP","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.318954_78.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.6","timestamp":"2021-07-26T15:50:05.318954457Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ka6SOFFSNH-DQYh5ysJzWzP","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.320814_79.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.320814541Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_viazGXWENU_GxWz_zhx9itE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.324072_80.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.324072030Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_viazGXWENU_GxWz_zhx9itE","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314605.352256_81.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.7","timestamp":"2021-07-26T15:50:05.352256318Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9eez3dLlpqJGl0U2ixQYVBy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.360599_82.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.7","timestamp":"2021-07-26T15:50:05.360599989Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9eez3dLlpqJGl0U2ixQYVBy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.363400_83.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.363400118Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GEuuXor-U89rfJI5tTZJR0S","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.367998_84.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.367998724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GEuuXor-U89rfJI5tTZJR0S","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314605.416977_86.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.8","timestamp":"2021-07-26T15:50:05.416977185Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Ab-VI7aBOhJSGG1CI57-x4","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.424456_87.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.8","timestamp":"2021-07-26T15:50:05.424456010Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Ab-VI7aBOhJSGG1CI57-x4","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.426356_88.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.426356320Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ox9y1KGUJz641oNHtdQfsCJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.429662_89.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.429662676Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ox9y1KGUJz641oNHtdQfsCJ","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314606.258337_93.1","section":"bucket.instance","name":"ldpzkr-5:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.9","timestamp":"2021-07-26T15:50:06.258337801Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X7RHz0WW2_FEDyRwAUA1ACj","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.263690_94.1","section":"bucket.instance","name":"ldpzkr-5:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.9","timestamp":"2021-07-26T15:50:06.263690643Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X7RHz0WW2_FEDyRwAUA1ACj","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314606.265567_95.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:06.265567855Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.272020_96.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:06.272020492Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314606.292633_97.1","section":"bucket.instance","name":"ldpzkr-6:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.10","timestamp":"2021-07-26T15:50:06.292633415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7ov6MLPnWen_c4DQk3iDXRE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.297834_98.1","section":"bucket.instance","name":"ldpzkr-6:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.10","timestamp":"2021-07-26T15:50:06.297834416Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7ov6MLPnWen_c4DQk3iDXRE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314606.299936_99.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:06.299936007Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.306561_100.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:06.306561199Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.082877_101.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:07.082877332Z","data":{"read_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":2},"status":{"status":"remove"}}},{"id":"1_1627314607.088730_103.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:07.088730582Z","data":{"read_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314607.129399_104.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:07.129399418Z","data":{"read_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":2},"status":{"status":"remove"}}},{"id":"1_1627314607.134933_105.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:07.134933308Z","data":{"read_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314607.913587_106.1","section":"bucket.instance","name":"ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11","timestamp":"2021-07-26T15:50:07.913587580Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uziwhsZeWnGryKQlsrnPI7o","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.919215_108.1","section":"bucket.instance","name":"ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11","timestamp":"2021-07-26T15:50:07.919215749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uziwhsZeWnGryKQlsrnPI7o","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.921025_109.1","section":"bucket","name":"ldpzkr-7","timestamp":"2021-07-26T15:50:07.921025552Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SeWKLNwX2b9MlpRrmKmAZ2S","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.927503_110.1","section":"bucket","name":"ldpzkr-7","timestamp":"2021-07-26T15:50:07.927503571Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SeWKLNwX2b9MlpRrmKmAZ2S","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.945419_111.1","section":"bucket.instance","name":"ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12","timestamp":"2021-07-26T15:50:07.945419467Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-k-eP3PMGEEpNWXsELxcpXz","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.950522_112.1","section":"bucket.instance","name":"ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12","timestamp":"2021-07-26T15:50:07.950522818Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-k-eP3PMGEEpNWXsELxcpXz","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.952243_113.1","section":"bucket","name":"ldpzkr-8","timestamp":"2021-07-26T15:50:07.952243991Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bRcQV_NBIHJ6zoXN1N2e4j1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.956772_114.1","section":"bucket","name":"ldpzkr-8","timestamp":"2021-07-26T15:50:07.956772749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bRcQV_NBIHJ6zoXN1N2e4j1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.216144_115.1","section":"bucket.instance","name":"ldpzkr-9:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.13","timestamp":"2021-07-26T15:50:13.216144820Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iK2vCG_AvVJ1Jk1iPVXy9v1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.220881_120.1","section":"bucket.instance","name":"ldpzkr-9:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.13","timestamp":"2021-07-26T15:50:13.220881647Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iK2vCG_AvVJ1Jk1iPVXy9v1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.222477_121.1","section":"bucket","name":"ldpzkr-9","timestamp":"2021-07-26T15:50:13.222477718Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lwiw_VRx2v3BRFkutzz7l-U","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.226456_122.1","section":"bucket","name":"ldpzkr-9","timestamp":"2021-07-26T15:50:13.226456798Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lwiw_VRx2v3BRFkutzz7l-U","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:53:13.985 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:13.986 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:13.987 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 1199c4c8-86c9-46c2-aada-9f8c593dcbf1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:14.022 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:14.023 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:14.224 INFO:teuthology.orchestra.run.smithi087.stdout:[{"id":"1_1627314478.700993_29.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:47:58.700993213Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D4bNoxPZQXKdemSmOEIfdDg","ver":1},"status":{"status":"write"}}},{"id":"1_1627314478.708636_31.1","section":"user","name":"rgw-multisite-test-user","timestamp":"2021-07-26T15:47:58.708636223Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D4bNoxPZQXKdemSmOEIfdDg","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.243124_32.1","section":"bucket.instance","name":"ldpzkr-10:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.14","timestamp":"2021-07-26T15:50:13.243124319Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CHYdvBfWWG8j9J8iMVOLrxa","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.249182_44.1","section":"bucket.instance","name":"ldpzkr-10:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.14","timestamp":"2021-07-26T15:50:13.249182965Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CHYdvBfWWG8j9J8iMVOLrxa","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.251100_45.1","section":"bucket","name":"ldpzkr-10","timestamp":"2021-07-26T15:50:13.251100565Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6M8ivcoEM7shIa2D0ygsHo","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.256073_46.1","section":"bucket","name":"ldpzkr-10","timestamp":"2021-07-26T15:50:13.256073019Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_A6M8ivcoEM7shIa2D0ygsHo","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.245089_47.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.245089086Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.250248_55.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.250248184Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.251835_56.1","section":"bucket","name":"ldpzkr-11","timestamp":"2021-07-26T15:50:18.251835547Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Rh8NDZPZQ5JynPmOn3DfvM7","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.258309_57.1","section":"bucket","name":"ldpzkr-11","timestamp":"2021-07-26T15:50:18.258309198Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Rh8NDZPZQ5JynPmOn3DfvM7","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.280304_58.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.280304412Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.286025_59.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.286025440Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.288319_60.1","section":"bucket","name":"ldpzkr-12","timestamp":"2021-07-26T15:50:18.288319544Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ya8YLY_3VOeIkbONZ3E_Nmi","ver":1},"status":{"status":"write"}}},{"id":"1_1627314618.293209_61.1","section":"bucket","name":"ldpzkr-12","timestamp":"2021-07-26T15:50:18.293209754Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ya8YLY_3VOeIkbONZ3E_Nmi","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314618.317905_62.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.317905206Z","data":{"read_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":2},"status":{"status":"write"}}},{"id":"1_1627314618.325182_63.1","section":"bucket.instance","name":"ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15","timestamp":"2021-07-26T15:50:18.325182597Z","data":{"read_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":1},"write_version":{"tag":"_2FfOCbPTnY5LU9CR9HaZ6LR","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314618.330756_64.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.330756281Z","data":{"read_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":2},"status":{"status":"write"}}},{"id":"1_1627314618.337553_65.1","section":"bucket.instance","name":"ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16","timestamp":"2021-07-26T15:50:18.337553748Z","data":{"read_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":1},"write_version":{"tag":"_pKb1U2vIf5nGamc_6jWtZMS","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314630.924578_66.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.924578167Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"status":{"status":"write"}}},{"id":"1_1627314630.929934_83.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.929934793Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314630.931834_84.1","section":"bucket","name":"ldpzkr-13","timestamp":"2021-07-26T15:50:30.931834061Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBaActxDLrZMRKg2ft0tf57","ver":1},"status":{"status":"write"}}},{"id":"1_1627314630.937761_85.1","section":"bucket","name":"ldpzkr-13","timestamp":"2021-07-26T15:50:30.937761177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LBaActxDLrZMRKg2ft0tf57","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314630.943831_86.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.943831019Z","data":{"read_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":2},"status":{"status":"write"}}},{"id":"1_1627314630.950552_87.1","section":"bucket.instance","name":"ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17","timestamp":"2021-07-26T15:50:30.950552996Z","data":{"read_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":1},"write_version":{"tag":"_-K6Rx6Rh6zlKLshaA-6nmNd","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314643.077874_114.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:43.077874341Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"status":{"status":"write"}}},{"id":"1_1627314643.086997_121.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:43.086997864Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314643.089501_122.1","section":"bucket","name":"ldpzkr-14","timestamp":"2021-07-26T15:50:43.089501995Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_n2jdXkRYGAB8lNNgfNQ-OjS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314643.098669_123.1","section":"bucket","name":"ldpzkr-14","timestamp":"2021-07-26T15:50:43.098669117Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_n2jdXkRYGAB8lNNgfNQ-OjS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314645.533369_124.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:45.533369001Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"status":{"status":"write"}}},{"id":"1_1627314645.540388_129.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:45.540388460Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":1},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314648.180923_134.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:48.180923290Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":3},"status":{"status":"write"}}},{"id":"1_1627314648.186385_137.1","section":"bucket.instance","name":"ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18","timestamp":"2021-07-26T15:50:48.186385294Z","data":{"read_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":2},"write_version":{"tag":"_vPYUYg221LdQdplBOIWYR7B","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314650.706781_138.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.706781479Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.711421_143.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.711421950Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.713734_144.1","section":"bucket","name":"ldpzkr-15","timestamp":"2021-07-26T15:50:50.713734507Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_z_4iD1kD4zC8z5aa8hvum66","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.718384_145.1","section":"bucket","name":"ldpzkr-15","timestamp":"2021-07-26T15:50:50.718384721Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_z_4iD1kD4zC8z5aa8hvum66","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.734786_146.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.734786911Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.739675_147.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.739675997Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.741475_148.1","section":"bucket","name":"ldpzkr-16","timestamp":"2021-07-26T15:50:50.741475869Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nUsCJ9uq31V5QxtFTswld61","ver":1},"status":{"status":"write"}}},{"id":"1_1627314650.745743_149.1","section":"bucket","name":"ldpzkr-16","timestamp":"2021-07-26T15:50:50.745743051Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_nUsCJ9uq31V5QxtFTswld61","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314650.767356_150.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.767356531Z","data":{"read_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":2},"status":{"status":"write"}}},{"id":"1_1627314650.774176_151.1","section":"bucket.instance","name":"ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19","timestamp":"2021-07-26T15:50:50.774176682Z","data":{"read_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":1},"write_version":{"tag":"_06irM1fgHdtwsyE3gNC0-MS","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314650.781682_152.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.781682881Z","data":{"read_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":2},"status":{"status":"write"}}},{"id":"1_1627314650.789514_153.1","section":"bucket.instance","name":"ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20","timestamp":"2021-07-26T15:50:50.789514878Z","data":{"read_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":1},"write_version":{"tag":"_CR0j50pg4ZdkBpiX_1-GpOV","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314654.949415_154.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:54.949415177Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.954908_162.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:54.954908009Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314654.956473_163.1","section":"bucket","name":"ldpzkr-17","timestamp":"2021-07-26T15:50:54.956473640Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8r1bq-j62bn-gIA_jutcOtL","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.960341_164.1","section":"bucket","name":"ldpzkr-17","timestamp":"2021-07-26T15:50:54.960341832Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8r1bq-j62bn-gIA_jutcOtL","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314654.975203_165.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:54.975203993Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.980157_166.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:54.980157796Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314654.981860_167.1","section":"bucket","name":"ldpzkr-18","timestamp":"2021-07-26T15:50:54.981860530Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6MP46g7sL15CYF0kotVrN-","ver":1},"status":{"status":"write"}}},{"id":"1_1627314654.986750_168.1","section":"bucket","name":"ldpzkr-18","timestamp":"2021-07-26T15:50:54.986750756Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_a6MP46g7sL15CYF0kotVrN-","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314655.019818_169.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.019818491Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"status":{"status":"write"}}},{"id":"1_1627314655.028091_170.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.028091781Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":1},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314655.032524_171.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.032524796Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":3},"status":{"status":"write"}}},{"id":"1_1627314655.039220_172.1","section":"bucket.instance","name":"ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21","timestamp":"2021-07-26T15:50:55.039220558Z","data":{"read_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":2},"write_version":{"tag":"_KfOB6W3bXCX5kkYa3vc1aCO","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314655.046008_173.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.046008507Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"status":{"status":"write"}}},{"id":"1_1627314655.052682_174.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.052682998Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":1},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314655.063174_175.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.063174559Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":3},"status":{"status":"write"}}},{"id":"1_1627314655.070296_176.1","section":"bucket.instance","name":"ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22","timestamp":"2021-07-26T15:50:55.070296374Z","data":{"read_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":2},"write_version":{"tag":"_in3FAVRCYbmP90DUNiafRTt","ver":3},"status":{"status":"complete"}}},{"id":"1_1627314659.238996_177.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.238996030Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.243533_185.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.243533949Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.245091_186.1","section":"bucket","name":"ldpzkr-19","timestamp":"2021-07-26T15:50:59.245091609Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S-M2I7GUc5SnfNeNl4Hqa5g","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.249579_187.1","section":"bucket","name":"ldpzkr-19","timestamp":"2021-07-26T15:50:59.249579334Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_S-M2I7GUc5SnfNeNl4Hqa5g","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.269938_188.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.269938912Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.276000_189.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.276000057Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.277780_190.1","section":"bucket","name":"ldpzkr-20","timestamp":"2021-07-26T15:50:59.277780826Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8YTJaLLwUmfgXcPKBByxFgV","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.283509_191.1","section":"bucket","name":"ldpzkr-20","timestamp":"2021-07-26T15:50:59.283509006Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_8YTJaLLwUmfgXcPKBByxFgV","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.306956_192.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.306956599Z","data":{"read_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.313863_193.1","section":"bucket.instance","name":"ldpzkr-19:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23","timestamp":"2021-07-26T15:50:59.313863802Z","data":{"read_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":1},"write_version":{"tag":"_iYcCjJm9pbeJZ0i8-IJYrOh","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.364584_194.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.364584148Z","data":{"read_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.372588_195.1","section":"bucket.instance","name":"ldpzkr-20:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24","timestamp":"2021-07-26T15:50:59.372588226Z","data":{"read_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":1},"write_version":{"tag":"_6QtzKYmKO-NzP63DgGSX1Sy","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.439181_196.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.439181344Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.443838_197.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.443838384Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.445318_198.1","section":"bucket","name":"ldpzkr-21","timestamp":"2021-07-26T15:50:59.445318213Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_26VTESQsQpzIfReHYUyXYB-","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.450250_199.1","section":"bucket","name":"ldpzkr-21","timestamp":"2021-07-26T15:50:59.450250693Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_26VTESQsQpzIfReHYUyXYB-","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.469755_200.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.469755872Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.476715_201.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.476715367Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.478788_202.1","section":"bucket","name":"ldpzkr-22","timestamp":"2021-07-26T15:50:59.478788207Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XfNKsrf3-iM0-gjiyNs9thW","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.485056_203.1","section":"bucket","name":"ldpzkr-22","timestamp":"2021-07-26T15:50:59.485056774Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XfNKsrf3-iM0-gjiyNs9thW","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.511027_204.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.511027906Z","data":{"read_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.519050_205.1","section":"bucket.instance","name":"ldpzkr-21:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25","timestamp":"2021-07-26T15:50:59.519050696Z","data":{"read_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":1},"write_version":{"tag":"_xemvvlucm3I-3zknqXUVR4r","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.569930_206.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.569930114Z","data":{"read_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.577836_207.1","section":"bucket.instance","name":"ldpzkr-22:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26","timestamp":"2021-07-26T15:50:59.577836116Z","data":{"read_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":1},"write_version":{"tag":"_2yn3TCy6Ant-qA0YPiNy5Lv","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314659.643371_208.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.643371103Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.647958_209.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.647958317Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.649706_210.1","section":"bucket","name":"ldpzkr-23","timestamp":"2021-07-26T15:50:59.649706644Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D1iVS-JVde1n5j3VJLe3kDH","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.653727_211.1","section":"bucket","name":"ldpzkr-23","timestamp":"2021-07-26T15:50:59.653727676Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_D1iVS-JVde1n5j3VJLe3kDH","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.669325_213.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:50:59.669325317Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.674543_214.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:50:59.674543032Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.676480_215.1","section":"bucket","name":"ldpzkr-24","timestamp":"2021-07-26T15:50:59.676480975Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P24-K8SpoKjzvL7PtSl-lh2","ver":1},"status":{"status":"write"}}},{"id":"1_1627314659.680725_216.1","section":"bucket","name":"ldpzkr-24","timestamp":"2021-07-26T15:50:59.680725147Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P24-K8SpoKjzvL7PtSl-lh2","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314659.703821_217.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.703821654Z","data":{"read_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":2},"status":{"status":"write"}}},{"id":"1_1627314659.710419_218.1","section":"bucket.instance","name":"ldpzkr-23:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27","timestamp":"2021-07-26T15:50:59.710419718Z","data":{"read_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":1},"write_version":{"tag":"_ZjZBfM0g9nBiNC-s1rP5RqL","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314660.761078_221.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:51:00.761078944Z","data":{"read_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":2},"status":{"status":"write"}}},{"id":"1_1627314660.769698_222.1","section":"bucket.instance","name":"ldpzkr-24:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28","timestamp":"2021-07-26T15:51:00.769698866Z","data":{"read_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":1},"write_version":{"tag":"_skcfzWNoqIZnzRgCi4GYKRl","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314660.837923_223.1","section":"bucket.instance","name":"ldpzkr-25:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.29","timestamp":"2021-07-26T15:51:00.837923878Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q0usZEZ-LWfFxCvVGVVuT-H","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.841807_224.1","section":"bucket.instance","name":"ldpzkr-25:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.29","timestamp":"2021-07-26T15:51:00.841807315Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Q0usZEZ-LWfFxCvVGVVuT-H","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314660.843189_225.1","section":"bucket","name":"ldpzkr-25","timestamp":"2021-07-26T15:51:00.843189256Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XMm664KMYovNwj_0wnJ2ctB","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.847087_226.1","section":"bucket","name":"ldpzkr-25","timestamp":"2021-07-26T15:51:00.847087496Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XMm664KMYovNwj_0wnJ2ctB","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314660.870361_227.1","section":"bucket.instance","name":"ldpzkr-26:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.30","timestamp":"2021-07-26T15:51:00.870361553Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BLWqcxxbz8-hlAUzBx7pm_","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.874973_228.1","section":"bucket.instance","name":"ldpzkr-26:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.30","timestamp":"2021-07-26T15:51:00.874973673Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_3BLWqcxxbz8-hlAUzBx7pm_","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314660.876645_229.1","section":"bucket","name":"ldpzkr-26","timestamp":"2021-07-26T15:51:00.876645436Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tbNoLcCHQR8S_qrqEuD0Cnd","ver":1},"status":{"status":"write"}}},{"id":"1_1627314660.881070_230.1","section":"bucket","name":"ldpzkr-26","timestamp":"2021-07-26T15:51:00.881070871Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_tbNoLcCHQR8S_qrqEuD0Cnd","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.890488_234.1","section":"bucket.instance","name":"ldpzkr-27:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.31","timestamp":"2021-07-26T15:51:01.890488478Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XhuTFg08GcVuU8186XSItcR","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.895004_235.1","section":"bucket.instance","name":"ldpzkr-27:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.31","timestamp":"2021-07-26T15:51:01.895004076Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_XhuTFg08GcVuU8186XSItcR","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.896887_236.1","section":"bucket","name":"ldpzkr-27","timestamp":"2021-07-26T15:51:01.896887362Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iBUiXG9JriyJvZCvwgmLPz1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.901530_237.1","section":"bucket","name":"ldpzkr-27","timestamp":"2021-07-26T15:51:01.901530492Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iBUiXG9JriyJvZCvwgmLPz1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.922063_238.1","section":"bucket.instance","name":"ldpzkr-28:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.32","timestamp":"2021-07-26T15:51:01.922063058Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g0VJkRq6PKDCpGcSUesB5cE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.926724_239.1","section":"bucket.instance","name":"ldpzkr-28:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.32","timestamp":"2021-07-26T15:51:01.926724028Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_g0VJkRq6PKDCpGcSUesB5cE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314661.929014_240.1","section":"bucket","name":"ldpzkr-28","timestamp":"2021-07-26T15:51:01.929014693Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZGL2gWFqkcLfPZU66DjgzEm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314661.936828_241.1","section":"bucket","name":"ldpzkr-28","timestamp":"2021-07-26T15:51:01.936828719Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_ZGL2gWFqkcLfPZU66DjgzEm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.606025_49.1","section":"bucket.instance","name":"ldpzkr-1:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.1","timestamp":"2021-07-26T15:49:59.606025152Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P3weeO8PelBz2nGVxFxHgJa","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.611284_53.1","section":"bucket.instance","name":"ldpzkr-1:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.1","timestamp":"2021-07-26T15:49:59.611284661Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_P3weeO8PelBz2nGVxFxHgJa","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.613140_54.1","section":"bucket","name":"ldpzkr-1","timestamp":"2021-07-26T15:49:59.613140868Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uDmWXoUipTim55z7US-i1Fm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.617693_55.1","section":"bucket","name":"ldpzkr-1","timestamp":"2021-07-26T15:49:59.617693844Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uDmWXoUipTim55z7US-i1Fm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.641095_56.1","section":"bucket.instance","name":"ldpzkr-2:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.2","timestamp":"2021-07-26T15:49:59.641095518Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_w1F3bHEYDDu7vnfk2MC1Gav","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.646995_57.1","section":"bucket.instance","name":"ldpzkr-2:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.2","timestamp":"2021-07-26T15:49:59.646995383Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_w1F3bHEYDDu7vnfk2MC1Gav","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314599.649112_58.1","section":"bucket","name":"ldpzkr-2","timestamp":"2021-07-26T15:49:59.649112762Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X3NJYXL8XNpdlVxkT9Q5Llc","ver":1},"status":{"status":"write"}}},{"id":"1_1627314599.655223_59.1","section":"bucket","name":"ldpzkr-2","timestamp":"2021-07-26T15:49:59.655223546Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X3NJYXL8XNpdlVxkT9Q5Llc","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.433234_60.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.3","timestamp":"2021-07-26T15:50:04.433234187Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cSZnlFPZ9OLVBWRPaq6UUA4","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.438430_62.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.3","timestamp":"2021-07-26T15:50:04.438430685Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_cSZnlFPZ9OLVBWRPaq6UUA4","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.440332_63.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:04.440332578Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HTQeOW0XnTrIcA5-RDtuZeq","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.449641_64.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:04.449641142Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HTQeOW0XnTrIcA5-RDtuZeq","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.471922_66.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.4","timestamp":"2021-07-26T15:50:04.471922414Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MPmZnfHysmL6ou2IZBjAdSH","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.475995_67.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.4","timestamp":"2021-07-26T15:50:04.475995581Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_MPmZnfHysmL6ou2IZBjAdSH","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314604.477405_68.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:04.477405640Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOwmayxsYiHx4VUOeqk71Si","ver":1},"status":{"status":"write"}}},{"id":"1_1627314604.481638_69.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:04.481638857Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_hOwmayxsYiHx4VUOeqk71Si","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.275314_72.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.5","timestamp":"2021-07-26T15:50:05.275314934Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B3GwZXZoR9ACx5K5b1m-Dm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.280572_73.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.5","timestamp":"2021-07-26T15:50:05.280572462Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7B3GwZXZoR9ACx5K5b1m-Dm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.282741_74.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.282741415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_93XmHdXEdiuA-BdOESWcs7m","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.287119_75.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.287119608Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_93XmHdXEdiuA-BdOESWcs7m","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314605.314084_77.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.6","timestamp":"2021-07-26T15:50:05.314084749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ka6SOFFSNH-DQYh5ysJzWzP","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.318954_78.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.6","timestamp":"2021-07-26T15:50:05.318954457Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ka6SOFFSNH-DQYh5ysJzWzP","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.320814_79.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.320814541Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_viazGXWENU_GxWz_zhx9itE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.324072_80.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.324072030Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_viazGXWENU_GxWz_zhx9itE","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314605.352256_81.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.7","timestamp":"2021-07-26T15:50:05.352256318Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9eez3dLlpqJGl0U2ixQYVBy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.360599_82.1","section":"bucket.instance","name":"ldpzkr-3:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.7","timestamp":"2021-07-26T15:50:05.360599989Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_9eez3dLlpqJGl0U2ixQYVBy","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.363400_83.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.363400118Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GEuuXor-U89rfJI5tTZJR0S","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.367998_84.1","section":"bucket","name":"ldpzkr-3","timestamp":"2021-07-26T15:50:05.367998724Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GEuuXor-U89rfJI5tTZJR0S","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314605.416977_86.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.8","timestamp":"2021-07-26T15:50:05.416977185Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Ab-VI7aBOhJSGG1CI57-x4","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.424456_87.1","section":"bucket.instance","name":"ldpzkr-4:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.8","timestamp":"2021-07-26T15:50:05.424456010Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_1Ab-VI7aBOhJSGG1CI57-x4","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314605.426356_88.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.426356320Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ox9y1KGUJz641oNHtdQfsCJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314605.429662_89.1","section":"bucket","name":"ldpzkr-4","timestamp":"2021-07-26T15:50:05.429662676Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_Ox9y1KGUJz641oNHtdQfsCJ","ver":1},"status":{"status":"abort"}}},{"id":"1_1627314606.258337_93.1","section":"bucket.instance","name":"ldpzkr-5:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.9","timestamp":"2021-07-26T15:50:06.258337801Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X7RHz0WW2_FEDyRwAUA1ACj","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.263690_94.1","section":"bucket.instance","name":"ldpzkr-5:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.9","timestamp":"2021-07-26T15:50:06.263690643Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_X7RHz0WW2_FEDyRwAUA1ACj","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314606.265567_95.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:06.265567855Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.272020_96.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:06.272020492Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314606.292633_97.1","section":"bucket.instance","name":"ldpzkr-6:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.10","timestamp":"2021-07-26T15:50:06.292633415Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7ov6MLPnWen_c4DQk3iDXRE","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.297834_98.1","section":"bucket.instance","name":"ldpzkr-6:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.10","timestamp":"2021-07-26T15:50:06.297834416Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_7ov6MLPnWen_c4DQk3iDXRE","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314606.299936_99.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:06.299936007Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"status":{"status":"write"}}},{"id":"1_1627314606.306561_100.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:06.306561199Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.082877_101.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:07.082877332Z","data":{"read_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":2},"status":{"status":"remove"}}},{"id":"1_1627314607.088730_103.1","section":"bucket","name":"ldpzkr-5","timestamp":"2021-07-26T15:50:07.088730582Z","data":{"read_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":1},"write_version":{"tag":"_DOwjH0J1RLq0VChvOUnOoNm","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314607.129399_104.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:07.129399418Z","data":{"read_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":2},"status":{"status":"remove"}}},{"id":"1_1627314607.134933_105.1","section":"bucket","name":"ldpzkr-6","timestamp":"2021-07-26T15:50:07.134933308Z","data":{"read_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":1},"write_version":{"tag":"_qebeSYvyfGSWjNdVcXFfOJe","ver":2},"status":{"status":"complete"}}},{"id":"1_1627314607.913587_106.1","section":"bucket.instance","name":"ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11","timestamp":"2021-07-26T15:50:07.913587580Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uziwhsZeWnGryKQlsrnPI7o","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.919215_108.1","section":"bucket.instance","name":"ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11","timestamp":"2021-07-26T15:50:07.919215749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_uziwhsZeWnGryKQlsrnPI7o","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.921025_109.1","section":"bucket","name":"ldpzkr-7","timestamp":"2021-07-26T15:50:07.921025552Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SeWKLNwX2b9MlpRrmKmAZ2S","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.927503_110.1","section":"bucket","name":"ldpzkr-7","timestamp":"2021-07-26T15:50:07.927503571Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_SeWKLNwX2b9MlpRrmKmAZ2S","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.945419_111.1","section":"bucket.instance","name":"ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12","timestamp":"2021-07-26T15:50:07.945419467Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-k-eP3PMGEEpNWXsELxcpXz","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.950522_112.1","section":"bucket.instance","name":"ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12","timestamp":"2021-07-26T15:50:07.950522818Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_-k-eP3PMGEEpNWXsELxcpXz","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314607.952243_113.1","section":"bucket","name":"ldpzkr-8","timestamp":"2021-07-26T15:50:07.952243991Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bRcQV_NBIHJ6zoXN1N2e4j1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314607.956772_114.1","section":"bucket","name":"ldpzkr-8","timestamp":"2021-07-26T15:50:07.956772749Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_bRcQV_NBIHJ6zoXN1N2e4j1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.216144_115.1","section":"bucket.instance","name":"ldpzkr-9:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.13","timestamp":"2021-07-26T15:50:13.216144820Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iK2vCG_AvVJ1Jk1iPVXy9v1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.220881_120.1","section":"bucket.instance","name":"ldpzkr-9:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.13","timestamp":"2021-07-26T15:50:13.220881647Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_iK2vCG_AvVJ1Jk1iPVXy9v1","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314613.222477_121.1","section":"bucket","name":"ldpzkr-9","timestamp":"2021-07-26T15:50:13.222477718Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lwiw_VRx2v3BRFkutzz7l-U","ver":1},"status":{"status":"write"}}},{"id":"1_1627314613.226456_122.1","section":"bucket","name":"ldpzkr-9","timestamp":"2021-07-26T15:50:13.226456798Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_lwiw_VRx2v3BRFkutzz7l-U","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:53:14.225 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:14.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:14.226 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 720812a8-530e-4f10-b564-196342c4e7e0 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:14.266 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:14.267 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:14.463 INFO:teuthology.orchestra.run.smithi067.stdout:[{"id":"1_1627314729.255785_180.1","section":"bucket.instance","name":"ldpzkr-29:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.1","timestamp":"2021-07-26T15:52:09.255785533Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GSFGjjowGasnPiSexPa9J-Y","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.260224_181.1","section":"bucket.instance","name":"ldpzkr-29:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.1","timestamp":"2021-07-26T15:52:09.260224547Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GSFGjjowGasnPiSexPa9J-Y","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314729.261790_182.1","section":"bucket","name":"ldpzkr-29","timestamp":"2021-07-26T15:52:09.261790554Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LnX7EIf_s-Difsq-GD4Z6eM","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.266224_183.1","section":"bucket","name":"ldpzkr-29","timestamp":"2021-07-26T15:52:09.266224279Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LnX7EIf_s-Difsq-GD4Z6eM","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314729.303434_184.1","section":"bucket.instance","name":"ldpzkr-30:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.2","timestamp":"2021-07-26T15:52:09.303434585Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f1FurMHVxBefr7EcMG-7TLx","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.307797_185.1","section":"bucket.instance","name":"ldpzkr-30:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.2","timestamp":"2021-07-26T15:52:09.307797557Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f1FurMHVxBefr7EcMG-7TLx","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314729.309327_186.1","section":"bucket","name":"ldpzkr-30","timestamp":"2021-07-26T15:52:09.309327596Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oLIwv5PJlyjgJ0bjIsj8hRy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.313225_187.1","section":"bucket","name":"ldpzkr-30","timestamp":"2021-07-26T15:52:09.313225819Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oLIwv5PJlyjgJ0bjIsj8hRy","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:53:14.464 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:14.464 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:14.465 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 720812a8-530e-4f10-b564-196342c4e7e0 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:14.503 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:14.504 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:14.689 INFO:teuthology.orchestra.run.smithi087.stdout:[{"id":"1_1627314729.255785_180.1","section":"bucket.instance","name":"ldpzkr-29:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.1","timestamp":"2021-07-26T15:52:09.255785533Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GSFGjjowGasnPiSexPa9J-Y","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.260224_181.1","section":"bucket.instance","name":"ldpzkr-29:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.1","timestamp":"2021-07-26T15:52:09.260224547Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GSFGjjowGasnPiSexPa9J-Y","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314729.261790_182.1","section":"bucket","name":"ldpzkr-29","timestamp":"2021-07-26T15:52:09.261790554Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LnX7EIf_s-Difsq-GD4Z6eM","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.266224_183.1","section":"bucket","name":"ldpzkr-29","timestamp":"2021-07-26T15:52:09.266224279Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LnX7EIf_s-Difsq-GD4Z6eM","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314729.303434_184.1","section":"bucket.instance","name":"ldpzkr-30:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.2","timestamp":"2021-07-26T15:52:09.303434585Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f1FurMHVxBefr7EcMG-7TLx","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.307797_185.1","section":"bucket.instance","name":"ldpzkr-30:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.2","timestamp":"2021-07-26T15:52:09.307797557Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f1FurMHVxBefr7EcMG-7TLx","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314729.309327_186.1","section":"bucket","name":"ldpzkr-30","timestamp":"2021-07-26T15:52:09.309327596Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oLIwv5PJlyjgJ0bjIsj8hRy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.313225_187.1","section":"bucket","name":"ldpzkr-30","timestamp":"2021-07-26T15:52:09.313225819Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oLIwv5PJlyjgJ0bjIsj8hRy","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:53:14.690 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:14.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:14.692 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 720812a8-530e-4f10-b564-196342c4e7e0 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:14.771 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:14.771 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:14.969 INFO:teuthology.orchestra.run.smithi087.stdout:[{"id":"1_1627314729.255785_180.1","section":"bucket.instance","name":"ldpzkr-29:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.1","timestamp":"2021-07-26T15:52:09.255785533Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GSFGjjowGasnPiSexPa9J-Y","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.260224_181.1","section":"bucket.instance","name":"ldpzkr-29:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.1","timestamp":"2021-07-26T15:52:09.260224547Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_GSFGjjowGasnPiSexPa9J-Y","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314729.261790_182.1","section":"bucket","name":"ldpzkr-29","timestamp":"2021-07-26T15:52:09.261790554Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LnX7EIf_s-Difsq-GD4Z6eM","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.266224_183.1","section":"bucket","name":"ldpzkr-29","timestamp":"2021-07-26T15:52:09.266224279Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_LnX7EIf_s-Difsq-GD4Z6eM","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314729.303434_184.1","section":"bucket.instance","name":"ldpzkr-30:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.2","timestamp":"2021-07-26T15:52:09.303434585Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f1FurMHVxBefr7EcMG-7TLx","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.307797_185.1","section":"bucket.instance","name":"ldpzkr-30:0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.2","timestamp":"2021-07-26T15:52:09.307797557Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_f1FurMHVxBefr7EcMG-7TLx","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314729.309327_186.1","section":"bucket","name":"ldpzkr-30","timestamp":"2021-07-26T15:52:09.309327596Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oLIwv5PJlyjgJ0bjIsj8hRy","ver":1},"status":{"status":"write"}}},{"id":"1_1627314729.313225_187.1","section":"bucket","name":"ldpzkr-30","timestamp":"2021-07-26T15:52:09.313225819Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_oLIwv5PJlyjgJ0bjIsj8hRy","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:53:14.969 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:14.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:14.971 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 0c36d6c3-0300-4c45-af6a-75a7af63a9ea --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:15.012 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:15.012 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:15.214 INFO:teuthology.orchestra.run.smithi067.stdout:[{"id":"1_1627314790.256902_115.1","section":"bucket.instance","name":"ldpzkr-31:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.1","timestamp":"2021-07-26T15:53:10.256902612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UmTVO7qiPwJfK8Q3mSAU5x8","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.263339_121.1","section":"bucket.instance","name":"ldpzkr-31:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.1","timestamp":"2021-07-26T15:53:10.263339482Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UmTVO7qiPwJfK8Q3mSAU5x8","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314790.265271_122.1","section":"bucket","name":"ldpzkr-31","timestamp":"2021-07-26T15:53:10.265271326Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q4wrbYUsOMfdj-b6DvcH7bJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.269818_123.1","section":"bucket","name":"ldpzkr-31","timestamp":"2021-07-26T15:53:10.269818706Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q4wrbYUsOMfdj-b6DvcH7bJ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314790.296263_124.1","section":"bucket.instance","name":"ldpzkr-32:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.2","timestamp":"2021-07-26T15:53:10.296263282Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I-bNrurUKnTu0n4Agj6ny56","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.300269_125.1","section":"bucket.instance","name":"ldpzkr-32:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.2","timestamp":"2021-07-26T15:53:10.300269926Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I-bNrurUKnTu0n4Agj6ny56","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314790.301752_126.1","section":"bucket","name":"ldpzkr-32","timestamp":"2021-07-26T15:53:10.301752127Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HuQO0QQ3w7HOLPjSlbywKv1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.305792_127.1","section":"bucket","name":"ldpzkr-32","timestamp":"2021-07-26T15:53:10.305792090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HuQO0QQ3w7HOLPjSlbywKv1","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:53:15.215 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:15.216 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:15.217 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 0c36d6c3-0300-4c45-af6a-75a7af63a9ea --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:15.255 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:15.461 INFO:teuthology.orchestra.run.smithi087.stdout:[{"id":"1_1627314790.256902_115.1","section":"bucket.instance","name":"ldpzkr-31:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.1","timestamp":"2021-07-26T15:53:10.256902612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UmTVO7qiPwJfK8Q3mSAU5x8","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.263339_121.1","section":"bucket.instance","name":"ldpzkr-31:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.1","timestamp":"2021-07-26T15:53:10.263339482Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UmTVO7qiPwJfK8Q3mSAU5x8","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314790.265271_122.1","section":"bucket","name":"ldpzkr-31","timestamp":"2021-07-26T15:53:10.265271326Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q4wrbYUsOMfdj-b6DvcH7bJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.269818_123.1","section":"bucket","name":"ldpzkr-31","timestamp":"2021-07-26T15:53:10.269818706Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q4wrbYUsOMfdj-b6DvcH7bJ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314790.296263_124.1","section":"bucket.instance","name":"ldpzkr-32:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.2","timestamp":"2021-07-26T15:53:10.296263282Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I-bNrurUKnTu0n4Agj6ny56","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.300269_125.1","section":"bucket.instance","name":"ldpzkr-32:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.2","timestamp":"2021-07-26T15:53:10.300269926Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I-bNrurUKnTu0n4Agj6ny56","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314790.301752_126.1","section":"bucket","name":"ldpzkr-32","timestamp":"2021-07-26T15:53:10.301752127Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HuQO0QQ3w7HOLPjSlbywKv1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.305792_127.1","section":"bucket","name":"ldpzkr-32","timestamp":"2021-07-26T15:53:10.305792090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HuQO0QQ3w7HOLPjSlbywKv1","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:53:15.461 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:15.462 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:15.463 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 0c36d6c3-0300-4c45-af6a-75a7af63a9ea --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:15.543 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:15.543 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:15.719 INFO:teuthology.orchestra.run.smithi087.stdout:[{"id":"1_1627314790.256902_115.1","section":"bucket.instance","name":"ldpzkr-31:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.1","timestamp":"2021-07-26T15:53:10.256902612Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UmTVO7qiPwJfK8Q3mSAU5x8","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.263339_121.1","section":"bucket.instance","name":"ldpzkr-31:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.1","timestamp":"2021-07-26T15:53:10.263339482Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_UmTVO7qiPwJfK8Q3mSAU5x8","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314790.265271_122.1","section":"bucket","name":"ldpzkr-31","timestamp":"2021-07-26T15:53:10.265271326Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q4wrbYUsOMfdj-b6DvcH7bJ","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.269818_123.1","section":"bucket","name":"ldpzkr-31","timestamp":"2021-07-26T15:53:10.269818706Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_q4wrbYUsOMfdj-b6DvcH7bJ","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314790.296263_124.1","section":"bucket.instance","name":"ldpzkr-32:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.2","timestamp":"2021-07-26T15:53:10.296263282Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I-bNrurUKnTu0n4Agj6ny56","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.300269_125.1","section":"bucket.instance","name":"ldpzkr-32:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.2","timestamp":"2021-07-26T15:53:10.300269926Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_I-bNrurUKnTu0n4Agj6ny56","ver":1},"status":{"status":"complete"}}},{"id":"1_1627314790.301752_126.1","section":"bucket","name":"ldpzkr-32","timestamp":"2021-07-26T15:53:10.301752127Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HuQO0QQ3w7HOLPjSlbywKv1","ver":1},"status":{"status":"write"}}},{"id":"1_1627314790.305792_127.1","section":"bucket","name":"ldpzkr-32","timestamp":"2021-07-26T15:53:10.305792090Z","data":{"read_version":{"tag":"","ver":0},"write_version":{"tag":"_HuQO0QQ3w7HOLPjSlbywKv1","ver":1},"status":{"status":"complete"}}}] 2021-07-26T15:53:15.719 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:15.720 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:15.720 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:53:15.756 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:15.756 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:15.994 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:15.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:15.996 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:53:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:16.041 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:16.260 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:16.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:16.263 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:53:16.299 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:16.300 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:16.502 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:16.503 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:16.504 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 1199c4c8-86c9-46c2-aada-9f8c593dcbf1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:16.543 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:16.544 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:16.726 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2021-07-26T15:53:16.727 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:16.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:16.729 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 1199c4c8-86c9-46c2-aada-9f8c593dcbf1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:16.769 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:16.952 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:53:16.953 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:16.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '1199c4c8-86c9-46c2-aada-9f8c593dcbf1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:16.955 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 1199c4c8-86c9-46c2-aada-9f8c593dcbf1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:16.990 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:16.991 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:17.182 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:53:17.183 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:17.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:17.184 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 720812a8-530e-4f10-b564-196342c4e7e0 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:17.225 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:17.419 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2021-07-26T15:53:17.419 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:17.420 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:17.420 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 720812a8-530e-4f10-b564-196342c4e7e0 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:17.459 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:17.644 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:53:17.645 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:17.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '720812a8-530e-4f10-b564-196342c4e7e0', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:17.648 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 720812a8-530e-4f10-b564-196342c4e7e0 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:17.682 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:17.683 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:17.865 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:53:17.866 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:17.866 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:17.867 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog list --period 0c36d6c3-0300-4c45-af6a-75a7af63a9ea --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:17.907 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:17.907 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:18.109 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2021-07-26T15:53:18.109 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:18.110 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:18.112 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 0c36d6c3-0300-4c45-af6a-75a7af63a9ea --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:18.149 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:18.150 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:18.336 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:53:18.337 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:18.338 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'mdlog', 'list', '--period', '0c36d6c3-0300-4c45-af6a-75a7af63a9ea', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:18.338 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 mdlog list --period 0c36d6c3-0300-4c45-af6a-75a7af63a9ea --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:18.375 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:18.375 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:18.553 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:53:18.555 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_period_incremental_sync ... ok 2021-07-26T15:53:18.556 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-33 2021-07-26T15:53:18.582 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-34 2021-07-26T15:53:18.656 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T15:53:18.654+0000 7f99a0ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:53:18.656 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:53:18.654+0000 7f28277f6700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:53:18.657 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:53:18.654+0000 7f2828ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:53:18.658 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T15:53:18.654+0000 7f99957f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:53:18.728 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:18.729 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:18.729 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:18.770 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:18.939 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314646.000902_39.3","last_update":"2021-07-26T15:50:46.000902Z"},{"marker":"1_1627314661.930728_154.1","last_update":"2021-07-26T15:51:01.930728Z"},{"marker":"1_1627314646.000902_53.2","last_update":"2021-07-26T15:50:46.000902Z"},{"marker":"1_1627314798.814266_178.1","last_update":"2021-07-26T15:53:18.814266Z"}] 2021-07-26T15:53:18.940 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:53:18.940 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:18.941 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:18.942 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:18.982 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:18.982 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:19.171 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_39.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:53:19.172 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:53:19.172 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:19.173 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:19.173 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:19.213 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:19.214 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:19.405 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314646.000902_39.3","last_update":"2021-07-26T15:50:46.000902Z"},{"marker":"1_1627314661.930728_154.1","last_update":"2021-07-26T15:51:01.930728Z"},{"marker":"1_1627314646.000902_53.2","last_update":"2021-07-26T15:50:46.000902Z"},{"marker":"1_1627314798.814266_178.1","last_update":"2021-07-26T15:53:18.814266Z"}] 2021-07-26T15:53:19.405 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:53:19.406 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:19.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:19.408 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:19.451 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:19.452 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:19.632 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_39.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:53:19.633 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:53:19.634 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:19.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:19.636 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:19.714 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:19.715 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:19.901 INFO:teuthology.orchestra.run.smithi087.stdout:[{"marker":"1_1627314646.121028_27.3","last_update":"2021-07-26T15:50:46.121028Z"},{"marker":"1_1627314661.808952_150.1","last_update":"2021-07-26T15:51:01.808952Z"},{"marker":"1_1627314646.121028_58.2","last_update":"2021-07-26T15:50:46.121028Z"},{"marker":"1_1627314798.758462_167.1","last_update":"2021-07-26T15:53:18.758462Z"}] 2021-07-26T15:53:19.902 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:53:19.902 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:19.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:19.904 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:19.946 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:19.947 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:20.141 INFO:teuthology.orchestra.run.smithi067.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8946806699955972168},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314646.121028_27.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.121028Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.808952_150.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.808952Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.121028_58.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.121028Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.758462_167.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.758462Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:53:20.142 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T15:53:20.143 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:20.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:20.144 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:20.178 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:20.375 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314646.000902_39.3","last_update":"2021-07-26T15:50:46.000902Z"},{"marker":"1_1627314661.930728_154.1","last_update":"2021-07-26T15:51:01.930728Z"},{"marker":"1_1627314646.000902_53.2","last_update":"2021-07-26T15:50:46.000902Z"},{"marker":"1_1627314798.814266_178.1","last_update":"2021-07-26T15:53:18.814266Z"}] 2021-07-26T15:53:20.376 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:20.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'autotrim', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:20.377 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog autotrim --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:53:20.456 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:20.457 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:20.661 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:20.661 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:20.662 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 0 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:20.704 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:20.705 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:20.890 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2021-07-26T15:53:20.891 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:20.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:20.892 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 1 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:20.931 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:20.932 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:21.123 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2021-07-26T15:53:21.124 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:21.124 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:21.125 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 2 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:21.212 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:21.213 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:21.406 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2021-07-26T15:53:21.407 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:21.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:21.408 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog list --shard-id 3 --max-entries 1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:21.448 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:21.449 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:21.643 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2021-07-26T15:53:21.644 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:21.644 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:21.645 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:21.682 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:21.872 INFO:teuthology.orchestra.run.smithi087.stdout:[{"marker":"1_1627314646.121028_27.3","last_update":"2021-07-26T15:50:46.121028Z"},{"marker":"1_1627314661.808952_150.1","last_update":"2021-07-26T15:51:01.808952Z"},{"marker":"1_1627314646.121028_58.2","last_update":"2021-07-26T15:50:46.121028Z"},{"marker":"1_1627314798.758462_167.1","last_update":"2021-07-26T15:53:18.758462Z"}] 2021-07-26T15:53:21.873 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:21.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'autotrim', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:21.875 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog autotrim --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:53:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:21.948 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:22.148 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:22.149 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '0', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:22.149 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 0 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:22.187 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:22.187 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:22.374 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:53:22.375 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:22.375 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '1', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:22.376 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 1 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:22.455 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:22.455 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:22.633 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:53:22.634 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:22.635 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '2', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:22.636 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 2 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:22.670 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:22.671 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:22.853 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:53:22.854 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:22.855 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'list', '--shard-id', '3', '--max-entries', '1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:53:22.855 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog list --shard-id 3 --max-entries 1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:53:22.932 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:22.933 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:23.113 INFO:teuthology.orchestra.run.smithi087.stdout:[] 2021-07-26T15:53:23.114 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_datalog_autotrim ... ok 2021-07-26T15:53:23.115 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:23.115 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=false', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:23.116 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=false --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:53:23.151 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:23.151 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:53:23.178+0000 7f2da1ddf980 0 failed reading obj info from .rgw.root:zone_info.6ccbe144-1255-4ce6-93aa-fdbfdac85106: (2) No such file or directory 2021-07-26T15:53:23.181 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:53:23.178+0000 7f2da1ddf980 0 WARNING: could not read zone params for zone id=6ccbe144-1255-4ce6-93aa-fdbfdac85106 name=test-zone1 2021-07-26T15:53:23.194 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4"} 2021-07-26T15:53:23.194 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:23.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:53:23.196 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:53:23.272 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:53:23.273 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:53:23.454 INFO:teuthology.orchestra.run.smithi087.stderr:Sending period to new master zone 6ccbe144-1255-4ce6-93aa-fdbfdac85106 2021-07-26T15:53:23.543 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","epoch":2,"predecessor_uuid":"720812a8-530e-4f10-b564-196342c4e7e0","sync_status":["1_1627314729.313225_187.1","","",""],"period_map":{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":""},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","val":1630018487},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:53:23.544 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to false 2021-07-26T15:54:23.546 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-35 2021-07-26T15:54:23.631 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:23.632 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:23.633 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:23.672 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:23.673 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:23.850 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T15:54:23.882 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314863.580010_157.1","last_update":"2021-07-26T15:54:23.580010Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:54:23.882 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:54:23.883 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:23.884 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:23.885 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:23.924 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:23.925 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:24.121 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:24.122 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:54:29.124 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:29.125 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:29.125 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:29.165 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:29.165 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:29.357 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:29.358 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:54:34.359 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:34.359 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:34.360 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:34.401 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:34.401 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:34.595 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:34.596 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:54:39.597 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:39.598 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:39.598 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:39.639 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:39.640 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:39.821 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:39.821 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:54:44.823 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:44.824 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:44.866 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:44.867 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:45.064 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:45.065 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:54:50.066 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:50.067 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:50.068 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:50.108 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:50.109 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:50.296 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:50.297 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:54:55.298 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:55.299 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:54:55.300 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:54:55.340 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:54:55.340 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:54:55.530 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:54:55.531 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:55:00.533 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:00.535 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:00.535 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:00.581 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:00.581 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:00.761 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:00.762 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:55:05.764 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:05.764 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:05.765 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:05.805 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:05.994 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:05.995 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:55:10.997 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:10.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:10.998 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:11.037 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:11.038 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:11.232 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:11.232 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:55:16.234 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:16.235 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:16.236 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:16.277 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:16.277 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:16.465 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:16.465 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:55:21.467 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:21.468 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:21.468 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:21.510 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:21.511 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:21.688 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314798.609228_137.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:53:18.609228Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:21.688 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627314863.580010_157.1 target=1_1627314798.609228_137.1 2021-07-26T15:55:23.706 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T15:55:23.702+0000 7f99977f6700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:55:26.690 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:26.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:26.692 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:26.732 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:26.733 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:26.934 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314863.580010_157.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:54:23.580010Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:26.935 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:55:26.936 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:55:26.936 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:26.937 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:55:26.937 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:55:26.974 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:26.975 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:27.171 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314863.580010_157.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:54:23.580010Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:55:27.171 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:55:27.183 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=6ccbe144-1255-4ce6-93aa-fdbfdac85106', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:55:27.184 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=6ccbe144-1255-4ce6-93aa-fdbfdac85106', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:55:27.185 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone=6ccbe144-1255-4ce6-93aa-fdbfdac85106 --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:55:27.251 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:27.251 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:55:27.274+0000 7fd073b41980 0 failed reading obj info from .rgw.root:zone_info.6ccbe144-1255-4ce6-93aa-fdbfdac85106: (2) No such file or directory 2021-07-26T15:55:27.277 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:55:27.274+0000 7fd073b41980 0 WARNING: could not read zone params for zone id=6ccbe144-1255-4ce6-93aa-fdbfdac85106 name=test-zone1 2021-07-26T15:55:27.294 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4"} 2021-07-26T15:55:27.295 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:55:27.295 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:55:27.296 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:55:27.334 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:55:27.334 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:55:27.542 INFO:teuthology.orchestra.run.smithi087.stderr:Sending period to new master zone 6ccbe144-1255-4ce6-93aa-fdbfdac85106 2021-07-26T15:55:27.629 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","epoch":3,"predecessor_uuid":"720812a8-530e-4f10-b564-196342c4e7e0","sync_status":["1_1627314729.313225_187.1","","",""],"period_map":{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"false","sync_from":[],"redirect_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106"},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","val":1630018487},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:55:27.630 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "6ccbe144-1255-4ce6-93aa-fdbfdac85106" 2021-07-26T15:56:27.995 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:56:27.996 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--sync-from-all=true', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:56:27.997 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --sync-from-all=true --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:56:28.039 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:28.040 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:28.065 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:56:28.061+0000 7f1965854980 0 failed reading obj info from .rgw.root:zone_info.6ccbe144-1255-4ce6-93aa-fdbfdac85106: (2) No such file or directory 2021-07-26T15:56:28.066 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:56:28.061+0000 7f1965854980 0 WARNING: could not read zone params for zone id=6ccbe144-1255-4ce6-93aa-fdbfdac85106 name=test-zone1 2021-07-26T15:56:28.076 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4"} 2021-07-26T15:56:28.077 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:56:28.078 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:56:28.080 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:56:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:56:28.159 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:56:28.360 INFO:teuthology.orchestra.run.smithi087.stderr:Sending period to new master zone 6ccbe144-1255-4ce6-93aa-fdbfdac85106 2021-07-26T15:56:28.441 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","epoch":4,"predecessor_uuid":"720812a8-530e-4f10-b564-196342c4e7e0","sync_status":["1_1627314729.313225_187.1","","",""],"period_map":{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106"},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","val":1630018487},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:56:28.441 INFO:rgw_multi.tests:Set sync_from_all flag on zone test-zone2 to true 2021-07-26T15:57:28.443 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:57:28.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'modify', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--redirect-zone=', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:57:28.445 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone modify --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --redirect-zone= --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:57:28.485 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:28.486 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:28.512 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:57:28.512+0000 7f27ba6e6980 0 failed reading obj info from .rgw.root:zone_info.6ccbe144-1255-4ce6-93aa-fdbfdac85106: (2) No such file or directory 2021-07-26T15:57:28.512 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:57:28.512+0000 7f27ba6e6980 0 WARNING: could not read zone params for zone id=6ccbe144-1255-4ce6-93aa-fdbfdac85106 name=test-zone1 2021-07-26T15:57:28.523 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","domain_root":"test-zone2.rgw.meta:root","control_pool":"test-zone2.rgw.control","gc_pool":"test-zone2.rgw.log:gc","lc_pool":"test-zone2.rgw.log:lc","log_pool":"test-zone2.rgw.log","intent_log_pool":"test-zone2.rgw.log:intent","usage_log_pool":"test-zone2.rgw.log:usage","roles_pool":"test-zone2.rgw.meta:roles","reshard_pool":"test-zone2.rgw.log:reshard","user_keys_pool":"test-zone2.rgw.meta:users.keys","user_email_pool":"test-zone2.rgw.meta:users.email","user_swift_pool":"test-zone2.rgw.meta:users.swift","user_uid_pool":"test-zone2.rgw.meta:users.uid","otp_pool":"test-zone2.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"test-zone2.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"test-zone2.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"test-zone2.rgw.buckets.non-ec","index_type":0}}],"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4"} 2021-07-26T15:57:28.524 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:57:28.525 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:57:28.525 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:57:28.610 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:57:28.610 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:57:28.795 INFO:teuthology.orchestra.run.smithi087.stderr:Sending period to new master zone 6ccbe144-1255-4ce6-93aa-fdbfdac85106 2021-07-26T15:57:28.875 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","epoch":5,"predecessor_uuid":"720812a8-530e-4f10-b564-196342c4e7e0","sync_status":["1_1627314729.313225_187.1","","",""],"period_map":{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","val":1630018487},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:57:28.876 INFO:rgw_multi.tests:Set redirect_zone zone test-zone2 to "" 2021-07-26T15:58:28.878 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multi_zone_redirect ... ok 2021-07-26T15:58:28.880 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:28.881 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:28.882 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:28.921 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:28.922 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:29.102 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T15:58:29.131 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627314863.580010_157.1","last_update":"2021-07-26T15:54:23.580010Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T15:58:29.132 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T15:58:29.133 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:29.133 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:29.134 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:29.175 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:29.175 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:29.367 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314863.580010_157.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:54:23.580010Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:29.368 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T15:58:29.368 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T15:58:29.369 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:29.369 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:29.370 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:29.412 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:29.412 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:29.609 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627314863.580010_157.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T15:54:23.580010Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T15:58:29.610 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T15:58:29.611 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:29.611 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--access-key', 'U7VF01BMRTS2Z3FS', '--secret', 'A8MVHLS39VJAUzl4NGxU8neu1LhIglID', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:29.612 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone create --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --access-key U7VF01BMRTS2Z3FS --secret A8MVHLS39VJAUzl4NGxU8neu1LhIglID --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:29.689 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:29.689 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:29.747 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:58:29.743+0000 7fa2e209f980 0 failed reading obj info from .rgw.root:zone_info.6ccbe144-1255-4ce6-93aa-fdbfdac85106: (2) No such file or directory 2021-07-26T15:58:29.747 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:58:29.743+0000 7fa2e209f980 0 WARNING: could not read zone params for zone id=6ccbe144-1255-4ce6-93aa-fdbfdac85106 name=test-zone1 2021-07-26T15:58:29.757 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"d509ee6f-da6d-4418-9b73-7b872c780fea","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"U7VF01BMRTS2Z3FS","secret_key":"A8MVHLS39VJAUzl4NGxU8neu1LhIglID"},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4"} 2021-07-26T15:58:29.757 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:29.758 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'period', 'update', '--rgw-zone', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:29.759 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 period update --rgw-zone remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:29.796 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:29.796 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:37.882 INFO:teuthology.orchestra.run.smithi087.stderr:Sending period to new master zone 6ccbe144-1255-4ce6-93aa-fdbfdac85106 2021-07-26T15:58:37.958 INFO:teuthology.orchestra.run.smithi087.stdout:{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","epoch":6,"predecessor_uuid":"720812a8-530e-4f10-b564-196342c4e7e0","sync_status":["1_1627314729.313225_187.1","","",""],"period_map":{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"d509ee6f-da6d-4418-9b73-7b872c780fea","name":"remove","endpoints":[],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","val":1630018487},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639},{"key":"d509ee6f-da6d-4418-9b73-7b872c780fea","val":2086518560}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:58:37.959 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:37.960 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:37.960 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:38.000 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:38.022 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:58:38.019+0000 7fb326142980 0 failed reading obj info from .rgw.root:zone_info.0e23b0cd-74e4-432d-b357-04b2074bdc2e: (2) No such file or directory 2021-07-26T15:58:38.022 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:58:38.019+0000 7fb326142980 0 WARNING: could not read zone params for zone id=0e23b0cd-74e4-432d-b357-04b2074bdc2e name=test-zone2 2021-07-26T15:58:38.027 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:58:38.019+0000 7fb326142980 0 failed reading obj info from .rgw.root:zone_info.10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c: (2) No such file or directory 2021-07-26T15:58:38.027 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:58:38.019+0000 7fb326142980 0 WARNING: could not read zone params for zone id=10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c name=test-zone3 2021-07-26T15:58:38.033 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}} 2021-07-26T15:58:38.034 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'remove', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--rgw-zone', 'remove', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.035 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup remove --rgw-zonegroup test-zonegroup --rgw-realm test-realm --rgw-zone remove --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:38.072 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:38.073 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:38.095 INFO:teuthology.orchestra.run.smithi067.stderr:zone name remove not found in zonegroup test-zonegroup 2021-07-26T15:58:38.101 DEBUG:teuthology.orchestra.run:got remote process result: 2 2021-07-26T15:58:38.103 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.103 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'zone', 'delete', '--rgw-zone', 'remove', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.104 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 zone delete --rgw-zone remove --cluster c2 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:38.146 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:38.146 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:58:38.183+0000 7fb7b9ea6980 0 failed reading obj info from .rgw.root:zone_info.6ccbe144-1255-4ce6-93aa-fdbfdac85106: (2) No such file or directory 2021-07-26T15:58:38.184 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:58:38.183+0000 7fb7b9ea6980 0 WARNING: could not read zone params for zone id=6ccbe144-1255-4ce6-93aa-fdbfdac85106 name=test-zone1 2021-07-26T15:58:38.186 INFO:teuthology.orchestra.run.smithi087.stderr:2021-07-26T15:58:38.183+0000 7fb7b9ea6980 0 zone id d509ee6f-da6d-4418-9b73-7b872c780fea is not a part of zonegroup default 2021-07-26T15:58:38.198 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.198 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.199 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:38.239 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:38.240 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:38.286 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:58:38.283+0000 7f3fbc4fd980 0 WARNING: can't generate connection for zone d509ee6f-da6d-4418-9b73-7b872c780fea id remove: no endpoints defined 2021-07-26T15:58:38.507 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","epoch":7,"predecessor_uuid":"720812a8-530e-4f10-b564-196342c4e7e0","sync_status":["1_1627314729.313225_187.1","","",""],"period_map":{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","val":1630018487},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:58:38.508 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zonegroup_remove ... ok 2021-07-26T15:58:38.509 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.509 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'create', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.510 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup create --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:38.542 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:38.542 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:38.573 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"76aeed51-5632-44e0-954a-426b2b058b0a","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"","zones":[],"placement_targets":[],"default_placement":"","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}} 2021-07-26T15:58:38.573 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.574 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'create', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.574 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone create --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:38.658 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:38.659 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:38.718 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"74d25919-13fc-4733-8aaf-4ee910e766b5","name":"remove","domain_root":"remove.rgw.meta:root","control_pool":"remove.rgw.control","gc_pool":"remove.rgw.log:gc","lc_pool":"remove.rgw.log:lc","log_pool":"remove.rgw.log","intent_log_pool":"remove.rgw.log:intent","usage_log_pool":"remove.rgw.log:usage","roles_pool":"remove.rgw.meta:roles","reshard_pool":"remove.rgw.log:reshard","user_keys_pool":"remove.rgw.meta:users.keys","user_email_pool":"remove.rgw.meta:users.email","user_swift_pool":"remove.rgw.meta:users.swift","user_uid_pool":"remove.rgw.meta:users.uid","otp_pool":"remove.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"remove.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"remove.rgw.buckets.data"}},"data_extra_pool":"remove.rgw.buckets.non-ec","index_type":0}}],"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4"} 2021-07-26T15:58:38.718 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.719 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.719 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:38.756 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:38.756 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:38.994 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","epoch":8,"predecessor_uuid":"720812a8-530e-4f10-b564-196342c4e7e0","sync_status":["1_1627314729.313225_187.1","","",""],"period_map":{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","zonegroups":[{"id":"76aeed51-5632-44e0-954a-426b2b058b0a","name":"remove_zg","api_name":"remove_zg","is_master":"false","endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"74d25919-13fc-4733-8aaf-4ee910e766b5","zones":[{"id":"74d25919-13fc-4733-8aaf-4ee910e766b5","name":"remove","endpoints":[],"log_meta":"false","log_data":"false","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}},{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","val":1630018487},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639},{"key":"74d25919-13fc-4733-8aaf-4ee910e766b5","val":1445198690}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:58:38.995 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.995 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zone', 'delete', '--rgw-zone', 'remove', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:38.996 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zone delete --rgw-zone remove --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:39.032 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:39.033 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:39.077 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:58:39.071+0000 7f84fa122980 0 zone id 74d25919-13fc-4733-8aaf-4ee910e766b5 is not a part of zonegroup test-zonegroup 2021-07-26T15:58:39.078 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:58:39.075+0000 7f84fa122980 0 zone id 74d25919-13fc-4733-8aaf-4ee910e766b5 is not a part of zonegroup default 2021-07-26T15:58:39.091 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:39.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:39.092 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:39.174 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:39.175 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:39.212 INFO:teuthology.orchestra.run.smithi067.stderr:2021-07-26T15:58:39.207+0000 7fefe306b980 0 ERROR: zonegroup remove_zg has a non existent master zone 2021-07-26T15:58:39.219 DEBUG:teuthology.orchestra.run:got remote process result: 22 2021-07-26T15:58:39.220 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:39.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'zonegroup', 'delete', '--rgw-zonegroup', 'remove_zg', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:39.221 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 zonegroup delete --rgw-zonegroup remove_zg --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:39.255 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:39.255 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:39.283 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:39.284 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'period', 'update', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--commit', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:39.284 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 period update --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --commit --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:39.319 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:39.319 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:39.511 INFO:teuthology.orchestra.run.smithi067.stdout:{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","epoch":9,"predecessor_uuid":"720812a8-530e-4f10-b564-196342c4e7e0","sync_status":["1_1627314729.313225_187.1","","",""],"period_map":{"id":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","zonegroups":[{"id":"test-zonegroup","name":"test-zonegroup","api_name":"","is_master":"true","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"hostnames":[],"hostnames_s3website":[],"master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","zones":[{"id":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","name":"test-zone2","endpoints":["http://smithi087.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""},{"id":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","name":"test-zone3","endpoints":["http://smithi087.front.sepia.ceph.com:8001"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"pubsub","sync_from_all":"false","sync_from":["test-zone1"],"redirect_zone":""},{"id":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","name":"test-zone1","endpoints":["http://smithi067.front.sepia.ceph.com:8000"],"log_meta":"false","log_data":"true","bucket_index_max_shards":11,"read_only":"false","tier_type":"","sync_from_all":"true","sync_from":[],"redirect_zone":""}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","sync_policy":{"groups":[]}}],"short_zone_ids":[{"key":"0e23b0cd-74e4-432d-b357-04b2074bdc2e","val":1089575723},{"key":"10a3f7ad-9a0b-4bb6-a106-9623ffe73b2c","val":1630018487},{"key":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","val":2744076639}]},"master_zonegroup":"test-zonegroup","master_zone":"6ccbe144-1255-4ce6-93aa-fdbfdac85106","period_config":{"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1}},"realm_id":"f77102bb-4347-429e-a853-57b537d7aec4","realm_name":"test-realm","realm_epoch":4} 2021-07-26T15:58:39.512 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_zg_master_zone_delete ... ok 2021-07-26T15:58:39.513 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-36 2021-07-26T15:58:39.885 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-37 2021-07-26T15:58:40.155 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-38 2021-07-26T15:58:40.183 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-39 2021-07-26T15:58:41.359 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_set_bucket_website ... rgw_multi.tests.test_set_bucket_policy ... ok 2021-07-26T15:58:41.360 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-40 2021-07-26T15:58:41.389 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-41 2021-07-26T15:58:41.435 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ldpzkr-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:41.435 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ldpzkr-40', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:41.436 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ldpzkr-40 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:41.476 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:41.476 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:41.727 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ldpzkr-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:41.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ldpzkr-41', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T15:58:41.729 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ldpzkr-41 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T15:58:41.766 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:41.767 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:42.018 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:42.019 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'log', 'list', '--rgw-zone', 'test-zone1', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:42.019 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 log list --rgw-zone test-zone1 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:42.055 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:42.055 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:42.276 INFO:teuthology.orchestra.run.smithi067.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17-ldpzkr-13","obj_delete_at_hint.0000000040","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:7","meta.full-sync.index.0","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16:5","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.1-ldpzkr-1","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4843.1-ldpzkr-35","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.4-ldpzkr-39","obj_delete_at_hint.0000000024","datalog.sync-status.shard.0e23b0cd-74e4-432d-b357-04b2074bdc2e.2","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_log.3","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:1","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.6-ldpzkr-41","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.32-ldpzkr-28","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.1-ldpzkr-36","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.14-ldpzkr-10","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","meta.log.0c36d6c3-0300-4c45-af6a-75a7af63a9ea.0","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.2-ldpzkr-2","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12-ldpzkr-8","datalog.sync-status.shard.0e23b0cd-74e4-432d-b357-04b2074bdc2e.3","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.3-ldpzkr-38","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24-ldpzkr-20","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.3-ldpzkr-33","obj_delete_at_hint.0000000008","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:1","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21:8","datalog.sync-status.shard.0e23b0cd-74e4-432d-b357-04b2074bdc2e.1","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:8","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:3","2021-07-26-15-0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.2-ldpzkr-30","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26-ldpzkr-22","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-10:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.14:1","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15-ldpzkr-11","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","data_log.1","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.13-ldpzkr-9","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.2-ldpzkr-37","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","datalog.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e","obj_delete_at_hint.0000000077","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22-ldpzkr-18","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11-ldpzkr-7","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22:8","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-34:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.4:8","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-26:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.30:10","mdlog.sync-status.shard.2","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.4-ldpzkr-4","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:3","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","mdlog.sync-status.shard.1","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19:8","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","datalog.sync-status.shard.0e23b0cd-74e4-432d-b357-04b2074bdc2e.0.retry","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-9:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.13:1","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18:8","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28-ldpzkr-24","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.23-ldpzkr-19","meta.full-sync.index.3","obj_delete_at_hint.0000000118","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15:1","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.10-ldpzkr-6","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","mdlog.sync-status.shard.0","datalog.sync-status.shard.0e23b0cd-74e4-432d-b357-04b2074bdc2e.0","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20-ldpzkr-16","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20:8","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:8","obj_delete_at_hint.0000000100","data.full-sync.index.0e23b0cd-74e4-432d-b357-04b2074bdc2e.3","obj_delete_at_hint.0000000093","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.31-ldpzkr-27","data.full-sync.index.0e23b0cd-74e4-432d-b357-04b2074bdc2e.0","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18-ldpzkr-14","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-35:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4843.1:5","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.29-ldpzkr-25","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.27-ldpzkr-23","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17:8","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.30-ldpzkr-26","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","2021-07-26-15-0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.1-ldpzkr-29","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.3-ldpzkr-3","obj_delete_at_hint.0000000033","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.4-ldpzkr-34","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16:1","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-25:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.29:10","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.25-ldpzkr-21","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16:3","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16-ldpzkr-12","obj_delete_at_hint.0000000023","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.5-ldpzkr-40","obj_delete_at_hint.0000000107","data.full-sync.index.0e23b0cd-74e4-432d-b357-04b2074bdc2e.1","obj_delete_at_hint.0000000046","meta.full-sync.index.2","data_log.2","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-33:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.3:8","obj_delete_at_hint.0000000067","datalog.sync-status.shard.0e23b0cd-74e4-432d-b357-04b2074bdc2e.1.retry","obj_delete_at_hint.0000000086","data.full-sync.index.0e23b0cd-74e4-432d-b357-04b2074bdc2e.2","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17:5","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.1-ldpzkr-31","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19-ldpzkr-15","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15:5","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","datalog.sync-status.shard.0e23b0cd-74e4-432d-b357-04b2074bdc2e.3.retry","obj_delete_at_hint.0000000061","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15:3","obj_delete_at_hint.0000000097","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.2-ldpzkr-32","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21-ldpzkr-17","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.9-ldpzkr-5","obj_delete_at_hint.0000000042","datalog.sync-status.shard.0e23b0cd-74e4-432d-b357-04b2074bdc2e.2.retry","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030","bucket.sync-status.0e23b0cd-74e4-432d-b357-04b2074bdc2e:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:7"] 2021-07-26T15:58:42.306 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:42.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone2', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:42.307 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone2 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:42.345 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:42.345 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:42.562 INFO:teuthology.orchestra.run.smithi087.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","data.full-sync.index.6ccbe144-1255-4ce6-93aa-fdbfdac85106.1","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17-ldpzkr-13","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:3","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18:8","obj_delete_at_hint.0000000040","meta.full-sync.index.0","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22:8","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.1-ldpzkr-1","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4843.1-ldpzkr-35","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:8","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.4-ldpzkr-39","datalog.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106","obj_delete_at_hint.0000000024","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16:3","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_log.3","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.6-ldpzkr-41","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:7","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.32-ldpzkr-28","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.2","obj_delete_at_hint.0000000076","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.1.retry","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.14-ldpzkr-10","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17:8","meta.log.0c36d6c3-0300-4c45-af6a-75a7af63a9ea.0","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.2-ldpzkr-2","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12-ldpzkr-8","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-25:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.29:10","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.24-ldpzkr-20","obj_delete_at_hint.0000000096","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-10:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.14:1","obj_delete_at_hint.0000000087","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.3-ldpzkr-33","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15:3","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","2021-07-26-15-0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.2-ldpzkr-30","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:7","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.26-ldpzkr-22","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15-ldpzkr-11","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.3.retry","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","data_log.1","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16:5","data.full-sync.index.6ccbe144-1255-4ce6-93aa-fdbfdac85106.0","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-26:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.30:10","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.13-ldpzkr-9","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.2-ldpzkr-37","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22-ldpzkr-18","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11-ldpzkr-7","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.0","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15:5","mdlog.sync-status.shard.2","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.1","obj_delete_at_hint.0000000116","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.4-ldpzkr-4","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-35:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4843.1:5","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.2.retry","mdlog.sync-status.shard.1","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.28-ldpzkr-24","meta.full-sync.index.3","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.10-ldpzkr-6","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","mdlog.sync-status.shard.0","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20-ldpzkr-16","obj_delete_at_hint.0000000100","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17:5","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:1","obj_delete_at_hint.0000000093","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.31-ldpzkr-27","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18-ldpzkr-14","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15:1","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.29-ldpzkr-25","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.0.retry","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.30-ldpzkr-26","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","2021-07-26-15-0e23b0cd-74e4-432d-b357-04b2074bdc2e.5016.1-ldpzkr-29","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.3-ldpzkr-3","obj_delete_at_hint.0000000033","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-9:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.13:1","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.4-ldpzkr-34","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:8","data.full-sync.index.6ccbe144-1255-4ce6-93aa-fdbfdac85106.2","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","data.full-sync.index.6ccbe144-1255-4ce6-93aa-fdbfdac85106.3","obj_delete_at_hint.0000000051","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16:1","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16-ldpzkr-12","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","meta.full-sync.index.2","data_log.2","obj_delete_at_hint.0000000067","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-34:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.4:8","obj_delete_at_hint.0000000086","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:3","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.1-ldpzkr-31","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-33:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.3:8","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19-ldpzkr-15","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20:8","obj_delete_at_hint.0000000050","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:1","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.2-ldpzkr-32","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21-ldpzkr-17","2021-07-26-15-6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.9-ldpzkr-5","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.3","obj_delete_at_hint.0000000030","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21:8","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19:8"] 2021-07-26T15:58:42.589 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:42.590 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'log', 'list', '--rgw-zone', 'test-zone3', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:42.590 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 log list --rgw-zone test-zone3 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:42.629 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:42.630 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:42.812 INFO:teuthology.orchestra.run.smithi087.stdout:["obj_delete_at_hint.0000000078","meta.history","obj_delete_at_hint.0000000070","data.full-sync.index.6ccbe144-1255-4ce6-93aa-fdbfdac85106.1","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:3","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-14:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.18:8","obj_delete_at_hint.0000000040","meta.full-sync.index.0","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-18:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.22:8","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:8","datalog.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106","obj_delete_at_hint.0000000024","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16:3","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:7","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.2","obj_delete_at_hint.0000000076","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.1.retry","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17:8","meta.log.0c36d6c3-0300-4c45-af6a-75a7af63a9ea.0","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-25:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.29:10","obj_delete_at_hint.0000000096","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-10:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.14:1","obj_delete_at_hint.0000000087","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15:3","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","bilog.trim","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:7","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.3.retry","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16:5","data.full-sync.index.6ccbe144-1255-4ce6-93aa-fdbfdac85106.0","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-26:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.30:10","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","meta.full-sync.index.1","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.0","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15:5","mdlog.sync-status.shard.2","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.1","obj_delete_at_hint.0000000116","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-35:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4843.1:5","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.2.retry","mdlog.sync-status.shard.1","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","meta.full-sync.index.3","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","mdlog.sync-status.shard.3","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","mdlog.sync-status.shard.0","obj_delete_at_hint.0000000027","mdlog.sync-status","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-13:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.17:5","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-8:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.12:1","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-11:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.15:1","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","meta.log.1199c4c8-86c9-46c2-aada-9f8c593dcbf1.0","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.0.retry","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","meta.log.1199c4c8-86c9-46c2-aada-9f8c593dcbf1.1","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-9:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.13:1","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:8","data.full-sync.index.6ccbe144-1255-4ce6-93aa-fdbfdac85106.2","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","data.full-sync.index.6ccbe144-1255-4ce6-93aa-fdbfdac85106.3","obj_delete_at_hint.0000000051","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-12:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.16:1","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","meta.log.720812a8-530e-4f10-b564-196342c4e7e0.0","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","meta.full-sync.index.2","obj_delete_at_hint.0000000067","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-34:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.4:8","obj_delete_at_hint.0000000086","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:3","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-33:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4737.3:8","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-16:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.20:8","obj_delete_at_hint.0000000050","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-7:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.11:1","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","datalog.sync-status.shard.6ccbe144-1255-4ce6-93aa-fdbfdac85106.3","obj_delete_at_hint.0000000030","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-17:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.21:8","bucket.sync-status.6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-15:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4273.19:8"] 2021-07-26T15:58:42.840 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:42.841 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:42.842 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:42.882 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:42.882 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:43.089 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315121.987482_154.3","last_update":"2021-07-26T15:58:41.987482Z"},{"marker":"1_1627315121.987482_345.3","last_update":"2021-07-26T15:58:41.987482Z"},{"marker":"1_1627315121.987482_193.2","last_update":"2021-07-26T15:58:41.987482Z"},{"marker":"1_1627315121.987482_296.3","last_update":"2021-07-26T15:58:41.987482Z"}] 2021-07-26T15:58:43.090 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:58:43.090 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:43.091 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:43.091 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:43.134 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:43.134 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:43.340 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:58:43.340 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:58:48.342 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:48.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:48.343 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:48.385 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:48.385 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:48.590 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:58:48.591 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:58:53.592 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:53.593 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:53.593 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:53.634 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:53.634 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:53.843 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:58:53.844 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:58:58.847 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:58.849 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:58:58.850 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:58:58.892 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:58:58.893 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:58:59.108 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:58:59.108 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:59:04.109 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:04.110 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:04.111 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:04.152 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:04.152 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:04.356 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:04.357 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:59:09.359 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:09.360 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:09.361 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:09.403 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:09.403 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:09.631 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:09.632 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:59:14.634 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:14.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:14.638 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:14.680 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:14.680 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:14.901 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:14.902 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:59:19.904 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:19.904 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:19.905 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:19.946 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:19.947 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:20.159 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:20.160 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:59:25.161 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:25.162 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:25.163 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:25.204 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:25.417 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:25.417 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:59:30.418 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:30.419 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:30.420 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:30.462 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:30.462 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:30.676 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:30.676 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:59:35.678 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:35.679 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:35.679 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:35.726 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:35.726 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:35.958 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:35.959 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:59:40.960 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:40.961 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:40.962 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:41.004 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:41.004 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:41.149 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:59:41.146+0000 7f282affd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:59:41.149 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:59:41.146+0000 7f282bfff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:59:41.149 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:59:41.146+0000 7f282a7fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:59:41.151 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:59:41.150+0000 7f2824ff1700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:59:41.152 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:59:41.150+0000 7f283ffff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:59:41.152 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:59:41.150+0000 7f2824ff1700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:59:41.154 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:59:41.150+0000 7f2831ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:59:41.154 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T15:59:41.150+0000 7f28327fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T15:59:41.243 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627315121.987482_193.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:58:41.987482Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:41.243 WARNING:rgw_multi.tests:data of zone test-zone2 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:59:46.245 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:46.246 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:46.247 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:46.289 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:46.290 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:46.494 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627315121.987482_154.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:58:41.987482Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627315121.987482_345.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:58:41.987482Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627315121.987482_193.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:58:41.987482Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627315121.987482_296.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:58:41.987482Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:46.495 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T15:59:46.495 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:46.496 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:46.496 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:46.534 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:46.534 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:46.716 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315121.987482_154.3","last_update":"2021-07-26T15:58:41.987482Z"},{"marker":"1_1627315121.987482_345.3","last_update":"2021-07-26T15:58:41.987482Z"},{"marker":"1_1627315121.987482_193.2","last_update":"2021-07-26T15:58:41.987482Z"},{"marker":"1_1627315121.987482_296.3","last_update":"2021-07-26T15:58:41.987482Z"}] 2021-07-26T15:59:46.716 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T15:59:46.717 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:46.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:46.718 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:46.759 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:46.760 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:46.953 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:46.953 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:59:51.955 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:51.956 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:51.956 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:51.997 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:52.201 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:52.201 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T15:59:57.202 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:57.203 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T15:59:57.204 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T15:59:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T15:59:57.247 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T15:59:57.454 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T15:59:57.454 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T16:00:02.456 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:02.457 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:02.457 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:02.501 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:02.502 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:02.691 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:00:02.692 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T16:00:07.693 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:07.694 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:07.695 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:07.740 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:07.740 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:07.950 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:00:07.950 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T16:00:12.951 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:12.953 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:12.953 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:12.996 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:12.998 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:13.212 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:00:13.213 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T16:00:18.214 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:18.215 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:18.216 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:18.257 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:18.257 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:18.472 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:00:18.473 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T16:00:23.474 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:23.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:23.475 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:23.518 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:23.519 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:23.721 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:00:23.722 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T16:00:28.723 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:28.724 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:28.725 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:28.770 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:28.770 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:28.974 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:00:28.975 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T16:00:33.976 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:33.977 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:33.978 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:34.021 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:34.022 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:34.215 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:00:34.216 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T16:00:39.217 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:39.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:39.219 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:39.261 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:39.469 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627314988.590310_91.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:56:28.590310Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627314661.930728_154.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:51:01.930728Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627314646.000902_53.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:46.000902Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627314798.814266_178.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:53:18.814266Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:00:39.470 WARNING:rgw_multi.tests:data of zone test-zone3 behind zone test-zone1: shard=0 master=1_1627315121.987482_154.3 target=1_1627314988.590310_91.1, shard=1 master=1_1627315121.987482_345.3 target=1_1627314661.930728_154.1, shard=2 master=1_1627315121.987482_193.2 target=1_1627314646.000902_53.2, shard=3 master=1_1627315121.987482_296.3 target=1_1627314798.814266_178.1 2021-07-26T16:00:41.110 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f999b7fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.110 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99927ec700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.111 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f9993fef700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.111 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f9993fef700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.111 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f999a7fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.111 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f9994ff1700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.112 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99a27fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.112 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99977f6700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.112 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99977f6700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.112 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99a0ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.113 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f9990fe9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.113 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f9999ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.113 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99a17fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.113 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99a0ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.113 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99a1ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.114 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99967f4700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.114 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99967f4700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.114 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99b8ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.114 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99957f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.115 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f9992fed700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.115 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f99937ee700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:41.115 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:41.105+0000 7f9991feb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:44.471 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:44.472 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:44.473 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:44.514 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:44.515 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:44.701 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627315121.987482_154.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:58:41.987482Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627315121.987482_345.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:58:41.987482Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627315121.987482_193.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:58:41.987482Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627315121.987482_296.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:58:41.987482Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:00:44.702 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T16:00:44.702 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:44.703 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:44.704 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:44.740 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:44.740 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:44.942 INFO:teuthology.orchestra.run.smithi087.stdout:[{"marker":"1_1627315242.205662_135.1","last_update":"2021-07-26T16:00:42.205662Z"},{"marker":"1_1627315242.207249_408.1","last_update":"2021-07-26T16:00:42.207249Z"},{"marker":"1_1627315242.202683_212.1","last_update":"2021-07-26T16:00:42.202683Z"},{"marker":"1_1627315242.204110_289.1","last_update":"2021-07-26T16:00:42.204110Z"}] 2021-07-26T16:00:44.942 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T16:00:44.943 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:44.947 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:44.948 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:44.988 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:44.989 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:45.195 INFO:teuthology.orchestra.run.smithi067.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8946806699955972168},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627315242.205662_135.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:42.205662Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627315242.207249_408.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:42.207249Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627315242.202683_212.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:42.202683Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627315242.204110_289.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:42.204110Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:00:45.196 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T16:00:45.197 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable ... ok 2021-07-26T16:00:45.197 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-42 2021-07-26T16:00:45.231 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-43 2021-07-26T16:00:45.326 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:00:45.325+0000 7f28277f6700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:45.327 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:45.325+0000 7f9996ff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:45.328 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:00:45.325+0000 7f2826ff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:45.331 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:00:45.329+0000 7f9991feb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:00:45.671 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:45.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:45.673 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:45.712 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:45.712 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:45.901 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000001.27.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.38.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.143.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.38.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:00:45.902 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-42 2021-07-26T16:00:45.903 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:45.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:45.904 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:45.956 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:45.956 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:46.156 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.27.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.38.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.143.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.38.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:00:46.157 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-42 2021-07-26T16:00:46.158 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:46.158 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:46.159 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:46.200 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:46.201 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:46.405 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000001.27.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.38.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.143.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.38.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:00:46.406 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-42 2021-07-26T16:00:46.406 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:46.407 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:46.407 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:46.451 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:46.451 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:46.644 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.27.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.38.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.143.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.38.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:00:46.644 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-42 2021-07-26T16:00:46.645 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:46.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:46.646 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:46.724 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:46.725 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:46.919 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":"00000000001.33.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.51.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.135.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.46.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:00:46.920 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-42 2021-07-26T16:00:46.921 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:46.921 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:46.922 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:46.964 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:46.965 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:47.190 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.33.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.51.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.135.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.46.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:00:47.191 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-42 2021-07-26T16:00:47.192 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-42 zones={test-zone2, test-zone1} 2021-07-26T16:00:47.201 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T16:00:47.251 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:00:47.252 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:00:47.253 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:00:47.253 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:00:47.254 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T16:00:47.260 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:00:47.260 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:00:47.261 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:00:47.261 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:00:47.316 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:00:47.373 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:00:47.484 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:00:47.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:00:47.643 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:00:47.753 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:00:47.860 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:00:47.916 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:00:48.030 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:00:48.133 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:00:48.188 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:00:48.299 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:00:48.397 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-42 zones={test-zone2, test-zone1} 2021-07-26T16:00:48.398 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:48.398 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:48.399 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:48.441 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:48.641 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000001.33.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.35.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.28.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.49.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:00:48.641 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-43 2021-07-26T16:00:48.642 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:48.642 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:48.643 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:48.685 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:48.686 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:48.897 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.33.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.35.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.28.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.49.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:00:48.898 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-43 2021-07-26T16:00:48.898 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:48.899 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:48.900 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:48.942 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:48.943 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:49.148 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000001.33.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.35.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.28.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.49.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:00:49.148 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-43 2021-07-26T16:00:49.149 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:49.149 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:49.150 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:49.194 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:49.194 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:49.395 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.33.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.35.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.28.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.49.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:00:49.396 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-43 2021-07-26T16:00:49.396 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:49.397 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:49.397 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:49.477 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:49.478 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:49.684 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":"00000000001.45.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.40.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.34.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.55.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:00:49.684 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-43 2021-07-26T16:00:49.685 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:49.685 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:49.686 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:49.731 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:49.731 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:49.943 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.45.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.40.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.34.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.55.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:00:49.944 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-43 2021-07-26T16:00:49.944 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-43 zones={test-zone2, test-zone1} 2021-07-26T16:00:49.953 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T16:00:49.958 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:00:49.959 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:00:49.959 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:00:49.959 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:00:49.960 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T16:00:49.965 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:00:49.965 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:00:49.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:00:49.966 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:00:50.019 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:00:50.072 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:00:50.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:00:50.329 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:00:50.388 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:00:50.494 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:00:50.592 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:00:50.648 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:00:50.754 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:00:50.864 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:00:50.919 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:00:51.026 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:00:51.133 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-43 zones={test-zone2, test-zone1} 2021-07-26T16:00:51.133 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ldpzkr-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:00:51.135 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ldpzkr-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:00:51.136 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ldpzkr-42 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T16:00:51.176 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:51.177 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:51.440 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'ldpzkr-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:00:51.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'ldpzkr-42', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:00:51.441 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket ldpzkr-42 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T16:00:51.480 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:51.481 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:51.726 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ldpzkr-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:00:51.726 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ldpzkr-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:00:51.727 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ldpzkr-43 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T16:00:51.810 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:51.811 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:52.061 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'ldpzkr-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:00:52.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'ldpzkr-43', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:00:52.062 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket ldpzkr-43 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T16:00:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:52.102 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:52.747 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:52.748 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:52.749 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:52.793 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:52.793 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:52.960 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000006.33.5"},{"key":1,"val":"00000000004.45.1"},{"key":2,"val":"00000000006.48.5"},{"key":3,"val":"00000000004.32.1"},{"key":4,"val":"00000000006.149.5"},{"key":5,"val":"00000000004.29.1"},{"key":6,"val":"00000000004.20.1"},{"key":7,"val":"00000000006.44.5"},{"key":8,"val":"00000000004.31.1"},{"key":9,"val":"00000000004.30.1"},{"key":10,"val":"00000000004.47.1"}]} 2021-07-26T16:00:52.961 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-42 2021-07-26T16:00:52.961 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:52.962 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:52.963 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:53.005 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:53.006 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:53.222 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.33.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.48.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.32.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.149.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.20.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.44.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.47.1"}}}] 2021-07-26T16:00:53.223 WARNING:rgw_multi.tests:bucket ldpzkr-42 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.45.1 target=, shard=5 master=00000000004.29.1 target=, shard=9 master=00000000004.30.1 target= 2021-07-26T16:00:58.225 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:58.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:00:58.227 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:00:58.273 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:00:58.273 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:00:58.490 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.33.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.48.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.32.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.149.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.20.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.44.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.47.1"}}}] 2021-07-26T16:00:58.491 WARNING:rgw_multi.tests:bucket ldpzkr-42 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.45.1 target=, shard=5 master=00000000004.29.1 target=, shard=9 master=00000000004.30.1 target= 2021-07-26T16:01:03.493 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:03.493 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:03.494 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:03.537 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:03.538 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:03.734 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.33.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.48.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.32.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.149.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.20.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.44.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.30.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.47.1"}}}] 2021-07-26T16:01:03.734 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-42 2021-07-26T16:01:03.735 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:03.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:03.736 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:03.777 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:03.778 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:03.979 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000006.33.5"},{"key":1,"val":"00000000004.45.1"},{"key":2,"val":"00000000006.48.5"},{"key":3,"val":"00000000004.32.1"},{"key":4,"val":"00000000006.149.5"},{"key":5,"val":"00000000004.29.1"},{"key":6,"val":"00000000004.20.1"},{"key":7,"val":"00000000006.44.5"},{"key":8,"val":"00000000004.31.1"},{"key":9,"val":"00000000004.30.1"},{"key":10,"val":"00000000004.47.1"}]} 2021-07-26T16:01:03.980 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-42 2021-07-26T16:01:03.980 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:03.981 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:03.981 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:04.025 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:04.026 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:04.228 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.33.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.45.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.48.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.32.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.149.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.20.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.44.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.30.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.47.1"}}}] 2021-07-26T16:01:04.228 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-42 2021-07-26T16:01:04.229 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:04.229 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-42', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:04.230 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-42 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:04.268 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:04.268 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:04.473 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":"00000000002.35.5"},{"key":1,"val":""},{"key":2,"val":"00000000002.53.5"},{"key":3,"val":""},{"key":4,"val":"00000000002.138.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000002.48.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:01:04.474 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-42 2021-07-26T16:01:04.474 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:04.475 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-42', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:04.475 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-42 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:04.518 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:04.519 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:04.719 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.35.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.53.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.138.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.48.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:01:04.720 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-42 2021-07-26T16:01:04.720 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-42 zones={test-zone2, test-zone1} 2021-07-26T16:01:04.728 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T16:01:04.735 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:01:04.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:01:04.736 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:01:04.737 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:01:04.738 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T16:01:04.739 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T16:01:04.740 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T16:01:04.741 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T16:01:04.742 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T16:01:04.749 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:01:04.750 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:01:04.752 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:01:04.752 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:01:04.753 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T16:01:04.753 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T16:01:04.753 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T16:01:04.754 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T16:01:04.767 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:04.865 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:04.974 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:05.076 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:05.131 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:05.242 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:05.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:05.395 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:05.508 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:05.612 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:05.672 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:05.781 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:05.884 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:01:05.941 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:01:06.051 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:01:06.154 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:01:06.207 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:01:06.319 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:01:06.424 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:01:06.480 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:01:06.593 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:01:06.700 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:01:06.756 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:01:06.869 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:01:06.969 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-42 zones={test-zone2, test-zone1} 2021-07-26T16:01:06.969 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:06.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:06.971 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:07.010 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:07.011 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:07.213 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000006.43.5"},{"key":1,"val":"00000000004.39.1"},{"key":2,"val":"00000000006.41.5"},{"key":3,"val":"00000000004.78.1"},{"key":4,"val":"00000000006.38.5"},{"key":5,"val":"00000000004.29.1"},{"key":6,"val":"00000000004.41.1"},{"key":7,"val":"00000000006.55.5"},{"key":8,"val":"00000000004.42.1"},{"key":9,"val":"00000000004.46.1"},{"key":10,"val":"00000000004.47.1"}]} 2021-07-26T16:01:07.214 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-43 2021-07-26T16:01:07.215 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:07.216 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:07.216 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:07.260 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:07.261 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:07.481 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.43.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.39.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.41.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":3},"inc_marker":{"position":"00000000006.38.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.55.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.42.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.47.1"}}}] 2021-07-26T16:01:07.482 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-43 2021-07-26T16:01:07.482 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:07.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:07.484 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:07.526 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:07.527 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:07.735 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000006.43.5"},{"key":1,"val":"00000000004.39.1"},{"key":2,"val":"00000000006.41.5"},{"key":3,"val":"00000000004.78.1"},{"key":4,"val":"00000000006.38.5"},{"key":5,"val":"00000000004.29.1"},{"key":6,"val":"00000000004.41.1"},{"key":7,"val":"00000000006.55.5"},{"key":8,"val":"00000000004.42.1"},{"key":9,"val":"00000000004.46.1"},{"key":10,"val":"00000000004.47.1"}]} 2021-07-26T16:01:07.736 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-43 2021-07-26T16:01:07.736 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:07.737 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:07.738 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:07.781 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:07.781 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:07.985 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.43.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.39.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.41.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.78.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.38.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.29.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.41.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.55.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.42.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.47.1"}}}] 2021-07-26T16:01:07.986 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-43 2021-07-26T16:01:07.987 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:07.987 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-43', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:07.988 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-43 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:08.027 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:08.028 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:08.231 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":"00000000002.47.5"},{"key":1,"val":""},{"key":2,"val":"00000000002.42.5"},{"key":3,"val":""},{"key":4,"val":"00000000002.36.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000002.57.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:01:08.232 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-43 2021-07-26T16:01:08.233 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:08.233 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-43', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:08.234 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-43 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:08.278 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:08.278 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:08.494 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.47.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.42.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.36.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000002.57.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:01:08.495 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-43 2021-07-26T16:01:08.495 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-43 zones={test-zone2, test-zone1} 2021-07-26T16:01:08.504 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T16:01:08.510 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:01:08.511 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:01:08.511 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:01:08.512 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:01:08.513 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T16:01:08.513 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T16:01:08.516 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T16:01:08.516 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T16:01:08.517 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T16:01:08.522 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:01:08.523 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:01:08.524 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:01:08.524 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:01:08.524 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T16:01:08.525 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T16:01:08.525 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T16:01:08.526 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T16:01:08.535 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:08.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:08.691 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:08.797 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:08.852 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:08.966 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:09.073 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:09.128 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:09.238 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:09.340 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:09.396 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:09.506 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:09.610 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:01:09.664 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:01:09.778 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:01:09.877 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:01:09.932 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:01:10.041 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:01:10.145 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:01:10.200 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:01:10.316 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:01:10.425 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:01:10.484 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:01:10.594 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:01:10.692 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-43 zones={test-zone2, test-zone1} 2021-07-26T16:01:10.693 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:10.694 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:10.694 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:10.732 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:10.733 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:10.930 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315252.326998_170.3","last_update":"2021-07-26T16:00:52.326998Z"},{"marker":"1_1627315252.326998_380.3","last_update":"2021-07-26T16:00:52.326998Z"},{"marker":"1_1627315252.326998_226.2","last_update":"2021-07-26T16:00:52.326998Z"},{"marker":"1_1627315252.326998_341.3","last_update":"2021-07-26T16:00:52.326998Z"}] 2021-07-26T16:01:10.931 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T16:01:10.931 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:10.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:10.932 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:10.973 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:10.973 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:11.169 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627315252.326998_170.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.326998Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627315252.326998_380.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.326998Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627315252.326998_226.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.326998Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627315252.326998_341.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.326998Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:01:11.170 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T16:01:11.171 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:11.172 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:11.172 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:11.210 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:11.210 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:11.413 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315252.326998_170.3","last_update":"2021-07-26T16:00:52.326998Z"},{"marker":"1_1627315252.326998_380.3","last_update":"2021-07-26T16:00:52.326998Z"},{"marker":"1_1627315252.326998_226.2","last_update":"2021-07-26T16:00:52.326998Z"},{"marker":"1_1627315252.326998_341.3","last_update":"2021-07-26T16:00:52.326998Z"}] 2021-07-26T16:01:11.413 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T16:01:11.414 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:11.415 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:11.415 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:11.461 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:11.461 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:11.644 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627315252.326998_170.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.326998Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627315252.326998_380.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.326998Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627315252.326998_226.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.326998Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627315252.326998_341.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.326998Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:01:11.645 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T16:01:11.645 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:11.646 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:11.646 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:11.682 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:11.682 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:11.876 INFO:teuthology.orchestra.run.smithi087.stdout:[{"marker":"1_1627315252.031837_136.3","last_update":"2021-07-26T16:00:52.031837Z"},{"marker":"1_1627315252.031837_416.3","last_update":"2021-07-26T16:00:52.031837Z"},{"marker":"1_1627315252.031837_216.2","last_update":"2021-07-26T16:00:52.031837Z"},{"marker":"1_1627315252.031837_295.3","last_update":"2021-07-26T16:00:52.031837Z"}] 2021-07-26T16:01:11.877 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T16:01:11.877 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:11.878 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:11.879 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:11.921 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:11.921 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:12.139 INFO:teuthology.orchestra.run.smithi067.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8946806699955972168},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627315252.031837_136.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.031837Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627315252.031837_416.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.031837Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627315252.031837_216.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.031837Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627315252.031837_295.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:00:52.031837Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:01:12.140 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T16:01:12.140 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_enable_right_after_disable ... ok 2021-07-26T16:01:12.141 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-44 2021-07-26T16:01:12.169 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-45 2021-07-26T16:01:12.339 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:01:12.337+0000 7f283d7fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.340 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:01:12.337+0000 7f99b97fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.340 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:01:12.337+0000 7f2826ff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.341 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:01:12.337+0000 7f99a27fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.341 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:01:12.337+0000 7f2830ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.342 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:01:12.337+0000 7f99a17fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.343 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:01:12.337+0000 7f283cff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.343 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:01:12.337+0000 7f28287f8700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.344 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:01:12.337+0000 7f283e7fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.344 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:01:12.341+0000 7f999b7fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.344 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:01:12.341+0000 7f9998ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.345 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:01:12.341+0000 7f9998ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:01:12.603 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:12.604 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:12.604 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:12.643 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:12.792 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:01:12.822 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315272.195759_295.1","last_update":"2021-07-26T16:01:12.195759Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:01:12.822 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:01:12.823 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:12.824 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:12.824 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:12.863 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:12.864 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:13.059 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315272.195759_295.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:01:12.195759Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:01:13.059 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:01:13.060 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:01:13.060 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:13.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:13.062 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:13.101 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:13.102 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:13.291 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315272.195759_295.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:01:12.195759Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:01:13.292 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:01:13.292 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:13.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:13.293 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:13.334 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:13.334 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:13.539 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000001.38.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.40.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.38.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.50.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:01:13.540 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-44 2021-07-26T16:01:13.541 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:13.541 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:13.542 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:13.585 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:13.585 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:13.774 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.38.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.40.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.38.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.50.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:01:13.775 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-44 2021-07-26T16:01:13.776 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:13.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:13.777 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:13.818 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:13.819 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:14.027 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000001.38.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.40.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.38.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.50.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:01:14.028 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-44 2021-07-26T16:01:14.028 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:14.029 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:14.030 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:14.074 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:14.074 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:14.279 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.38.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.40.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.38.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.50.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:01:14.280 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-44 2021-07-26T16:01:14.281 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:14.281 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:14.282 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:14.317 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:14.318 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:14.509 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":"00000000001.63.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.61.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.63.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.56.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:01:14.510 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-44 2021-07-26T16:01:14.510 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:14.511 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:14.512 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:14.560 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:14.561 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:14.766 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.63.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.61.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.63.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.56.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:01:14.767 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-44 2021-07-26T16:01:14.768 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-44 zones={test-zone2, test-zone1} 2021-07-26T16:01:14.777 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T16:01:14.783 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:01:14.783 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:01:14.784 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:01:14.784 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:01:14.785 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T16:01:14.790 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:01:14.791 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:01:14.791 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:01:14.792 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:01:14.802 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:14.860 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:14.973 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:15.080 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:15.135 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:15.245 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:15.349 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:15.404 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:15.527 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:15.629 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:15.683 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:15.793 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:15.897 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-44 zones={test-zone2, test-zone1} 2021-07-26T16:01:15.898 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:15.899 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:15.900 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:15.943 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:15.944 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:16.158 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000001.34.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.50.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.45.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.51.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:01:16.159 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-45 2021-07-26T16:01:16.159 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:16.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:16.161 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:16.205 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:16.206 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:16.417 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.34.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.50.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.45.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.51.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:01:16.418 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-45 2021-07-26T16:01:16.418 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:16.419 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:16.420 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:16.465 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:16.465 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:16.654 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000001.34.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.50.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.45.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.51.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:01:16.655 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-45 2021-07-26T16:01:16.655 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:16.656 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:16.657 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:16.700 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:16.700 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:16.909 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.34.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.50.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.45.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.51.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:01:16.909 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-45 2021-07-26T16:01:16.910 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:16.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:16.911 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:16.950 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:17.145 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":"00000000001.40.5"},{"key":1,"val":""},{"key":2,"val":"00000000001.68.5"},{"key":3,"val":""},{"key":4,"val":"00000000001.40.5"},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":"00000000001.64.5"},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:01:17.146 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-45 2021-07-26T16:01:17.147 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:17.147 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:17.148 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:17.193 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:17.193 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:17.425 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.40.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.68.5"}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.40.5"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.64.5"}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:01:17.425 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-45 2021-07-26T16:01:17.426 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-45 zones={test-zone2, test-zone1} 2021-07-26T16:01:17.435 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T16:01:17.440 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:01:17.441 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:01:17.441 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:01:17.442 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:01:17.442 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T16:01:17.492 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:01:17.493 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:01:17.493 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:01:17.494 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:01:17.551 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:17.604 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:17.710 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:01:17.813 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:17.868 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:17.978 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:01:18.089 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:18.147 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:18.257 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:01:18.361 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:18.416 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:18.525 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:01:18.635 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-45 zones={test-zone2, test-zone1} 2021-07-26T16:01:18.636 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ldpzkr-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:01:18.636 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ldpzkr-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:01:18.637 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ldpzkr-44 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T16:01:18.677 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:18.678 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:18.954 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'disable', '--bucket', 'ldpzkr-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:01:18.955 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'disable', '--bucket', 'ldpzkr-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:01:18.955 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync disable --bucket ldpzkr-45 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T16:01:18.995 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:18.996 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:19.267 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:19.268 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:19.268 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:19.346 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:19.346 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:19.535 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:01:19.569 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315279.215808_301.1","last_update":"2021-07-26T16:01:19.215808Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:01:19.569 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:01:19.570 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:19.571 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:19.571 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:19.611 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:19.611 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:19.797 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315272.195759_295.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:01:12.195759Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:01:19.798 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315279.215808_301.1 target=1_1627315272.195759_295.1 2021-07-26T16:01:24.799 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:24.800 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:24.800 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:24.842 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:24.843 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:25.055 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315279.215808_301.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:01:19.215808Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:01:25.055 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:01:25.056 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:01:25.056 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:25.057 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:25.057 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:25.097 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:25.097 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:25.300 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315279.215808_301.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:01:19.215808Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:01:25.300 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:01:25.699 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'ldpzkr-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:01:25.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'ldpzkr-44', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:01:25.700 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket ldpzkr-44 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T16:01:25.743 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:25.744 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:26.038 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'enable', '--bucket', 'ldpzkr-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:01:26.038 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'enable', '--bucket', 'ldpzkr-45', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:01:26.039 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync enable --bucket ldpzkr-45 --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T16:01:26.084 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:26.085 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:26.361 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:26.362 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:26.362 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:26.444 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:26.445 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:26.660 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000006.49.1"},{"key":1,"val":"00000000004.60.1"},{"key":2,"val":"00000000006.51.1"},{"key":3,"val":"00000000004.40.1"},{"key":4,"val":"00000000006.52.1"},{"key":5,"val":"00000000004.25.1"},{"key":6,"val":"00000000004.50.1"},{"key":7,"val":"00000000006.56.1"},{"key":8,"val":"00000000004.31.1"},{"key":9,"val":"00000000004.38.1"},{"key":10,"val":"00000000004.46.1"}]} 2021-07-26T16:01:26.660 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-44 2021-07-26T16:01:26.661 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:26.661 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:26.662 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:26.707 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:26.707 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:26.916 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:01:26.917 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone2 behind zone test-zone1: shard=0 master=00000000006.49.1 target=, shard=1 master=00000000004.60.1 target=, shard=2 master=00000000006.51.1 target=, shard=3 master=00000000004.40.1 target=, shard=4 master=00000000006.52.1 target=, shard=5 master=00000000004.25.1 target=, shard=6 master=00000000004.50.1 target=, shard=7 master=00000000006.56.1 target=, shard=8 master=00000000004.31.1 target=, shard=9 master=00000000004.38.1 target=, shard=10 master=00000000004.46.1 target= 2021-07-26T16:01:31.918 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:31.919 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:31.920 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:31.963 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:31.963 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:32.194 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.49.1"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.51.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.52.1"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.56.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:01:32.195 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.60.1 target=, shard=5 master=00000000004.25.1 target=, shard=9 master=00000000004.38.1 target= 2021-07-26T16:01:37.196 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:37.197 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:37.197 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:37.241 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:37.242 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:37.451 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.49.1"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.51.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.52.1"}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.56.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:01:37.452 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone2 behind zone test-zone1: shard=1 master=00000000004.60.1 target=, shard=5 master=00000000004.25.1 target=, shard=9 master=00000000004.38.1 target= 2021-07-26T16:01:42.453 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:42.454 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:42.455 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:42.499 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:42.729 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.49.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.51.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.52.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.56.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:01:42.730 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-44 2021-07-26T16:01:42.730 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:42.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:42.731 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:42.773 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:42.773 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:42.999 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000006.49.1"},{"key":1,"val":"00000000004.60.1"},{"key":2,"val":"00000000006.51.1"},{"key":3,"val":"00000000004.40.1"},{"key":4,"val":"00000000006.52.1"},{"key":5,"val":"00000000004.25.1"},{"key":6,"val":"00000000004.50.1"},{"key":7,"val":"00000000006.56.1"},{"key":8,"val":"00000000004.31.1"},{"key":9,"val":"00000000004.38.1"},{"key":10,"val":"00000000004.46.1"}]} 2021-07-26T16:01:43.000 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-44 2021-07-26T16:01:43.001 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:43.002 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:43.002 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:43.046 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:43.047 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:43.250 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:01:43.252 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:01:48.253 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:48.254 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:48.255 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:48.298 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:48.298 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:48.526 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:01:48.526 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:01:53.528 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:53.529 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:53.529 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:53.573 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:53.574 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:53.768 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:01:53.768 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:01:58.771 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:58.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:01:58.772 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:01:58.814 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:01:58.815 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:01:59.032 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:01:59.034 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:02:04.035 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:04.036 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:04.037 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:04.081 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:04.081 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:04.294 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:02:04.295 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:02:09.297 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:09.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:09.298 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:09.341 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:09.341 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:09.553 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:02:09.553 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:02:14.554 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:14.555 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:14.556 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:14.596 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:14.596 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:14.787 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:02:14.791 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:02:19.792 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:19.793 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:19.794 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:19.838 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:20.039 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:02:20.040 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:02:25.041 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:25.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:25.042 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:25.086 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:25.087 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:25.285 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:02:25.286 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:02:30.287 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:30.288 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:30.289 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:30.332 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:30.333 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:30.532 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:02:30.532 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:02:35.533 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:35.534 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:35.535 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:35.578 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:35.580 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:35.777 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:02:35.778 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:02:40.780 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:40.780 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:40.781 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:40.823 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:41.031 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:02:41.032 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:02:46.033 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:46.034 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:46.035 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:46.082 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:46.083 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:46.284 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:02:46.285 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:02:51.286 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:51.287 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:51.287 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:51.330 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:51.331 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:51.543 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:02:51.544 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:02:56.545 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:56.546 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:02:56.547 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:02:56.594 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:02:56.594 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:02:56.794 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:02:56.795 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:01.797 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:01.797 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:01.798 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:01.843 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:01.843 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:02.055 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:02.055 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:07.057 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:07.059 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:07.060 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:07.104 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:07.105 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:07.312 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:07.313 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:12.315 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:12.315 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:12.316 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:12.362 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:12.362 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:12.569 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:12.570 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:17.571 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:17.572 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:17.572 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:17.616 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:17.617 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:17.823 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:17.824 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:22.825 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:22.826 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:22.828 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:22.872 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:23.079 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:23.080 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:28.081 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:28.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:28.083 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:28.125 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:28.126 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:28.340 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:28.340 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:33.341 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:33.342 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:33.343 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:33.386 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:33.386 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:33.604 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:33.605 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:38.607 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:38.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:38.608 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:38.654 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:38.654 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:38.868 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.41.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:38.868 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=2 master=00000000006.51.1 target=00000000002.41.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:43.870 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:43.871 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:43.871 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:43.916 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:43.916 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:44.137 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.51.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:44.138 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:49.140 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:49.141 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:49.141 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:49.183 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:49.183 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:49.401 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.51.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:49.402 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:54.403 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:54.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:54.404 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:54.449 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:54.450 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:54.663 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.51.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:54.664 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:03:59.665 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:59.666 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:03:59.666 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:03:59.706 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:03:59.706 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:03:59.911 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.51.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.42.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"stopped","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:03:59.911 WARNING:rgw_multi.tests:bucket ldpzkr-44 zone test-zone3 behind zone test-zone1: shard=0 master=00000000006.49.1 target=00000000002.39.1, shard=4 master=00000000006.52.1 target=00000000002.42.1, shard=7 master=00000000006.56.1 target=00000000002.51.1 2021-07-26T16:04:04.912 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:04.913 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:04.914 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:04.959 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:04.960 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:05.180 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.49.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.60.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.51.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.40.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.52.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.25.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.50.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.56.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.31.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.38.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.46.1"}}}] 2021-07-26T16:04:05.180 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-44 2021-07-26T16:04:05.181 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:05.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-44', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:05.182 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-44 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:05.220 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:05.220 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:05.433 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":"00000000004.77.5"},{"key":1,"val":"00000000002.68.1"},{"key":2,"val":"00000000004.75.5"},{"key":3,"val":"00000000002.48.1"},{"key":4,"val":"00000000004.73.5"},{"key":5,"val":"00000000002.30.1"},{"key":6,"val":"00000000002.71.1"},{"key":7,"val":"00000000004.62.5"},{"key":8,"val":"00000000002.40.1"},{"key":9,"val":"00000000002.46.1"},{"key":10,"val":"00000000002.53.1"}]} 2021-07-26T16:04:05.434 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-44 2021-07-26T16:04:05.434 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:05.435 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-44', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:05.436 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-44 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:05.478 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:05.479 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:05.697 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj3","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.77.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.68.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj2","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.75.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.48.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj1","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.73.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.30.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.71.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj4","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000004.62.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.40.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.46.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.53.1"}}}] 2021-07-26T16:04:05.697 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-44 2021-07-26T16:04:05.698 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-44 zones={test-zone2, test-zone1} 2021-07-26T16:04:05.712 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T16:04:05.719 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:04:05.720 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:04:05.720 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:04:05.721 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:04:05.721 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T16:04:05.722 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T16:04:05.722 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T16:04:05.722 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T16:04:05.723 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T16:04:05.729 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:04:05.730 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:04:05.730 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:04:05.731 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:04:05.731 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T16:04:05.732 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T16:04:05.732 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T16:04:05.733 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T16:04:05.743 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:04:05.795 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:04:05.910 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:04:06.020 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:04:06.075 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:04:06.193 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:04:06.292 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:04:06.347 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:04:06.457 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:04:06.564 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:04:06.623 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:04:06.726 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:04:06.824 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:04:06.879 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:04:06.981 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:04:07.080 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:04:07.135 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:04:07.246 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:04:07.344 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:04:07.400 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:04:07.505 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:04:07.609 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:04:07.668 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:04:07.784 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:04:07.894 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-44 zones={test-zone2, test-zone1} 2021-07-26T16:04:07.894 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:07.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:07.896 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:07.935 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:07.935 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:08.159 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000006.40.5"},{"key":1,"val":"00000000004.57.1"},{"key":2,"val":"00000000006.60.5"},{"key":3,"val":"00000000004.58.1"},{"key":4,"val":"00000000006.51.5"},{"key":5,"val":"00000000004.154.1"},{"key":6,"val":"00000000004.27.1"},{"key":7,"val":"00000000006.61.5"},{"key":8,"val":"00000000004.52.1"},{"key":9,"val":"00000000004.44.1"},{"key":10,"val":"00000000004.33.1"}]} 2021-07-26T16:04:08.159 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-45 2021-07-26T16:04:08.160 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:08.160 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:08.161 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:08.206 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:08.459 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.40.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.57.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.60.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.58.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.51.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.154.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.27.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000006.61.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.33.1"}}}] 2021-07-26T16:04:08.465 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-45 2021-07-26T16:04:08.466 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:08.467 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:08.467 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:08.508 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:08.508 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:08.738 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000006.40.5"},{"key":1,"val":"00000000004.57.1"},{"key":2,"val":"00000000006.60.5"},{"key":3,"val":"00000000004.58.1"},{"key":4,"val":"00000000006.51.5"},{"key":5,"val":"00000000004.154.1"},{"key":6,"val":"00000000004.27.1"},{"key":7,"val":"00000000006.61.5"},{"key":8,"val":"00000000004.52.1"},{"key":9,"val":"00000000004.44.1"},{"key":10,"val":"00000000004.33.1"}]} 2021-07-26T16:04:08.738 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-45 2021-07-26T16:04:08.739 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:08.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:08.740 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:08.784 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:08.784 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:08.998 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.40.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.57.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.60.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.58.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.51.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.154.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.27.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000006.61.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.52.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.44.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.33.1"}}}] 2021-07-26T16:04:08.999 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-45 2021-07-26T16:04:09.000 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:09.000 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-45', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:09.001 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-45 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:09.040 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:09.040 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:09.262 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":"00000000004.45.1"},{"key":1,"val":"00000000002.75.1"},{"key":2,"val":"00000000004.76.1"},{"key":3,"val":"00000000002.71.1"},{"key":4,"val":"00000000004.45.1"},{"key":5,"val":"00000000002.144.1"},{"key":6,"val":"00000000002.33.1"},{"key":7,"val":"00000000004.72.1"},{"key":8,"val":"00000000002.72.1"},{"key":9,"val":"00000000002.46.1"},{"key":10,"val":"00000000002.43.1"}]} 2021-07-26T16:04:09.263 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-45 2021-07-26T16:04:09.263 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:09.264 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-45', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:09.265 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-45 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:09.311 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:09.312 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:09.559 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj7","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.45.1"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.75.1"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj6","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.76.1"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.71.1"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj5","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.45.1"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.144.1"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.33.1"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"obj8","instance":"","ns":""},"count":2},"inc_marker":{"position":"00000000004.72.1"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.72.1"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.46.1"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.1"}}}] 2021-07-26T16:04:09.560 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-45 2021-07-26T16:04:09.561 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-45 zones={test-zone2, test-zone1} 2021-07-26T16:04:09.571 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T16:04:09.578 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:04:09.579 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:04:09.579 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:04:09.580 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:04:09.580 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T16:04:09.581 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T16:04:09.581 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T16:04:09.582 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T16:04:09.582 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T16:04:09.589 DEBUG:tasks.rgw_multi.zone_rados:o=obj1 2021-07-26T16:04:09.589 DEBUG:tasks.rgw_multi.zone_rados:o=obj2 2021-07-26T16:04:09.590 DEBUG:tasks.rgw_multi.zone_rados:o=obj3 2021-07-26T16:04:09.590 DEBUG:tasks.rgw_multi.zone_rados:o=obj4 2021-07-26T16:04:09.591 DEBUG:tasks.rgw_multi.zone_rados:o=obj5 2021-07-26T16:04:09.591 DEBUG:tasks.rgw_multi.zone_rados:o=obj6 2021-07-26T16:04:09.591 DEBUG:tasks.rgw_multi.zone_rados:o=obj7 2021-07-26T16:04:09.592 DEBUG:tasks.rgw_multi.zone_rados:o=obj8 2021-07-26T16:04:09.605 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:04:09.659 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:04:09.761 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj1 2021-07-26T16:04:09.862 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:04:09.915 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:04:10.025 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj2 2021-07-26T16:04:10.130 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:04:10.183 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:04:10.293 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj3 2021-07-26T16:04:10.397 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:04:10.455 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:04:10.564 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj4 2021-07-26T16:04:10.668 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:04:10.723 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:04:10.872 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj5 2021-07-26T16:04:10.976 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:04:11.035 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:04:11.149 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj6 2021-07-26T16:04:11.253 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:04:11.308 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:04:11.423 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj7 2021-07-26T16:04:11.530 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:04:11.588 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:04:11.696 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=obj8 2021-07-26T16:04:11.797 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-45 zones={test-zone2, test-zone1} 2021-07-26T16:04:11.798 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:11.798 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:11.799 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:11.836 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:12.059 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315286.325618_186.3","last_update":"2021-07-26T16:01:26.325618Z"},{"marker":"1_1627315295.767069_499.2","last_update":"2021-07-26T16:01:35.767069Z"},{"marker":"1_1627315295.767069_267.2","last_update":"2021-07-26T16:01:35.767069Z"},{"marker":"1_1627315295.767069_391.4","last_update":"2021-07-26T16:01:35.767069Z"}] 2021-07-26T16:04:12.060 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T16:04:12.060 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:12.061 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:12.061 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:12.103 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:12.103 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:12.320 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":5191808041300628880},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627315286.325618_186.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:26.325618Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627315295.767069_499.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:35.767069Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627315295.767069_267.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:35.767069Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627315295.767069_391.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:35.767069Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:04:12.320 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone2 source_zone=test-zone1 2021-07-26T16:04:12.321 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:12.322 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'datalog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:12.322 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 datalog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:12.362 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:12.363 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:12.595 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315286.325618_186.3","last_update":"2021-07-26T16:01:26.325618Z"},{"marker":"1_1627315295.767069_499.2","last_update":"2021-07-26T16:01:35.767069Z"},{"marker":"1_1627315295.767069_267.2","last_update":"2021-07-26T16:01:35.767069Z"},{"marker":"1_1627315295.767069_391.4","last_update":"2021-07-26T16:01:35.767069Z"}] 2021-07-26T16:04:12.596 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T16:04:12.598 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:12.599 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'data', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:12.600 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 data sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:12.638 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:12.846 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":12512331181028984470},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627315286.325618_186.3","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:26.325618Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627315295.767069_499.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:35.767069Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627315295.767069_267.2","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:35.767069Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627315295.767069_391.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:35.767069Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:04:12.846 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone3 source_zone=test-zone1 2021-07-26T16:04:12.847 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:12.848 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'datalog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:12.849 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 datalog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:12.887 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:13.106 INFO:teuthology.orchestra.run.smithi087.stdout:[{"marker":"1_1627315296.055282_143.6","last_update":"2021-07-26T16:01:36.055282Z"},{"marker":"1_1627315296.055282_539.6","last_update":"2021-07-26T16:01:36.055282Z"},{"marker":"1_1627315296.055282_240.4","last_update":"2021-07-26T16:01:36.055282Z"},{"marker":"1_1627315296.055282_338.6","last_update":"2021-07-26T16:01:36.055282Z"}] 2021-07-26T16:04:13.107 INFO:rgw_multi.tests:starting data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T16:04:13.108 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:13.109 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'data', 'sync', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:13.110 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 data sync status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:13.153 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:13.153 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:13.386 INFO:teuthology.orchestra.run.smithi067.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"instance_id":8946806699955972168},"markers":[{"key":0,"val":{"status":"incremental-sync","marker":"1_1627315296.055282_143.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:36.055282Z"}},{"key":1,"val":{"status":"incremental-sync","marker":"1_1627315296.055282_539.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:36.055282Z"}},{"key":2,"val":{"status":"incremental-sync","marker":"1_1627315296.055282_240.4","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:36.055282Z"}},{"key":3,"val":{"status":"incremental-sync","marker":"1_1627315296.055282_338.6","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T16:01:36.055282Z"}}]},"full_sync":{"total":0,"complete":0}} 2021-07-26T16:04:13.387 INFO:rgw_multi.tests:finished data checkpoint for target_zone=test-zone1 source_zone=test-zone2 2021-07-26T16:04:13.388 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_sync_disable_enable ... ok 2021-07-26T16:04:13.389 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-46 2021-07-26T16:04:13.423 INFO:rgw_multi.tests:create bucket zone=test-zone2 name=ldpzkr-47 2021-07-26T16:04:15.703 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:15.704 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:15.705 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:15.743 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:15.744 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:15.955 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000011.68.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:04:15.955 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-46 2021-07-26T16:04:15.956 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:15.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:15.960 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:16.004 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:16.004 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:16.245 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.68.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:04:16.245 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-46 2021-07-26T16:04:16.246 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:16.247 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:16.248 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:16.289 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:16.289 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:16.514 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000011.68.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:04:16.514 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-46 2021-07-26T16:04:16.515 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:16.516 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:16.516 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:16.560 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:16.561 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:16.760 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000011.68.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:04:16.761 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-46 2021-07-26T16:04:16.761 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:16.762 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-46', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:16.763 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-46 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:16.801 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:17.021 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.82.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:04:17.022 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-46 2021-07-26T16:04:17.023 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:17.024 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-46', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:17.025 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-46 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:17.070 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:17.070 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:17.305 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"MULTIPART","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.82.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:04:17.305 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-46 2021-07-26T16:04:17.306 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-46 zones={test-zone2, test-zone1} 2021-07-26T16:04:17.315 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T16:04:17.363 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2021-07-26T16:04:17.364 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T16:04:17.370 DEBUG:tasks.rgw_multi.zone_rados:o=MULTIPART 2021-07-26T16:04:17.428 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-07-26T16:04:17.636 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-07-26T16:04:17.917 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=MULTIPART 2021-07-26T16:04:18.227 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-46 zones={test-zone2, test-zone1} 2021-07-26T16:04:18.228 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_multipart_object_sync ... ok 2021-07-26T16:04:18.228 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-48 2021-07-26T16:04:18.347 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:18.348 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:18.348 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:18.386 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:18.386 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:18.450 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:18.449+0000 7f28257f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:18.451 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:18.449+0000 7f99a3fff700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:18.451 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:18.449+0000 7f999affd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:18.452 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:18.449+0000 7f2831ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:18.454 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:18.453+0000 7f2826ff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:18.455 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:18.453+0000 7f2826ff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:18.455 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:18.453+0000 7f99a0ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:18.456 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:18.453+0000 7f99a0ff9700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:18.566 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:18.593 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315458.254335_358.1","last_update":"2021-07-26T16:04:18.254335Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:18.593 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:18.594 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:18.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:18.595 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:18.638 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:18.639 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:18.827 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315458.254335_358.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:18.254335Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:18.828 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:18.828 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:18.829 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:18.829 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:18.830 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:18.869 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:18.869 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:19.074 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315458.254335_358.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:18.254335Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:19.074 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:19.075 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-48', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:19.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-48', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:19.076 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-48 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:19.117 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:19.334 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.47.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.31.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:04:19.335 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-48 2021-07-26T16:04:19.335 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-48', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:19.336 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-48', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:19.336 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-48 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:19.382 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:19.382 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:19.606 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"testobj-sse-c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.47.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"testobj-sse-kms","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.31.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:04:19.607 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-48 2021-07-26T16:04:19.711 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_encrypted_object_sync ... ok 2021-07-26T16:04:19.712 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-49 2021-07-26T16:04:19.851 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:19.849+0000 7f9999ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:19.853 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:19.849+0000 7f282affd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:19.853 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:19.849+0000 7f28297fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:19.854 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:19.849+0000 7f9994ff1700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:19.855 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:19.849+0000 7f99a1ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:19.855 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:19.849+0000 7f28257f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:19.856 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:19.849+0000 7f28257f2700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:19.857 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:19.849+0000 7f99917ea700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:19.940 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:19.941 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:19.941 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:19.981 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:19.981 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:20.144 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:20.175 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315459.735812_362.1","last_update":"2021-07-26T16:04:19.735812Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:20.176 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:20.177 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:20.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:20.178 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:20.218 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:20.218 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:20.422 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315459.735812_362.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:19.735812Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:20.423 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:20.423 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:20.424 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:20.424 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:20.425 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:20.502 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:20.502 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:20.707 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315459.735812_362.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:19.735812Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:20.708 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:20.709 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:20.710 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:20.711 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:20.751 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:20.752 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:20.964 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.64.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.37.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.22.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.46.5"}]} 2021-07-26T16:04:20.965 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-49 2021-07-26T16:04:20.965 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:20.966 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:20.966 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:21.009 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:21.010 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:21.223 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.64.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.37.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.22.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.46.5"}}}] 2021-07-26T16:04:21.224 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-49 2021-07-26T16:04:21.224 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:21.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:21.227 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:21.269 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:21.269 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:21.491 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.64.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.37.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.22.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.46.5"}]} 2021-07-26T16:04:21.491 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-49 2021-07-26T16:04:21.492 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:21.492 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:21.493 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:21.537 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:21.750 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.64.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.37.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.22.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.46.5"}}}] 2021-07-26T16:04:21.750 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-49 2021-07-26T16:04:21.751 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:21.751 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-49', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:21.752 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-49 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:21.833 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:21.833 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:22.044 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.78.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.57.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.26.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.62.5"}]} 2021-07-26T16:04:22.045 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-49 2021-07-26T16:04:22.046 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:22.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:22.047 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:22.092 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:22.092 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:22.329 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.78.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.57.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.26.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.62.5"}}}] 2021-07-26T16:04:22.330 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-49 2021-07-26T16:04:22.331 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-49 zones={test-zone2, test-zone1} 2021-07-26T16:04:22.339 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T16:04:22.345 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-07-26T16:04:22.346 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-07-26T16:04:22.346 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-07-26T16:04:22.347 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-07-26T16:04:22.347 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T16:04:22.352 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-07-26T16:04:22.353 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-07-26T16:04:22.353 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-07-26T16:04:22.354 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-07-26T16:04:22.407 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T16:04:22.461 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T16:04:22.569 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T16:04:22.671 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T16:04:22.729 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T16:04:22.841 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T16:04:22.948 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T16:04:23.003 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T16:04:23.114 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T16:04:23.222 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T16:04:23.280 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T16:04:23.395 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T16:04:23.500 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-49 zones={test-zone2, test-zone1} 2021-07-26T16:04:23.500 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:04:23.501 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:04:23.502 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T16:04:23.535 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:23.536 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:23.751 INFO:rgw_multi.tests:create bucket zone=test-zone1 name=ldpzkr-50 2021-07-26T16:04:23.855 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:23.853+0000 7f283f7fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:23.856 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:23.853+0000 7f28327fc700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:23.856 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:23.849+0000 7f9996ff5700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:23.856 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:23.849+0000 7f99927ec700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:23.857 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:23.853+0000 7f9995ff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:23.857 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:23.853+0000 7f99987f8700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:23.858 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:23.853+0000 7f282affd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:23.858 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:23.853+0000 7f282affd700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:23.975 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:23.976 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:23.977 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:24.019 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:24.020 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:24.175 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:24.205 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315463.774901_367.1","last_update":"2021-07-26T16:04:23.774901Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:24.206 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:24.206 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:24.207 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:24.207 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:24.248 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:24.248 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:24.437 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315463.774901_367.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:23.774901Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:24.437 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:24.438 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:24.438 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:24.439 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:24.439 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:24.477 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:24.478 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:24.660 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315463.774901_367.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:23.774901Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:24.660 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:24.661 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:24.661 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:24.662 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:24.705 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:24.706 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:24.907 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.44.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.51.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.61.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.67.5"}]} 2021-07-26T16:04:24.908 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-50 2021-07-26T16:04:24.909 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:24.909 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:24.910 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:24.952 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:24.953 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:25.175 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.44.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.51.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.61.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.67.5"}}}] 2021-07-26T16:04:25.175 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone2 source_zone=test-zone1 bucket=ldpzkr-50 2021-07-26T16:04:25.176 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:25.177 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:25.177 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:25.218 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:25.219 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:25.432 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.44.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.51.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.61.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.67.5"}]} 2021-07-26T16:04:25.433 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-50 2021-07-26T16:04:25.433 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:25.434 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:25.434 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:25.477 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:25.477 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:25.679 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.44.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.51.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.61.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.67.5"}}}] 2021-07-26T16:04:25.679 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-50 2021-07-26T16:04:25.680 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:25.681 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bilog', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-50', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:25.682 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bilog status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-50 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:25.766 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:25.766 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:25.966 INFO:teuthology.orchestra.run.smithi087.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000001.69.5"},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":"00000000001.64.5"},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":"00000000001.72.5"},{"key":9,"val":""},{"key":10,"val":"00000000001.85.5"}]} 2021-07-26T16:04:25.967 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-50 2021-07-26T16:04:25.967 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:25.968 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone2', '--bucket', 'ldpzkr-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:25.969 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bucket sync markers --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone2 --bucket ldpzkr-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:26.013 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:26.013 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:26.244 INFO:teuthology.orchestra.run.smithi067.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"a","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.69.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"d","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.64.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"c","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.72.5"}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"b","instance":"","ns":""},"count":1},"inc_marker":{"position":"00000000001.85.5"}}}] 2021-07-26T16:04:26.245 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone1 source_zone=test-zone2 bucket=ldpzkr-50 2021-07-26T16:04:26.245 INFO:tasks.rgw_multi.zone_rados:comparing bucket=ldpzkr-50 zones={test-zone2, test-zone1} 2021-07-26T16:04:26.254 DEBUG:tasks.rgw_multi.zone_rados:bucket1 objects: 2021-07-26T16:04:26.260 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-07-26T16:04:26.260 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-07-26T16:04:26.261 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-07-26T16:04:26.261 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-07-26T16:04:26.262 DEBUG:tasks.rgw_multi.zone_rados:bucket2 objects: 2021-07-26T16:04:26.267 DEBUG:tasks.rgw_multi.zone_rados:o=a 2021-07-26T16:04:26.268 DEBUG:tasks.rgw_multi.zone_rados:o=b 2021-07-26T16:04:26.268 DEBUG:tasks.rgw_multi.zone_rados:o=c 2021-07-26T16:04:26.268 DEBUG:tasks.rgw_multi.zone_rados:o=d 2021-07-26T16:04:26.278 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T16:04:26.331 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T16:04:26.445 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=a 2021-07-26T16:04:26.548 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T16:04:26.612 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T16:04:26.722 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=b 2021-07-26T16:04:26.828 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T16:04:26.883 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T16:04:26.992 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=c 2021-07-26T16:04:27.096 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T16:04:27.155 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T16:04:27.263 DEBUG:tasks.rgw_multi.zone_rados:comparing key name=d 2021-07-26T16:04:27.360 INFO:tasks.rgw_multi.zone_rados:success, bucket identical: bucket=ldpzkr-50 zones={test-zone2, test-zone1} 2021-07-26T16:04:27.361 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:04:27.361 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '1', '--rgw-sync-log-trim-min-cold-buckets', '0', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:04:27.362 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 1 --rgw-sync-log-trim-min-cold-buckets 0 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T16:04:27.402 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:27.405 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:27.626 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'ldpzkr-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:27.627 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'ldpzkr-50', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:27.627 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket ldpzkr-50 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:27.707 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:27.708 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:27.924 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2021-07-26T16:04:27.925 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'ldpzkr-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:27.926 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'ldpzkr-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:27.927 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket ldpzkr-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:27.964 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:27.965 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:28.174 INFO:teuthology.orchestra.run.smithi067.stdout:[{"op_id":"1#00000000001.64.5","op_tag":"6ccbe144-1255-4ce6-93aa-fdbfdac85106.4936.1970","op":"write","object":"a","instance":"","state":"complete","index_ver":1,"timestamp":"2021-07-26T16:04:19.746101026Z","ver":{"pool":9,"epoch":4},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-49:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.14"}]},{"op_id":"5#00000000001.37.5","op_tag":"6ccbe144-1255-4ce6-93aa-fdbfdac85106.4936.1999","op":"write","object":"d","instance":"","state":"complete","index_ver":1,"timestamp":"2021-07-26T16:04:19.894586782Z","ver":{"pool":9,"epoch":2},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-49:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.14"}]},{"op_id":"8#00000000001.22.5","op_tag":"6ccbe144-1255-4ce6-93aa-fdbfdac85106.4936.1976","op":"write","object":"c","instance":"","state":"complete","index_ver":1,"timestamp":"2021-07-26T16:04:19.843744617Z","ver":{"pool":9,"epoch":1},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-49:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.14"}]},{"op_id":"10#00000000001.46.5","op_tag":"6ccbe144-1255-4ce6-93aa-fdbfdac85106.4936.1972","op":"write","object":"b","instance":"","state":"complete","index_ver":1,"timestamp":"2021-07-26T16:04:19.795813611Z","ver":{"pool":9,"epoch":2},"bilog_flags":0,"versioned":false,"owner":"","owner_display_name":"","zones_trace":[{"entry":"6ccbe144-1255-4ce6-93aa-fdbfdac85106:ldpzkr-49:6ccbe144-1255-4ce6-93aa-fdbfdac85106.4938.14"}]}] 2021-07-26T16:04:28.175 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:04:28.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'autotrim', '--rgw-sync-log-trim-max-buckets', '999', '--rgw-sync-log-trim-min-cold-buckets', '999', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0'] 2021-07-26T16:04:28.176 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog autotrim --rgw-sync-log-trim-max-buckets 999 --rgw-sync-log-trim-min-cold-buckets 999 --cluster c1 --debug-rgw 0 --debug-ms 0 2021-07-26T16:04:28.211 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:28.212 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:28.950 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'list', '--bucket', 'ldpzkr-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:28.951 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'list', '--bucket', 'ldpzkr-49', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:28.951 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog list --bucket ldpzkr-49 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:29.029 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:29.030 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:29.248 INFO:teuthology.orchestra.run.smithi067.stdout:[] 2021-07-26T16:04:29.249 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_index_log_trim ... ok 2021-07-26T16:04:29.259 INFO:tasks.rgw_multisite_tests:rgw_multi.tests.test_bucket_creation_time ... ok 2021-07-26T16:04:29.260 INFO:tasks.rgw_multisite_tests:log information for manual testing ... ok 2021-07-26T16:04:29.261 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:29.262 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:29.263 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:29.301 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:29.302 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:29.475 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:29.508 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315463.774901_367.1","last_update":"2021-07-26T16:04:23.774901Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:29.509 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:29.509 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:29.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:29.511 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:29.551 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:29.552 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:29.737 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315463.774901_367.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:23.774901Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:29.738 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:29.738 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:29.739 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:29.739 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:29.740 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:29.818 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:29.818 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:30.009 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315463.774901_367.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:23.774901Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:30.010 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:30.011 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:30.011 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:30.012 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:30.050 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:30.050 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:30.232 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:30.263 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315463.774901_367.1","last_update":"2021-07-26T16:04:23.774901Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:30.263 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:30.264 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:30.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:30.265 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:30.307 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:30.307 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:30.497 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315463.774901_367.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:23.774901Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:30.498 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:30.529 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:30.530 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:30.531 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:30.568 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:30.569 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:30.742 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:30.775 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315470.525200_378.1","last_update":"2021-07-26T16:04:30.525200Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:30.776 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:30.776 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:30.777 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:30.778 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:30.817 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:30.818 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:31.013 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315470.525200_378.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:30.525200Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:31.013 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:31.141 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:31.142 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:31.143 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:31.183 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:31.184 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:31.356 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:31.390 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315470.525200_378.1","last_update":"2021-07-26T16:04:30.525200Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:31.391 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:31.392 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:31.392 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:31.393 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:31.431 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:31.433 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:31.622 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315470.525200_378.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:30.525200Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:31.624 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:31.699 INFO:tasks.rgw_multisite_tests:test low level implementation of s3 notifications ... ok 2021-07-26T16:04:31.700 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:31.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:31.701 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:31.744 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:31.744 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:31.928 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:31.961 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315471.692638_380.1","last_update":"2021-07-26T16:04:31.692638Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:31.961 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:31.962 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:31.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:31.964 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:32.003 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:32.003 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:32.208 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315471.692638_380.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:31.692638Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:32.209 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:32.210 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:32.210 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:32.211 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:32.211 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:32.250 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:32.250 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:32.449 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315471.692638_380.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:31.692638Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:32.450 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:32.450 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:32.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:32.451 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:32.493 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:32.494 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:32.668 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:32.699 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315471.692638_380.1","last_update":"2021-07-26T16:04:31.692638Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:32.700 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:32.700 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:32.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:32.701 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:32.741 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:32.933 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315471.692638_380.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:31.692638Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:32.933 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:32.962 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:32.963 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:32.964 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:32.998 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:32.999 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:33.176 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:33.208 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315472.957399_384.1","last_update":"2021-07-26T16:04:32.957399Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:33.208 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:33.209 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:33.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:33.210 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:33.250 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:33.251 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:33.444 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315472.957399_384.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:32.957399Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:33.445 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:33.483 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:33.484 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:33.485 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:33.523 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:33.523 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:33.700 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:33.733 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315472.957399_384.1","last_update":"2021-07-26T16:04:32.957399Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:33.733 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:33.734 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:33.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:33.736 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:33.775 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:33.775 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:33.972 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315472.957399_384.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:32.957399Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:33.972 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:34.387 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-52', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:34.388 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-52', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:34.388 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-52 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:34.430 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:34.430 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:34.615 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.68.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.52.5"},{"key":4,"val":"00000000001.68.5"},{"key":5,"val":"00000000001.80.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.83.5"},{"key":8,"val":"00000000001.63.5"},{"key":9,"val":"00000000001.81.5"},{"key":10,"val":"00000000002.94.5"}]} 2021-07-26T16:04:34.615 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-52 2021-07-26T16:04:34.616 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-52', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:34.616 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-52', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:34.617 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-52 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:34.663 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:34.663 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:34.868 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.68.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.52.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.68.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.80.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.83.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.63.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.81.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.94.5"}}}] 2021-07-26T16:04:34.869 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-52 2021-07-26T16:04:34.886 WARNING:rgw_multi.tests_ps:superfluous records are found 2021-07-26T16:04:35.023 INFO:tasks.rgw_multisite_tests:test s3 records fetching ... ok 2021-07-26T16:04:35.024 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:35.025 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:35.026 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:35.066 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:35.067 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:35.233 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:35.264 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315475.017810_394.1","last_update":"2021-07-26T16:04:35.017810Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:35.265 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:35.265 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:35.266 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:35.267 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:35.307 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:35.307 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:35.508 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315475.017810_394.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:35.017810Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:35.508 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:35.509 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:35.509 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:35.510 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:35.510 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:35.586 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:35.586 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:35.768 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315475.017810_394.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:35.017810Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:35.769 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:35.769 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:35.770 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:35.771 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:35.811 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:35.812 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:35.994 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:36.025 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315475.017810_394.1","last_update":"2021-07-26T16:04:35.017810Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:36.026 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:36.027 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:36.027 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:36.028 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:36.067 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:36.067 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:36.263 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315475.017810_394.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:35.017810Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:36.263 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:36.292 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:36.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:36.294 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:36.329 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:36.330 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:36.508 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:36.534 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315476.288030_401.1","last_update":"2021-07-26T16:04:36.288030Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:36.535 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:36.535 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:36.536 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:36.536 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:36.577 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:36.577 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:36.764 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315476.288030_401.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:36.288030Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:36.765 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:36.902 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:36.903 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:36.904 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:36.945 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:36.946 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:37.125 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:37.157 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315476.288030_401.1","last_update":"2021-07-26T16:04:36.288030Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:37.158 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:37.158 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:37.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:37.159 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:37.201 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:37.202 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:37.393 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315476.288030_401.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:36.288030Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:37.393 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:37.482 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete ... ok 2021-07-26T16:04:37.483 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:37.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:37.484 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:37.524 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:37.525 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:37.698 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:37.729 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315477.475477_403.1","last_update":"2021-07-26T16:04:37.475477Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:37.730 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:37.730 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:37.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:37.731 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:37.772 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:37.773 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:37.973 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315477.475477_403.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:37.475477Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:37.974 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:37.974 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:37.975 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:37.975 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:37.976 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:38.016 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:38.016 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:38.211 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315477.475477_403.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:37.475477Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:38.212 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:38.212 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:38.213 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:38.214 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:38.252 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:38.253 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:38.431 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:38.464 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315477.475477_403.1","last_update":"2021-07-26T16:04:37.475477Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:38.464 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:38.465 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:38.466 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:38.466 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:38.506 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:38.506 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:38.682 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315477.475477_403.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:37.475477Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:38.682 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:38.890 INFO:tasks.rgw_multisite_tests:test s3 topics set/get/delete on master ... ok 2021-07-26T16:04:38.891 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:38.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:38.893 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:38.934 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:38.935 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:39.123 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:39.156 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315477.475477_403.1","last_update":"2021-07-26T16:04:37.475477Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:39.157 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:39.158 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:39.159 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:39.160 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:39.198 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:39.198 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:39.400 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315477.475477_403.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:37.475477Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:39.400 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:39.401 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:39.401 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:39.402 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:39.403 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:39.440 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:39.440 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:39.637 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315477.475477_403.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:37.475477Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:39.637 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:39.638 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:39.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:39.639 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:39.678 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:39.678 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:39.858 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:39.890 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315477.475477_403.1","last_update":"2021-07-26T16:04:37.475477Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:39.891 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:39.891 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:39.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:39.892 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:39.934 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:39.934 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:40.131 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315477.475477_403.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:37.475477Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:40.132 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:40.133 INFO:tasks.rgw_multisite_tests:test s3 topics with secret set/get/delete on master ... ok 2021-07-26T16:04:40.133 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:40.134 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:40.134 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:40.175 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:40.175 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:40.358 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:40.393 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315477.475477_403.1","last_update":"2021-07-26T16:04:37.475477Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:40.393 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:40.394 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:40.394 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:40.395 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:40.433 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:40.434 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:40.631 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315477.475477_403.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:37.475477Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:40.631 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:40.632 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:40.632 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:40.633 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:40.633 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:40.710 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:40.910 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315477.475477_403.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:37.475477Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:40.911 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:40.912 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:40.912 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:40.913 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:40.950 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:40.951 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:41.132 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:41.163 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315477.475477_403.1","last_update":"2021-07-26T16:04:37.475477Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:41.163 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:41.164 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:41.164 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:41.165 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:41.203 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:41.204 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:41.397 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315477.475477_403.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:37.475477Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:41.397 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:41.653 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete on master ... ok 2021-07-26T16:04:41.655 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_filter_on_master ... ok 2021-07-26T16:04:41.656 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_filter ... ok 2021-07-26T16:04:41.657 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:41.658 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:41.659 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:41.696 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:41.697 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:41.881 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:41.913 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315481.643343_416.1","last_update":"2021-07-26T16:04:41.643343Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:41.914 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:41.914 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:41.915 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:41.915 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:41.955 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:41.955 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:42.165 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315481.643343_416.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:41.643343Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:42.165 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:42.166 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:42.166 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:42.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:42.167 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:42.246 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:42.246 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:42.452 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315481.643343_416.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:41.643343Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:42.453 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:42.453 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:42.454 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:42.454 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:42.497 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:42.497 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:42.666 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:42.698 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315481.643343_416.1","last_update":"2021-07-26T16:04:41.643343Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:42.699 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:42.700 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:42.700 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:42.701 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:42.741 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:42.742 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:42.942 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315481.643343_416.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:41.643343Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:42.943 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:43.145 INFO:tasks.rgw_multisite_tests:test s3 notification set/get/delete on master ... ok 2021-07-26T16:04:43.146 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_objcet_timing ... ok 2021-07-26T16:04:43.146 INFO:tasks.rgw_multisite_tests:test pushing amqp s3 notification on master ... ok 2021-07-26T16:04:43.147 INFO:tasks.rgw_multisite_tests:test pushing kafka s3 notification on master ... ok 2021-07-26T16:04:43.147 INFO:tasks.rgw_multisite_tests:test pushing kafka s3 notification on master ... ok 2021-07-26T16:04:43.148 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_push_kafka_security_ssl ... ok 2021-07-26T16:04:43.148 INFO:tasks.rgw_multisite_tests:rgw_multi.tests_ps.test_ps_s3_notification_push_kafka_security_ssl_sasl ... ok 2021-07-26T16:04:43.149 INFO:tasks.rgw_multisite_tests:test deletion of multiple keys on master ... ok 2021-07-26T16:04:43.150 INFO:tasks.rgw_multisite_tests:test pushing http s3 notification on master ... ok 2021-07-26T16:04:43.150 INFO:tasks.rgw_multisite_tests:test that opaque id set in topic, is sent in notification ... ok 2021-07-26T16:04:43.151 INFO:tasks.rgw_multisite_tests:test that opaque id set in topic, is sent in notification on master ... ok 2021-07-26T16:04:43.152 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:43.152 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:43.153 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:43.191 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:43.191 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:43.370 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:43.403 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315483.138076_422.1","last_update":"2021-07-26T16:04:43.138076Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:43.403 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:43.404 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:43.404 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:43.405 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:43.447 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:43.447 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:43.652 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315483.138076_422.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:43.138076Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:43.653 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:43.655 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:43.656 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:43.656 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:43.657 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:43.736 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:43.738 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:43.931 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315483.138076_422.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:43.138076Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:43.931 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:43.932 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:43.932 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:43.933 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:43.973 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:43.973 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:44.163 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:44.194 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315483.138076_422.1","last_update":"2021-07-26T16:04:43.138076Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:44.194 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:44.195 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:44.195 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:44.196 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:44.234 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:44.234 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:44.431 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315483.138076_422.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:43.138076Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:44.432 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:44.448 INFO:tasks.rgw_multisite_tests:test set/get/delete of topic ... ok 2021-07-26T16:04:44.449 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:44.449 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:44.450 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:44.488 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:44.488 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:44.657 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:44.687 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315483.138076_422.1","last_update":"2021-07-26T16:04:43.138076Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:44.688 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:44.688 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:44.689 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:44.689 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:44.728 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:44.729 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:44.946 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315483.138076_422.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:43.138076Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:44.946 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:44.947 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:44.947 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:44.948 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:44.948 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:45.026 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:45.027 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:45.228 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315483.138076_422.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:43.138076Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:45.229 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:45.230 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:45.230 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:45.231 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:45.269 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:45.270 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:45.455 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:45.488 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315483.138076_422.1","last_update":"2021-07-26T16:04:43.138076Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:45.488 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:45.489 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:45.489 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:45.490 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:45.528 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:45.529 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:45.720 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315483.138076_422.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:43.138076Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:45.721 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:45.735 INFO:tasks.rgw_multisite_tests:test set topic with endpoint ... ok 2021-07-26T16:04:45.736 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:45.737 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:45.737 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:45.777 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:45.777 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:45.964 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:45.997 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315483.138076_422.1","last_update":"2021-07-26T16:04:43.138076Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:45.997 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:45.998 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:45.998 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:45.999 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:46.038 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:46.039 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:46.239 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315483.138076_422.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:43.138076Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:46.240 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:46.240 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:46.241 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:46.241 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:46.242 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:46.280 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:46.281 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:46.478 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315483.138076_422.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:43.138076Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:46.478 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:46.479 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:46.480 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:46.480 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:46.525 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:46.526 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:46.694 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:46.726 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315483.138076_422.1","last_update":"2021-07-26T16:04:43.138076Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:46.727 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:46.727 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:46.728 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:46.728 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:46.770 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:46.770 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:46.971 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315483.138076_422.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:43.138076Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:46.972 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:47.007 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:47.007 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:47.008 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:47.044 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:47.044 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:47.229 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:47.259 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315487.002174_426.1","last_update":"2021-07-26T16:04:47.002174Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:47.259 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:47.260 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:47.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:47.261 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:47.301 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:47.301 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:47.509 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315487.002174_426.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:47.002174Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:47.510 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:47.569 INFO:tasks.rgw_multisite_tests:test set/get/delete of notification ... ok 2021-07-26T16:04:47.570 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:47.570 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:47.571 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:47.608 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:47.608 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:47.789 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:47.822 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315487.563148_428.1","last_update":"2021-07-26T16:04:47.563148Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:47.822 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:47.823 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:47.823 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:47.824 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:47.864 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:47.864 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:48.074 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315487.563148_428.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:47.563148Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:48.074 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:48.075 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:48.075 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:48.076 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:48.076 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:48.115 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:48.116 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:48.315 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315487.563148_428.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:47.563148Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:48.315 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:48.316 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:48.317 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:48.317 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:48.357 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:48.357 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:48.541 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:48.567 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315487.563148_428.1","last_update":"2021-07-26T16:04:47.563148Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:48.568 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:48.568 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:48.569 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:48.569 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:48.608 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:48.608 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:48.790 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315487.563148_428.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:47.563148Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:48.791 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:48.828 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:48.828 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:48.829 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:48.865 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:48.865 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:49.052 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:49.084 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315488.823433_432.1","last_update":"2021-07-26T16:04:48.823433Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:49.084 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:49.085 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:49.085 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:49.086 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:49.129 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:49.130 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:49.326 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315488.823433_432.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:48.823433Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:49.327 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:49.382 INFO:tasks.rgw_multisite_tests:test set/get/delete of notification on specific events ... ok 2021-07-26T16:04:49.383 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:49.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:49.384 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:49.422 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:49.423 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:49.608 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:49.640 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315489.375798_434.1","last_update":"2021-07-26T16:04:49.375798Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:49.641 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:49.641 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:49.642 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:49.642 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:49.685 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:49.686 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:49.890 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315489.375798_434.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:49.375798Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:49.892 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:49.894 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:49.894 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:49.895 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:49.895 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:49.939 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:49.940 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:50.149 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315489.375798_434.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:49.375798Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:50.150 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:50.151 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:50.151 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:50.152 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:50.190 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:50.190 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:50.371 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:50.403 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315489.375798_434.1","last_update":"2021-07-26T16:04:49.375798Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:50.404 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:50.404 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:50.405 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:50.405 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:50.445 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:50.445 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:50.660 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315489.375798_434.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:49.375798Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:50.661 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:50.695 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:50.696 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:50.696 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:50.732 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:50.733 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:50.918 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:50.952 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315490.690754_438.1","last_update":"2021-07-26T16:04:50.690754Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:50.953 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:50.954 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:50.954 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:50.955 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:50.995 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:50.995 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:51.195 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315490.690754_438.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:50.690754Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:51.195 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:51.638 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:51.638 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:51.639 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-61 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:51.684 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:51.684 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:51.873 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.51.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.47.5"},{"key":4,"val":"00000000001.75.5"},{"key":5,"val":"00000000001.58.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.67.5"},{"key":8,"val":"00000000001.37.5"},{"key":9,"val":"00000000001.73.5"},{"key":10,"val":"00000000002.91.5"}]} 2021-07-26T16:04:51.873 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-61 2021-07-26T16:04:51.874 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:51.874 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:51.875 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-61 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:51.919 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:51.920 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:52.135 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.51.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.47.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.75.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.58.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.67.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.37.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.73.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.91.5"}}}] 2021-07-26T16:04:52.135 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-61 2021-07-26T16:04:52.220 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:52.221 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-61', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:52.222 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-61 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:52.259 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:52.260 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:52.471 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000004.55.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.49.5"},{"key":4,"val":"00000000002.79.5"},{"key":5,"val":"00000000002.60.5"},{"key":6,"val":""},{"key":7,"val":"00000000002.69.5"},{"key":8,"val":"00000000002.39.5"},{"key":9,"val":"00000000002.77.5"},{"key":10,"val":"00000000004.95.5"}]} 2021-07-26T16:04:52.472 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-61 2021-07-26T16:04:52.472 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:52.473 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-61', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:52.473 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-61 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:52.519 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:52.520 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:52.715 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.55.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.49.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.79.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.60.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.69.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.39.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.77.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.95.5"}}}] 2021-07-26T16:04:52.715 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-61 2021-07-26T16:04:52.775 INFO:tasks.rgw_multisite_tests:test set/get/delete of subscription ... ok 2021-07-26T16:04:52.776 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:52.776 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:52.777 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:52.816 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:52.817 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:53.006 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:53.040 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315492.769060_442.1","last_update":"2021-07-26T16:04:52.769060Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:53.041 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:53.042 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:53.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:53.043 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:53.082 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:53.082 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:53.295 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315492.769060_442.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:52.769060Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:53.296 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:53.296 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:53.297 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:53.297 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:53.298 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:53.374 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:53.374 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:53.584 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315492.769060_442.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:52.769060Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:53.584 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:53.585 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:53.586 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:53.586 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:53.630 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:53.630 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:53.809 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:53.841 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315492.769060_442.1","last_update":"2021-07-26T16:04:52.769060Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:53.841 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:53.842 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:53.843 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:53.843 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:53.882 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:53.883 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:54.108 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315492.769060_442.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:52.769060Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:54.108 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:54.267 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:54.265+0000 7f9999ffb700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.268 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:54.265+0000 7f9993fef700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.269 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:54.265+0000 7f99937ee700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.269 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:54.269+0000 7f9997ff7700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.270 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:54.265+0000 7f28277f6700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.271 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:54.269+0000 7f28297fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.273 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:54.269+0000 7f28297fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.273 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:54.269+0000 7f28297fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.274 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:54.269+0000 7f28317fa700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.275 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:04:54.273+0000 7f2825ff3700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.275 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:54.273+0000 7f999b7fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.276 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:04:54.273+0000 7f999b7fe700 -1 ERROR: _send_request(): get_sync_policy_handler() returned -2 2021-07-26T16:04:54.599 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:54.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:54.601 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:54.641 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:54.849 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.85.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.59.5"},{"key":4,"val":"00000000001.65.5"},{"key":5,"val":"00000000001.39.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.101.5"},{"key":8,"val":"00000000001.59.5"},{"key":9,"val":"00000000001.57.5"},{"key":10,"val":"00000000002.43.5"}]} 2021-07-26T16:04:54.850 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-62 2021-07-26T16:04:54.850 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:54.851 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:54.851 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:54.893 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:54.894 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:55.110 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.85.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.59.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.65.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.39.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.101.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.59.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.57.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.43.5"}}}] 2021-07-26T16:04:55.110 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-62 2021-07-26T16:04:55.539 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:55.540 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-62', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:55.540 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-62 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:55.581 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:55.581 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:55.787 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000001.74.5"},{"key":1,"val":"00000000003.87.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.61.5"},{"key":4,"val":"00000000001.65.5"},{"key":5,"val":"00000000003.47.5"},{"key":6,"val":""},{"key":7,"val":"00000000003.105.5"},{"key":8,"val":"00000000002.61.5"},{"key":9,"val":"00000000002.59.5"},{"key":10,"val":"00000000003.49.5"}]} 2021-07-26T16:04:55.788 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-62 2021-07-26T16:04:55.789 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:55.789 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-62', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:55.790 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-62 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:55.833 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:55.833 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:56.067 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.74.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.87.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.61.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.65.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.47.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.105.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.61.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.59.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.49.5"}}}] 2021-07-26T16:04:56.067 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-62 2021-07-26T16:04:56.291 INFO:tasks.rgw_multisite_tests:test that events are only sent on incremental sync ... ok 2021-07-26T16:04:56.292 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:56.293 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:56.293 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:56.328 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:56.328 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:56.524 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:56.548 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315496.282196_455.1","last_update":"2021-07-26T16:04:56.282196Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:56.549 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:04:56.549 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:56.550 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:56.551 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:56.592 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:56.593 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:56.804 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315496.282196_455.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:56.282196Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:56.805 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:04:56.806 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:56.807 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:56.808 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:56.809 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:56.885 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:56.886 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:57.106 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315496.282196_455.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:56.282196Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:57.107 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:57.107 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:57.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:57.108 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:57.148 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:57.148 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:57.335 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:57.368 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315496.282196_455.1","last_update":"2021-07-26T16:04:56.282196Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:57.368 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:57.369 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:57.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:57.370 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:57.410 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:57.410 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:57.610 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315496.282196_455.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:56.282196Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:57.611 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:57.664 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:57.665 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:57.665 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:57.701 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:57.702 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:57.894 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:04:57.928 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315497.658081_459.1","last_update":"2021-07-26T16:04:57.658081Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:04:57.929 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:04:57.929 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:57.930 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:57.931 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:57.969 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:57.970 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:58.173 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315497.658081_459.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:04:57.658081Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:04:58.174 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:04:58.175 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:58.175 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:58.176 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-63 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:58.218 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:58.218 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:58.454 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":""},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":""},{"key":10,"val":""}]} 2021-07-26T16:04:58.455 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-63 2021-07-26T16:04:58.455 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:58.456 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:58.456 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-63 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:58.498 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:58.499 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:58.700 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:04:58.700 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-63 2021-07-26T16:04:59.175 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:59.176 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:59.176 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-63 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:59.216 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:59.216 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:59.438 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000003.93.3"},{"key":2,"val":""},{"key":3,"val":"00000000001.98.5"},{"key":4,"val":"00000000001.36.5"},{"key":5,"val":"00000000001.73.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.88.5"},{"key":8,"val":"00000000001.75.5"},{"key":9,"val":"00000000001.96.5"},{"key":10,"val":"00000000002.38.5"}]} 2021-07-26T16:04:59.439 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-63 2021-07-26T16:04:59.439 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:59.440 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:59.440 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-63 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:59.486 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:59.486 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:04:59.707 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000003.93.3"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.98.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.36.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.73.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.88.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.75.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.96.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.38.5"}}}] 2021-07-26T16:04:59.708 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-63 2021-07-26T16:04:59.822 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:59.822 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-63', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:04:59.823 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-63 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:04:59.864 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:04:59.864 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:00.071 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000005.97.5"},{"key":2,"val":""},{"key":3,"val":"00000000002.100.5"},{"key":4,"val":"00000000002.38.5"},{"key":5,"val":"00000000002.77.5"},{"key":6,"val":""},{"key":7,"val":"00000000002.90.5"},{"key":8,"val":"00000000002.79.5"},{"key":9,"val":"00000000002.98.5"},{"key":10,"val":"00000000004.42.5"}]} 2021-07-26T16:05:00.071 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-63 2021-07-26T16:05:00.072 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:00.072 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-63', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:00.073 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-63 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:00.114 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:00.115 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:00.317 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000005.97.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.100.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.38.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.77.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.90.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.79.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.98.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000004.42.5"}}}] 2021-07-26T16:05:00.318 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-63 2021-07-26T16:05:00.433 INFO:tasks.rgw_multisite_tests:test subscriptions for different events ... ok 2021-07-26T16:05:00.434 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:00.435 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:00.436 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:00.474 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:00.474 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:00.654 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:05:00.689 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315500.427014_463.1","last_update":"2021-07-26T16:05:00.427014Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:05:00.690 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:05:00.690 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:00.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:00.692 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:00.730 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:00.937 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315500.427014_463.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:00.427014Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:00.938 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:05:00.939 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:05:00.939 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:00.942 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:00.943 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:01.022 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:01.023 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:01.230 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315500.427014_463.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:00.427014Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:01.230 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:05:01.231 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:01.231 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:01.232 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:01.271 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:01.271 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:01.463 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:05:01.498 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315500.427014_463.1","last_update":"2021-07-26T16:05:00.427014Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:05:01.498 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:05:01.499 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:01.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:01.500 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:01.541 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:01.541 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:01.749 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315500.427014_463.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:00.427014Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:01.749 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:05:01.786 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:01.787 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:01.787 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:01.825 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:01.826 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:02.012 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:05:02.044 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315501.780347_467.1","last_update":"2021-07-26T16:05:01.780347Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:05:02.045 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:05:02.045 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:02.046 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:02.046 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:02.085 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:02.086 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:02.295 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315501.780347_467.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:01.780347Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:02.296 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:05:06.784 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-64', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:06.784 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-64', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:06.785 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-64 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:06.828 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:06.829 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:07.050 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000010.60.5"},{"key":1,"val":"00000000010.102.5"},{"key":2,"val":"00000000009.85.5"},{"key":3,"val":"00000000010.88.5"},{"key":4,"val":"00000000007.100.5"},{"key":5,"val":"00000000007.96.5"},{"key":6,"val":"00000000008.83.5"},{"key":7,"val":"00000000010.110.5"},{"key":8,"val":"00000000010.94.5"},{"key":9,"val":"00000000010.86.5"},{"key":10,"val":"00000000010.48.5"}]} 2021-07-26T16:05:07.050 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-64 2021-07-26T16:05:07.051 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-64', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:07.052 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-64', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:07.052 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-64 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:07.096 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:07.096 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:07.316 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.60.5"}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.102.5"}}},{"key":2,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000009.85.5"}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.88.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000007.100.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000007.96.5"}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000008.83.5"}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.110.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.94.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.86.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000010.48.5"}}}] 2021-07-26T16:05:07.316 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-64 2021-07-26T16:05:08.177 INFO:tasks.rgw_multisite_tests:test incremental fetching of events from a subscription ... ok 2021-07-26T16:05:08.178 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:08.179 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:08.181 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:08.223 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:08.223 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:08.398 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:05:08.434 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315508.167509_991.1","last_update":"2021-07-26T16:05:08.167509Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:05:08.434 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:05:08.435 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:08.435 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:08.437 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:08.476 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:08.477 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:08.668 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315508.167509_991.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:08.167509Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:08.669 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:05:08.669 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:05:08.670 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:08.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:08.671 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:08.707 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:08.708 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:08.913 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315508.167509_991.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:08.167509Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:08.913 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:05:08.914 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:08.914 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:08.915 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:08.954 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:08.954 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:09.167 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:05:09.203 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315508.167509_991.1","last_update":"2021-07-26T16:05:08.167509Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:05:09.203 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:05:09.204 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:09.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:09.205 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:09.245 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:09.245 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:09.448 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315508.167509_991.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:08.167509Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:09.449 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:05:09.486 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:09.486 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:09.487 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:09.522 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:09.522 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:09.718 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:05:09.753 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315509.481118_996.1","last_update":"2021-07-26T16:05:09.481118Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:05:09.753 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:05:09.754 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:09.755 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:09.755 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:09.799 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:10.000 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315509.481118_996.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:09.481118Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:10.001 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:05:10.443 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:10.444 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-65', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:10.445 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-65 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:10.485 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:10.486 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:10.699 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":""},{"key":1,"val":"00000000002.98.5"},{"key":2,"val":""},{"key":3,"val":"00000000001.63.5"},{"key":4,"val":"00000000001.101.5"},{"key":5,"val":"00000000001.94.5"},{"key":6,"val":""},{"key":7,"val":"00000000001.52.5"},{"key":8,"val":"00000000001.83.5"},{"key":9,"val":"00000000001.76.5"},{"key":10,"val":"00000000002.111.5"}]} 2021-07-26T16:05:10.700 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-65 2021-07-26T16:05:10.700 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:10.701 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-65', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:10.701 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-65 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:10.747 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:10.748 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:10.957 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":1,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.98.5"}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.63.5"}}},{"key":4,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.101.5"}}},{"key":5,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.94.5"}}},{"key":6,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":7,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.52.5"}}},{"key":8,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.83.5"}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.76.5"}}},{"key":10,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000002.111.5"}}}] 2021-07-26T16:05:10.958 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-65 2021-07-26T16:05:11.149 INFO:tasks.rgw_multisite_tests:test acking of some events in a subscription ... ok 2021-07-26T16:05:11.150 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:11.150 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:11.151 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:11.187 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:11.380 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:05:11.406 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315511.143890_1000.1","last_update":"2021-07-26T16:05:11.143890Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:05:11.407 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:05:11.407 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:11.408 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:11.408 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:11.454 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:11.454 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:11.654 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315511.143890_1000.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:11.143890Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:11.655 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone2 2021-07-26T16:05:11.655 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:05:11.656 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:11.656 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:11.657 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:11.695 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:11.696 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:11.889 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315511.143890_1000.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:11.143890Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:11.890 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:05:11.891 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:11.891 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:11.892 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:11.930 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:11.930 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:12.132 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:05:12.166 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315511.143890_1000.1","last_update":"2021-07-26T16:05:11.143890Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:05:12.166 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:05:12.167 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:12.167 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:12.168 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:12.211 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:12.212 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:12.413 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315511.143890_1000.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:11.143890Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:12.413 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:05:12.450 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:12.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:12.452 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:12.487 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:12.488 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:12.683 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:05:12.716 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315512.445154_1004.1","last_update":"2021-07-26T16:05:12.445154Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:05:12.716 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone3 2021-07-26T16:05:12.717 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:12.717 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:12.718 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:12.757 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:12.757 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:12.958 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:12.958 INFO:rgw_multi.tests:finish meta checkpoint for zone=test-zone3 2021-07-26T16:05:13.264 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-66', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:13.265 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'bilog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--bucket', 'ldpzkr-66', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:13.265 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 bilog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --bucket ldpzkr-66 --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:13.294 INFO:tasks.rgw.c2.client.0.smithi087.stdout:*** Caught signal (Segmentation fault) ** 2021-07-26T16:05:13.295 INFO:tasks.rgw.c2.client.0.smithi087.stdout: in thread 7f2831ffb700 thread_name:rados_async 2021-07-26T16:05:13.298 INFO:tasks.rgw.c2.client.0.smithi087.stdout: ceph version 15.2.13-213-g0f589fd5 (0f589fd5a12a7ee844fceabe951140b18faf866b) octopus (stable) 2021-07-26T16:05:13.299 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 1: (()+0x46210) [0x7f2862f4e210] 2021-07-26T16:05:13.299 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7f2863bb7114] 2021-07-26T16:05:13.299 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7f28639ee347] 2021-07-26T16:05:13.301 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7f286391c1e6] 2021-07-26T16:05:13.301 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7f28639163c5] 2021-07-26T16:05:13.301 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7f286391e6c1] 2021-07-26T16:05:13.302 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7f285a260c8b] 2021-07-26T16:05:13.302 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7f285a261d55] 2021-07-26T16:05:13.302 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 9: (()+0x9609) [0x7f2859dbd609] 2021-07-26T16:05:13.303 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 10: (clone()+0x43) [0x7f286302a293] 2021-07-26T16:05:13.303 INFO:tasks.rgw.c2.client.0.smithi087.stdout:2021-07-26T16:05:13.296+0000 7f2831ffb700 -1 *** Caught signal (Segmentation fault) ** 2021-07-26T16:05:13.303 INFO:tasks.rgw.c2.client.0.smithi087.stdout: in thread 7f2831ffb700 thread_name:rados_async 2021-07-26T16:05:13.304 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 2021-07-26T16:05:13.304 INFO:tasks.rgw.c2.client.0.smithi087.stdout: ceph version 15.2.13-213-g0f589fd5 (0f589fd5a12a7ee844fceabe951140b18faf866b) octopus (stable) 2021-07-26T16:05:13.304 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 1: (()+0x46210) [0x7f2862f4e210] 2021-07-26T16:05:13.305 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7f2863bb7114] 2021-07-26T16:05:13.305 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7f28639ee347] 2021-07-26T16:05:13.305 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7f286391c1e6] 2021-07-26T16:05:13.306 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7f28639163c5] 2021-07-26T16:05:13.306 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7f286391e6c1] 2021-07-26T16:05:13.307 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7f285a260c8b] 2021-07-26T16:05:13.308 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7f285a261d55] 2021-07-26T16:05:13.308 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 9: (()+0x9609) [0x7f2859dbd609] 2021-07-26T16:05:13.308 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 10: (clone()+0x43) [0x7f286302a293] 2021-07-26T16:05:13.308 INFO:tasks.rgw.c2.client.0.smithi087.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-07-26T16:05:13.309 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 2021-07-26T16:05:13.310 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:13.310 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:13.318 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 0> 2021-07-26T16:05:13.296+0000 7f2831ffb700 -1 *** Caught signal (Segmentation fault) ** 2021-07-26T16:05:13.319 INFO:tasks.rgw.c2.client.0.smithi087.stdout: in thread 7f2831ffb700 thread_name:rados_async 2021-07-26T16:05:13.319 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 2021-07-26T16:05:13.319 INFO:tasks.rgw.c2.client.0.smithi087.stdout: ceph version 15.2.13-213-g0f589fd5 (0f589fd5a12a7ee844fceabe951140b18faf866b) octopus (stable) 2021-07-26T16:05:13.319 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 1: (()+0x46210) [0x7f2862f4e210] 2021-07-26T16:05:13.319 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7f2863bb7114] 2021-07-26T16:05:13.320 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7f28639ee347] 2021-07-26T16:05:13.320 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7f286391c1e6] 2021-07-26T16:05:13.321 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7f28639163c5] 2021-07-26T16:05:13.321 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7f286391e6c1] 2021-07-26T16:05:13.321 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7f285a260c8b] 2021-07-26T16:05:13.321 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7f285a261d55] 2021-07-26T16:05:13.322 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 9: (()+0x9609) [0x7f2859dbd609] 2021-07-26T16:05:13.322 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 10: (clone()+0x43) [0x7f286302a293] 2021-07-26T16:05:13.322 INFO:tasks.rgw.c2.client.0.smithi087.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-07-26T16:05:13.322 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 2021-07-26T16:05:13.333 INFO:tasks.rgw.c2.client.0.smithi087.stdout: -144> 2021-07-26T16:05:13.296+0000 7f2831ffb700 -1 *** Caught signal (Segmentation fault) ** 2021-07-26T16:05:13.334 INFO:tasks.rgw.c2.client.0.smithi087.stdout: in thread 7f2831ffb700 thread_name:rados_async 2021-07-26T16:05:13.334 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 2021-07-26T16:05:13.334 INFO:tasks.rgw.c2.client.0.smithi087.stdout: ceph version 15.2.13-213-g0f589fd5 (0f589fd5a12a7ee844fceabe951140b18faf866b) octopus (stable) 2021-07-26T16:05:13.334 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 1: (()+0x46210) [0x7f2862f4e210] 2021-07-26T16:05:13.335 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 2: (rgw::putobj::ETagVerifier_MPU::process(ceph::buffer::v15_2_0::list&&, unsigned long)+0x44) [0x7f2863bb7114] 2021-07-26T16:05:13.335 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 3: (RGWRados::fetch_remote_obj(RGWObjectCtx&, rgw_user const&, req_info*, rgw_zone_id const&, rgw_obj const&, rgw_obj const&, RGWBucketInfo const&, RGWBucketInfo const*, std::optional, std::chrono::time_point > >*, std::chrono::time_point > >*, std::chrono::time_point > > const*, std::chrono::time_point > > const*, bool, char const*, char const*, RGWRados::AttrsMod, bool, std::map, std::allocator >, ceph::buffer::v15_2_0::list, std::less, std::allocator > >, std::allocator, std::allocator > const, ceph::buffer::v15_2_0::list> > >&, RGWObjCategory, std::optional, std::chrono::time_point > >, std::__cxx11::basic_string, std::allocator >*, std::__cxx11::basic_string, std::allocator >*, void (*)(long, void*), void*, DoutPrefixProvider const*, RGWFetchObjFilter*, rgw_zone_set*, std::optional*)+0xf87) [0x7f28639ee347] 2021-07-26T16:05:13.335 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 4: (RGWAsyncFetchRemoteObj::_send_request()+0x4d6) [0x7f286391c1e6] 2021-07-26T16:05:13.335 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 5: (RGWAsyncRadosProcessor::handle_request(RGWAsyncRadosRequest*)+0x25) [0x7f28639163c5] 2021-07-26T16:05:13.336 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 6: (RGWAsyncRadosProcessor::RGWWQ::_process(RGWAsyncRadosRequest*, ThreadPool::TPHandle&)+0x11) [0x7f286391e6c1] 2021-07-26T16:05:13.336 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 7: (ThreadPool::worker(ThreadPool::WorkThread*)+0x5bb) [0x7f285a260c8b] 2021-07-26T16:05:13.336 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 8: (ThreadPool::WorkThread::entry()+0x15) [0x7f285a261d55] 2021-07-26T16:05:13.336 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 9: (()+0x9609) [0x7f2859dbd609] 2021-07-26T16:05:13.336 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 10: (clone()+0x43) [0x7f286302a293] 2021-07-26T16:05:13.337 INFO:tasks.rgw.c2.client.0.smithi087.stdout: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-07-26T16:05:13.337 INFO:tasks.rgw.c2.client.0.smithi087.stdout: 2021-07-26T16:05:13.479 INFO:tasks.rgw.c2.client.0.smithi087.stderr:daemon-helper: command crashed with signal 11 2021-07-26T16:05:13.530 INFO:teuthology.orchestra.run.smithi067.stdout:{"markers":[{"key":0,"val":"00000000001.107.5"},{"key":1,"val":""},{"key":2,"val":""},{"key":3,"val":""},{"key":4,"val":""},{"key":5,"val":""},{"key":6,"val":"00000000001.82.5"},{"key":7,"val":""},{"key":8,"val":""},{"key":9,"val":"00000000005.70.5"},{"key":10,"val":""}]} 2021-07-26T16:05:13.531 INFO:rgw_multi.tests:starting bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-66 2021-07-26T16:05:13.531 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-66', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:13.532 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'bucket', 'sync', 'markers', '--rgw-zone', 'test-zone3', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--source-zone', 'test-zone1', '--bucket', 'ldpzkr-66', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:13.533 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 bucket sync markers --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --source-zone test-zone1 --bucket ldpzkr-66 --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:13.577 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:13.577 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:13.778 INFO:teuthology.orchestra.run.smithi087.stdout:[{"key":0,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.107.5"}}},{"key":1,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":2,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":3,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":4,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":5,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":6,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000001.82.5"}}},{"key":7,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":8,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}},{"key":9,"val":{"status":"incremental-sync","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":"00000000005.70.5"}}},{"key":10,"val":{"status":"init","full_marker":{"position":{"name":"","instance":"","ns":""},"count":0},"inc_marker":{"position":""}}}] 2021-07-26T16:05:13.778 INFO:rgw_multi.tests:finished bucket checkpoint for target_zone=test-zone3 source_zone=test-zone1 bucket=ldpzkr-66 2021-07-26T16:05:13.858 INFO:tasks.rgw_multisite_tests:test object creation notifications in using put/copy/post ... ok 2021-07-26T16:05:13.859 INFO:tasks.rgw_multisite_tests:test object creation s3 notifications in using put/copy/post on master ... ok 2021-07-26T16:05:13.860 INFO:tasks.rgw_multisite_tests:test multipart object upload on master ... ok 2021-07-26T16:05:13.860 INFO:tasks.util.rgw:rgwadmin: c1.client.0 : ['mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:13.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c1', 'mdlog', 'status', '--rgw-zone', 'test-zone1', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c1', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:13.862 DEBUG:teuthology.orchestra.run.smithi067:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c1 mdlog status --rgw-zone test-zone1 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c1 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:13.902 INFO:teuthology.orchestra.run.smithi067.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:14.092 INFO:teuthology.orchestra.run.smithi067.stderr:No --period given, using current period=0c36d6c3-0300-4c45-af6a-75a7af63a9ea 2021-07-26T16:05:14.126 INFO:teuthology.orchestra.run.smithi067.stdout:[{"marker":"1_1627315513.852278_1030.1","last_update":"2021-07-26T16:05:13.852278Z"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"},{"marker":"","last_update":"0.000000"}] 2021-07-26T16:05:14.127 INFO:rgw_multi.tests:starting meta checkpoint for zone=test-zone2 2021-07-26T16:05:14.127 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:14.128 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:14.129 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:14.170 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:14.171 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:14.373 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:14.374 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:05:15.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~0s 2021-07-26T16:05:19.375 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:19.376 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:19.377 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:19.419 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:19.419 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:19.622 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:19.622 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:05:21.246 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~6s 2021-07-26T16:05:24.623 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:24.624 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:24.626 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:24.665 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:24.666 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:24.872 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:24.873 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:05:26.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~11s 2021-07-26T16:05:29.875 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:29.876 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:29.876 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:29.918 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:29.919 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:30.130 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:30.130 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:05:32.460 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~17s 2021-07-26T16:05:35.131 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:35.132 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:35.133 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:35.175 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:35.175 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:35.376 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:35.377 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:05:38.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~22s 2021-07-26T16:05:40.378 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:40.379 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:40.379 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:40.419 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:40.420 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:40.622 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:40.623 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:05:43.671 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~28s 2021-07-26T16:05:45.624 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:45.625 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:45.625 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:45.668 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:45.668 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:45.861 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:45.862 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:05:49.276 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~34s 2021-07-26T16:05:50.863 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:50.863 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:50.864 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:50.903 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:50.903 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:51.112 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:51.112 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:05:54.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~39s 2021-07-26T16:05:56.114 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:56.114 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:05:56.115 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:05:56.154 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:05:56.155 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:05:56.363 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:05:56.364 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:00.489 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~45s 2021-07-26T16:06:01.365 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:01.366 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:01.367 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:01.409 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:01.409 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:01.618 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:01.619 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:06.093 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~50s 2021-07-26T16:06:06.621 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:06.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:06.623 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:06.659 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:06.660 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:06.861 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:06.862 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:11.699 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~56s 2021-07-26T16:06:11.863 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:11.864 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:11.864 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:11.908 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:11.908 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:12.117 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:12.117 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:17.118 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:17.119 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:17.120 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:17.160 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:17.305 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~62s 2021-07-26T16:06:17.379 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:17.380 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:22.382 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:22.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:22.383 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:22.422 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:22.423 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:22.619 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:22.619 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:22.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~67s 2021-07-26T16:06:27.621 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:27.622 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:27.623 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:27.662 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:27.662 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:27.857 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:27.857 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:28.517 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~73s 2021-07-26T16:06:32.859 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:32.860 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:32.860 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:32.901 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:32.901 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:33.107 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:33.108 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:34.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~78s 2021-07-26T16:06:38.110 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:38.110 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:38.111 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:38.152 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:38.152 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:38.368 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:38.369 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:39.730 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~84s 2021-07-26T16:06:43.369 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:43.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:43.371 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:43.410 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:43.411 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:43.620 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:43.620 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:45.336 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~90s 2021-07-26T16:06:48.622 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:48.623 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:48.623 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:48.659 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:48.660 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:48.882 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:48.882 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:50.941 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~95s 2021-07-26T16:06:53.884 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:53.885 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:53.886 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:53.925 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:54.147 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:54.148 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:06:56.550 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~101s 2021-07-26T16:06:59.149 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:59.150 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:06:59.150 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:06:59.189 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:06:59.189 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:06:59.422 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:06:59.423 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:02.155 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~107s 2021-07-26T16:07:04.424 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:04.425 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:04.426 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:04.465 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:04.465 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:04.670 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:07:04.670 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:07.761 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~112s 2021-07-26T16:07:09.671 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:09.672 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:09.673 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:09.708 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:09.709 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:09.925 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:07:09.925 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:13.366 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~118s 2021-07-26T16:07:14.926 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:14.927 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:14.928 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:14.968 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:14.968 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:15.178 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:07:15.178 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:18.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~123s 2021-07-26T16:07:20.180 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:20.181 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:20.182 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:20.221 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:20.221 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:20.439 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:07:20.440 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:24.575 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~129s 2021-07-26T16:07:25.441 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:25.441 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:25.442 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:25.481 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:25.481 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:25.711 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:07:25.712 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:30.181 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~135s 2021-07-26T16:07:30.713 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:30.713 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:30.714 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:30.752 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:30.753 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:30.966 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:07:30.966 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:35.786 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~140s 2021-07-26T16:07:35.968 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:35.969 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:35.970 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:36.009 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:36.009 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:36.223 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:07:36.224 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:41.225 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:41.226 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:41.227 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:41.266 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:41.267 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:41.390 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~146s 2021-07-26T16:07:41.484 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:07:41.485 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:46.487 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:46.488 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:46.488 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:46.530 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:46.530 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:46.733 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:07:46.733 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:46.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~151s 2021-07-26T16:07:51.735 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:51.735 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:51.736 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:51.776 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:51.777 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:51.995 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:07:51.995 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:52.601 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~157s 2021-07-26T16:07:56.997 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:56.999 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:07:57.000 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:07:57.039 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:07:57.040 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:07:57.258 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:07:57.258 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:07:58.206 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~163s 2021-07-26T16:08:02.260 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:02.261 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:02.261 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:02.300 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:02.300 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:02.511 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:08:02.512 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:08:03.811 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~168s 2021-07-26T16:08:07.514 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:07.515 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:07.516 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:07.557 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:07.557 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:07.750 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:08:07.751 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:08:09.415 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~174s 2021-07-26T16:08:12.752 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:12.753 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:12.754 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:12.792 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:12.792 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:13.003 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:08:13.004 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:08:15.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~179s 2021-07-26T16:08:18.005 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:18.006 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:18.007 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:18.047 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:18.047 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:18.268 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:08:18.269 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:08:20.624 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~185s 2021-07-26T16:08:23.270 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:23.271 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:23.272 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:23.313 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:23.314 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:23.549 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:08:23.549 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:08:26.229 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~191s 2021-07-26T16:08:28.551 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:28.552 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:28.552 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:28.592 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:28.592 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:28.791 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:08:28.792 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:08:31.834 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~196s 2021-07-26T16:08:33.793 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:33.794 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:33.794 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:33.834 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:33.835 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:34.040 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:08:34.040 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:08:37.440 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~202s 2021-07-26T16:08:39.042 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:39.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:39.043 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:39.083 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:39.303 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:08:39.304 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:08:43.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~207s 2021-07-26T16:08:44.306 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:44.307 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:44.307 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:44.347 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:44.348 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:44.559 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:08:44.560 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:08:48.651 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~213s 2021-07-26T16:08:49.561 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:49.562 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:49.562 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:49.603 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:49.603 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:49.800 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:08:49.801 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:08:54.257 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~219s 2021-07-26T16:08:54.802 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:54.802 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:08:54.803 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:08:54.845 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:08:54.845 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:08:55.067 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:08:55.068 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:08:59.863 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~224s 2021-07-26T16:09:00.070 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:00.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:00.072 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:00.110 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:00.110 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:00.311 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:00.311 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:09:05.313 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:05.314 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:05.314 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:05.354 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:05.470 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~230s 2021-07-26T16:09:05.571 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:05.572 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:09:10.573 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:10.574 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:10.574 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:10.616 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:10.616 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:10.814 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:10.815 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:09:11.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~235s 2021-07-26T16:09:15.816 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:15.817 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:15.818 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:15.858 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:15.858 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:16.066 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:16.067 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:09:16.681 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~241s 2021-07-26T16:09:21.068 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:21.069 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:21.070 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:21.111 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:21.328 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:21.328 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:09:22.287 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~247s 2021-07-26T16:09:26.330 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:26.331 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:26.332 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:26.372 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:26.373 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:26.590 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:26.591 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:09:27.893 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~252s 2021-07-26T16:09:31.593 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:31.594 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:31.594 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:31.634 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:31.634 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:31.848 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:31.849 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:09:33.498 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~258s 2021-07-26T16:09:36.853 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:36.854 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:36.855 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:36.894 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:36.895 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:37.127 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:37.128 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:09:39.103 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~263s 2021-07-26T16:09:42.129 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:42.129 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:42.130 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:42.170 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:42.171 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:42.388 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:42.389 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:09:44.708 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~269s 2021-07-26T16:09:47.390 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:47.391 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:47.391 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:47.431 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:47.431 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:47.668 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:47.669 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:09:50.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~275s 2021-07-26T16:09:52.670 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:52.671 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:52.672 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:52.711 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:52.712 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:52.944 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:52.947 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:09:55.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~280s 2021-07-26T16:09:57.950 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:57.951 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:09:57.952 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:09:57.993 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:09:58.044 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:09:58.206 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:09:58.207 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:10:01.525 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~286s 2021-07-26T16:10:03.208 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:03.209 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:03.210 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:03.259 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:03.260 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:03.471 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:10:03.471 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:10:07.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~291s 2021-07-26T16:10:08.473 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:08.474 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:08.475 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:08.517 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:08.724 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:10:08.725 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:10:12.736 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~297s 2021-07-26T16:10:13.726 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:13.727 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:13.727 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:13.765 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:13.766 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:10:13.983 INFO:teuthology.orchestra.run.smithi087.stdout:{"sync_status":{"info":{"status":"sync","num_shards":4,"period":"0c36d6c3-0300-4c45-af6a-75a7af63a9ea","realm_epoch":4},"markers":[{"key":0,"val":{"state":1,"marker":"1_1627315512.445154_1004.1","next_step_marker":"","total_entries":1,"pos":0,"timestamp":"2021-07-26T16:05:12.445154Z","realm_epoch":4}},{"key":1,"val":{"state":1,"marker":"1_1627314613.226456_122.1","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"2021-07-26T15:50:13.226456Z","realm_epoch":2}},{"key":2,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}},{"key":3,"val":{"state":1,"marker":"","next_step_marker":"","total_entries":0,"pos":0,"timestamp":"0.000000","realm_epoch":2}}]},"full_sync":{"total":1,"complete":1}} 2021-07-26T16:10:13.983 WARNING:rgw_multi.tests:zone test-zone2 behind master: shard=0 master=1_1627315513.852278_1030.1 target=1_1627315512.445154_1004.1 2021-07-26T16:10:18.342 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon c2.rgw.client.0 is failed for ~303s 2021-07-26T16:10:18.343 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2021-07-26T16:10:18.947 INFO:tasks.ceph.c2.osd.0:Sent signal 15 2021-07-26T16:10:18.950 INFO:tasks.ceph.c2.osd.1:Sent signal 15 2021-07-26T16:10:18.950 INFO:tasks.ceph.c2.osd.2:Sent signal 15 2021-07-26T16:10:18.951 INFO:tasks.ceph.c2.mon.a:Sent signal 15 2021-07-26T16:10:18.951 INFO:tasks.rgw.c2.client.1:Sent signal 15 2021-07-26T16:10:18.952 INFO:tasks.ceph.c2.mgr.x:Sent signal 15 2021-07-26T16:10:18.953 INFO:tasks.ceph.c2.osd.0.smithi087.stderr:2021-07-26T16:10:18.952+0000 7f62c9eac700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster c2 -i 0 (PID: 14302) UID: 0 2021-07-26T16:10:18.953 INFO:tasks.ceph.c2.osd.0.smithi087.stderr:2021-07-26T16:10:18.952+0000 7f62c9eac700 -1 osd.0 65 *** Got signal Terminated *** 2021-07-26T16:10:18.953 INFO:tasks.ceph.c2.osd.0.smithi087.stderr:2021-07-26T16:10:18.952+0000 7f62c9eac700 -1 osd.0 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:10:18.954 INFO:tasks.ceph.c2.osd.1.smithi087.stderr:2021-07-26T16:10:18.952+0000 7fa8e1d84700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster c2 -i 1 (PID: 14303) UID: 0 2021-07-26T16:10:18.954 INFO:tasks.ceph.c2.osd.1.smithi087.stderr:2021-07-26T16:10:18.952+0000 7fa8e1d84700 -1 osd.1 65 *** Got signal Terminated *** 2021-07-26T16:10:18.955 INFO:tasks.ceph.c2.osd.1.smithi087.stderr:2021-07-26T16:10:18.952+0000 7fa8e1d84700 -1 osd.1 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:10:18.955 INFO:tasks.ceph.c2.osd.2.smithi087.stderr:2021-07-26T16:10:18.956+0000 7f44c5b06700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster c2 -i 2 (PID: 14306) UID: 0 2021-07-26T16:10:18.955 INFO:tasks.ceph.c2.osd.2.smithi087.stderr:2021-07-26T16:10:18.956+0000 7f44c5b06700 -1 osd.2 65 *** Got signal Terminated *** 2021-07-26T16:10:18.956 INFO:tasks.ceph.c2.osd.2.smithi087.stderr:2021-07-26T16:10:18.956+0000 7f44c5b06700 -1 osd.2 65 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-07-26T16:10:18.956 INFO:tasks.ceph.c2.mon.a.smithi087.stderr:2021-07-26T16:10:18.956+0000 7f5dfcfa4700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-mon -f --cluster c2 -i a (PID: 14115) UID: 0 2021-07-26T16:10:18.957 INFO:tasks.ceph.c2.mon.a.smithi087.stderr:2021-07-26T16:10:18.956+0000 7f5dfcfa4700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-07-26T16:10:18.957 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:10:18.956+0000 7f99c15af700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=8001 -n client.1 --cluster c2 -k /etc/ceph/c2.client.1.keyring --log-file /var/log/ceph/rgw.c2.client.1.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.c2.client.1.sock --foreground --rgw-zone test-zone3 --rgw-zonegroup test-zonegroup --rgw-realm test-realm (PID: 29081) UID: 0 2021-07-26T16:10:18.958 INFO:tasks.rgw.c2.client.1.smithi087.stdout:2021-07-26T16:10:18.956+0000 7f99c5989980 -1 shutting down 2021-07-26T16:10:18.984 INFO:tasks.util.rgw:rgwadmin: c2.client.0 : ['metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:18.985 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'c2', 'metadata', 'sync', 'status', '--rgw-zone', 'test-zone2', '--rgw-zonegroup', 'test-zonegroup', '--rgw-realm', 'test-realm', '--cluster', 'c2', '--debug-rgw', '0', '--debug-ms', '0', '--rgw-cache-enabled', 'false'] 2021-07-26T16:10:18.985 DEBUG:teuthology.orchestra.run.smithi087:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster c2 metadata sync status --rgw-zone test-zone2 --rgw-zonegroup test-zonegroup --rgw-realm test-realm --cluster c2 --debug-rgw 0 --debug-ms 0 --rgw-cache-enabled false 2021-07-26T16:10:19.030 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setuser ceph since I am not root 2021-07-26T16:10:19.031 INFO:teuthology.orchestra.run.smithi087.stderr:ignoring --setgroup ceph since I am not root 2021-07-26T16:13:30.123 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-07-26T16:13:30.125 DEBUG:teuthology.task.console_log:Killing console logger for smithi067 2021-07-26T16:13:30.126 DEBUG:teuthology.task.console_log:Killing console logger for smithi087 2021-07-26T16:13:30.127 DEBUG:teuthology.exit:Finished running handlers