2021-11-18T10:10:23.371 INFO:root:teuthology version: 1.1.0-d4737010 2021-11-18T10:10:23.374 DEBUG:teuthology.run:Teuthology command: teuthology --description rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} --archive /home/teuthworker/archive/teuthology-2021-11-15_02:01:02-rbd-master-distro-default-gibba/6503461 --owner scheduled_teuthology@teuthology --verbose --name teuthology-2021-11-15_02:01:02-rbd-master-distro-default-gibba -- /home/teuthworker/archive/teuthology-2021-11-15_02:01:02-rbd-master-distro-default-gibba/6503461/orig.config.yaml 2021-11-18T10:10:23.439 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-11-18T10:10:23.517 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2021-11-15_02:01:02-rbd-master-distro-default-gibba/6503461 branch: master description: rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock} email: ceph-qa@ceph.io first_in_suite: false job_id: '6503461' kernel: kdb: true sha1: distro last_in_suite: false machine_type: gibba meta: - desc: run two ceph clusters and install rbd-mirror - desc: configure the permissions for client.mirror - desc: 2 ceph clusters with 1 mon and 3 osds each - desc: run four rbd-mirror daemons per cluster - desc: run the rbd_mirror_stress.sh workunit to test the rbd-mirror daemon name: teuthology-2021-11-15_02:01:02-rbd-master-distro-default-gibba nuke-on-error: true openstack: - volumes: count: 3 size: 30 os_type: centos os_version: '8.3' overrides: admin_socket: branch: master ceph: conf: client: debug rbd: 20 debug rbd_mirror: 15 log to stderr: false rbd default features: 125 rbd mirror image policy type: simple client.mirror.0: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.1: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.2: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid client.mirror.3: admin socket: /var/run/ceph/rbd-mirror.$cluster-$name.asok pid file: /var/run/ceph/rbd-mirror.$cluster-$name.pid global: mon client directed command retry: 5 ms inject socket failures: 5000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bluefs allocator: hybrid bluestore allocator: hybrid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 44cd7c7650ed2227d3597352b00bd2ef65f4388f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 44cd7c7650ed2227d3597352b00bd2ef65f4388f selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: master sha1: 44cd7c7650ed2227d3597352b00bd2ef65f4388f owner: scheduled_teuthology@teuthology priority: 1000 repo: https://github.com/ceph/ceph.git roles: - - cluster1.mon.a - cluster1.mgr.x - cluster2.mgr.x - cluster1.osd.0 - cluster1.osd.1 - cluster1.osd.2 - cluster1.client.0 - cluster2.client.0 - - cluster2.mon.a - cluster2.osd.0 - cluster2.osd.1 - cluster2.osd.2 - cluster1.client.mirror - cluster1.client.mirror.0 - cluster1.client.mirror.1 - cluster1.client.mirror.2 - cluster1.client.mirror.3 - cluster1.client.mirror.4 - cluster1.client.mirror.5 - cluster1.client.mirror.6 - cluster2.client.mirror - cluster2.client.mirror.0 - cluster2.client.mirror.1 - cluster2.client.mirror.2 - cluster2.client.mirror.3 - cluster2.client.mirror.4 - cluster2.client.mirror.5 - cluster2.client.mirror.6 sha1: 44cd7c7650ed2227d3597352b00bd2ef65f4388f sleep_before_teardown: 0 suite: rbd suite_branch: master suite_path: /home/teuthworker/src/github.com_ceph_ceph_44cd7c7650ed2227d3597352b00bd2ef65f4388f/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph.git suite_sha1: 44cd7c7650ed2227d3597352b00bd2ef65f4388f targets: gibba005.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNiR1RqNqSftUOVGBiSU14AICZY8bEQYJD+zFAQmbYcV8dqVM2O6OspTmMlFXqme9oybYX6b0Wz1KYL5OAi+4QqU6kpiUhay1jAcoplneO95QnkpnEeC7SshfACme6Q7VPEQADdKMvB6i/ZAPbjG38FajSbX1+err7kFlcvaI5Cdi9zUuctG6PXGalivEgSCfZGrY69lLMUpbaxoKliQ7yCVOpvGYkpykzoMN06mCSdgE2dKEqrw438SmGD33T9qJPTk+5MLH1xYIFzbPlZLhQaNXqUDrKWeoHiJW4hLeBqLqddvSXA04+HmXb74b/lrObsmJ1czaZLIyeNQ7+2eBSm2Ddk1nUOk0ItK0XhC2iOxfZsXyCJ9EOJpXN3sB6NLBQSC0Vbq9R5LrC/OBhk4FTlgWwPpGIf+MVHIfDLu7Q5FO99lYiVHZC5BLu6fFtB/37zJXDZvQZn0d+6e2ergWNBOrukuFWyQ6WbHP5+S4UuloGC9DkzNI6PgbyY0vAyKU= gibba019.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1zpyjLs/XrLyk2CdygXDeA7ImscLQ62Xf41IuMr15/X4ICxR0/juDU0y9kqXl8x3tqiGdswB0HyTDIZayyt97N2N7/6jru0nljN4SeKrZrHnoJVxB570CCGHmD99wSxkQLl6Ho6SI1jdlsycAuslQvsag1rcH1ti74mMe3Pmz7U/1XMHlpEVuTDfKzY3lUfnkBr5WJ0p4c39TSxHc+M+jMQsE39lsL3OOdfjZrnGVFeduc6WYvg7PeDv7PoKjZhe+TI7WnJHi5S/aX6ggQ3CTg8q/c3wgQkHa4kYQkVilNV42vkwjE0gES570IWj4iFG0hiDbb+CvHkQIzSnTRTE4VPDiCA7tq6pc+fQrNIcxQNAvbhjvwNFIQgOueNYeDb3awS787a8u4YEW5JYaglLhElANQOxOsBtKaDQVKVkRCPYYnyWv9ofsTrVG71nFlBMXgr5xooVGjMiveyQ7EzejNWauMuhYiQsboOqQD4BQYJ715hzcd29QgpFg53ohDgs= tasks: - install: extra_packages: - rbd-mirror - ceph: cluster: cluster1 - ceph: cluster: cluster2 - exec: cluster1.client.mirror.0: - sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd' - sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd' - rbd-mirror: client: cluster1.client.mirror.0 thrash: true - rbd-mirror: client: cluster1.client.mirror.1 thrash: true - rbd-mirror: client: cluster1.client.mirror.2 thrash: true - rbd-mirror: client: cluster1.client.mirror.3 thrash: true - rbd-mirror: client: cluster2.client.mirror.0 thrash: true - rbd-mirror: client: cluster2.client.mirror.1 thrash: true - rbd-mirror: client: cluster2.client.mirror.2 thrash: true - rbd-mirror: client: cluster2.client.mirror.3 thrash: true - rbd-mirror-thrash: cluster: cluster1 - rbd-mirror-thrash: cluster: cluster2 - workunit: clients: cluster1.client.mirror: - rbd/rbd_mirror_stress.sh env: CEPH_ARGS: '' MIRROR_IMAGE_MODE: snapshot MIRROR_POOL_MODE: image RBD_IMAGE_FEATURES: layering,exclusive-lock RBD_MIRROR_INSTANCES: '4' RBD_MIRROR_USE_EXISTING_CLUSTER: '1' RBD_MIRROR_USE_RBD_MIRROR: '1' timeout: 6h teuthology_branch: master teuthology_sha1: d4737010a85099043cf081dc05b4069d301b23fb timestamp: 2021-11-15_02:01:02 tube: gibba user: teuthology verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.gibba.19943 2021-11-18T10:10:23.518 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_44cd7c7650ed2227d3597352b00bd2ef65f4388f/qa; will attempt to use it 2021-11-18T10:10:23.518 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_44cd7c7650ed2227d3597352b00bd2ef65f4388f/qa/tasks 2021-11-18T10:10:23.519 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-11-18T10:10:23.521 INFO:teuthology.task.internal:Checking packages... 2021-11-18T10:10:23.544 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '44cd7c7650ed2227d3597352b00bd2ef65f4388f' 2021-11-18T10:10:23.544 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-11-18T10:10:23.545 INFO:teuthology.packaging:ref: None 2021-11-18T10:10:23.545 INFO:teuthology.packaging:tag: None 2021-11-18T10:10:23.545 INFO:teuthology.packaging:branch: master 2021-11-18T10:10:23.546 INFO:teuthology.packaging:sha1: 44cd7c7650ed2227d3597352b00bd2ef65f4388f 2021-11-18T10:10:23.546 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=master 2021-11-18T10:10:24.070 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-9082.g8cc3f605 2021-11-18T10:10:24.071 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-11-18T10:10:24.086 INFO:teuthology.task.internal:no buildpackages task found 2021-11-18T10:10:24.087 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-11-18T10:10:24.112 INFO:teuthology.task.internal:Saving configuration 2021-11-18T10:10:24.133 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-11-18T10:10:24.145 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-11-18T10:10:24.168 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba005.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-15_02:01:02-rbd-master-distro-default-gibba/6503461', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-18 10:05:30.225984', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKSDirJ42WyYkZfUm+B3QH1KOkAfOKRLlYP4g5CHOXk2pxsav53fylQ0lWCX3RyueDTiaoOqJSptgVTnWLIE9II='} 2021-11-18T10:10:24.191 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'gibba019.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2021-11-15_02:01:02-rbd-master-distro-default-gibba/6503461', 'up': True, 'machine_type': 'gibba', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2021-11-18 10:05:30.227335', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBK9apQSqmoj4mWU47LismL9CuKpjl2Tw4wEKtH+esAfdAWCIV3m5gpikHgI+WBNA+JEgFDpbz+Don31s4OOQh/s='} 2021-11-18T10:10:24.192 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-11-18T10:10:24.203 INFO:teuthology.task.internal:roles: ubuntu@gibba005.front.sepia.ceph.com - ['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'] 2021-11-18T10:10:24.203 INFO:teuthology.task.internal:roles: ubuntu@gibba019.front.sepia.ceph.com - ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6'] 2021-11-18T10:10:24.203 INFO:teuthology.run_tasks:Running task console_log... 2021-11-18T10:10:24.285 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa37844eb70>, signals=[15]) 2021-11-18T10:10:24.286 INFO:teuthology.run_tasks:Running task internal.connect... 2021-11-18T10:10:24.298 INFO:teuthology.task.internal:Opening connections... 2021-11-18T10:10:24.298 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba005.front.sepia.ceph.com 2021-11-18T10:10:24.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-18T10:10:24.367 DEBUG:teuthology.task.internal:connecting to ubuntu@gibba019.front.sepia.ceph.com 2021-11-18T10:10:24.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-18T10:10:24.436 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-11-18T10:10:24.449 DEBUG:teuthology.orchestra.run.gibba005:> uname -m 2021-11-18T10:10:24.461 INFO:teuthology.orchestra.run.gibba005.stdout:x86_64 2021-11-18T10:10:24.461 DEBUG:teuthology.orchestra.run.gibba005:> cat /etc/os-release 2021-11-18T10:10:24.513 INFO:teuthology.orchestra.run.gibba005.stdout:NAME="CentOS Linux" 2021-11-18T10:10:24.513 INFO:teuthology.orchestra.run.gibba005.stdout:VERSION="8" 2021-11-18T10:10:24.513 INFO:teuthology.orchestra.run.gibba005.stdout:ID="centos" 2021-11-18T10:10:24.514 INFO:teuthology.orchestra.run.gibba005.stdout:ID_LIKE="rhel fedora" 2021-11-18T10:10:24.514 INFO:teuthology.orchestra.run.gibba005.stdout:VERSION_ID="8" 2021-11-18T10:10:24.514 INFO:teuthology.orchestra.run.gibba005.stdout:PLATFORM_ID="platform:el8" 2021-11-18T10:10:24.514 INFO:teuthology.orchestra.run.gibba005.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-18T10:10:24.515 INFO:teuthology.orchestra.run.gibba005.stdout:ANSI_COLOR="0;31" 2021-11-18T10:10:24.515 INFO:teuthology.orchestra.run.gibba005.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-18T10:10:24.515 INFO:teuthology.orchestra.run.gibba005.stdout:HOME_URL="https://centos.org/" 2021-11-18T10:10:24.516 INFO:teuthology.orchestra.run.gibba005.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-18T10:10:24.516 INFO:teuthology.orchestra.run.gibba005.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-18T10:10:24.516 INFO:teuthology.orchestra.run.gibba005.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-18T10:10:24.517 INFO:teuthology.lock.ops:Updating gibba005.front.sepia.ceph.com on lock server 2021-11-18T10:10:24.536 DEBUG:teuthology.orchestra.run.gibba019:> uname -m 2021-11-18T10:10:24.548 INFO:teuthology.orchestra.run.gibba019.stdout:x86_64 2021-11-18T10:10:24.548 DEBUG:teuthology.orchestra.run.gibba019:> cat /etc/os-release 2021-11-18T10:10:24.601 INFO:teuthology.orchestra.run.gibba019.stdout:NAME="CentOS Linux" 2021-11-18T10:10:24.601 INFO:teuthology.orchestra.run.gibba019.stdout:VERSION="8" 2021-11-18T10:10:24.602 INFO:teuthology.orchestra.run.gibba019.stdout:ID="centos" 2021-11-18T10:10:24.602 INFO:teuthology.orchestra.run.gibba019.stdout:ID_LIKE="rhel fedora" 2021-11-18T10:10:24.602 INFO:teuthology.orchestra.run.gibba019.stdout:VERSION_ID="8" 2021-11-18T10:10:24.602 INFO:teuthology.orchestra.run.gibba019.stdout:PLATFORM_ID="platform:el8" 2021-11-18T10:10:24.603 INFO:teuthology.orchestra.run.gibba019.stdout:PRETTY_NAME="CentOS Linux 8" 2021-11-18T10:10:24.603 INFO:teuthology.orchestra.run.gibba019.stdout:ANSI_COLOR="0;31" 2021-11-18T10:10:24.603 INFO:teuthology.orchestra.run.gibba019.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2021-11-18T10:10:24.603 INFO:teuthology.orchestra.run.gibba019.stdout:HOME_URL="https://centos.org/" 2021-11-18T10:10:24.604 INFO:teuthology.orchestra.run.gibba019.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2021-11-18T10:10:24.604 INFO:teuthology.orchestra.run.gibba019.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2021-11-18T10:10:24.604 INFO:teuthology.orchestra.run.gibba019.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2021-11-18T10:10:24.604 INFO:teuthology.lock.ops:Updating gibba019.front.sepia.ceph.com on lock server 2021-11-18T10:10:24.622 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-11-18T10:10:24.635 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-11-18T10:10:24.656 INFO:teuthology.task.internal:Checking for old test directory... 2021-11-18T10:10:24.656 DEBUG:teuthology.orchestra.run.gibba005:> test '!' -e /home/ubuntu/cephtest 2021-11-18T10:10:24.660 DEBUG:teuthology.orchestra.run.gibba019:> test '!' -e /home/ubuntu/cephtest 2021-11-18T10:10:24.672 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-11-18T10:10:24.683 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-11-18T10:10:24.684 DEBUG:teuthology.orchestra.run.gibba005:> test -z $(ls -A /var/lib/ceph) 2021-11-18T10:10:24.712 DEBUG:teuthology.orchestra.run.gibba019:> test -z $(ls -A /var/lib/ceph) 2021-11-18T10:10:24.728 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-11-18T10:10:24.783 INFO:teuthology.run_tasks:Running task kernel... 2021-11-18T10:10:24.801 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2021-11-18T10:10:24.802 INFO:teuthology.task.kernel:config {'cluster1.mon.a': {'kdb': True, 'sha1': 'distro'}, 'cluster2.mon.a': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-11-18T10:10:24.802 DEBUG:teuthology.orchestra.run.gibba005:> uname -r 2021-11-18T10:10:24.814 INFO:teuthology.orchestra.run.gibba005.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-11-18T10:10:24.815 INFO:teuthology.task.kernel:Running kernel on gibba005: 4.18.0-305.10.2.el8_4.x86_64 2021-11-18T10:10:24.815 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum install -y kernel 2021-11-18T10:10:26.926 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS-8 - AppStream 24 MB/s | 8.1 MB 00:00 2021-11-18T10:10:27.986 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS-8 - Base 31 MB/s | 3.5 MB 00:00 2021-11-18T10:10:28.427 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS-8 - Extras 171 kB/s | 10 kB 00:00 2021-11-18T10:10:31.437 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS Linux 8 - AppStream 2.7 MB/s | 8.1 MB 00:02 2021-11-18T10:10:33.474 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS Linux 8 - BaseOS 3.2 MB/s | 3.5 MB 00:01 2021-11-18T10:10:34.202 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS Linux 8 - Extras 30 kB/s | 10 kB 00:00 2021-11-18T10:10:34.343 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS-8 - PowerTools 24 MB/s | 2.3 MB 00:00 2021-11-18T10:10:34.720 INFO:teuthology.orchestra.run.gibba005.stdout:Copr repo for python3-asyncssh owned by ceph 47 kB/s | 3.5 kB 00:00 2021-11-18T10:10:35.981 INFO:teuthology.orchestra.run.gibba005.stdout:Extra Packages for Enterprise Linux 9.0 MB/s | 11 MB 00:01 2021-11-18T10:10:37.702 INFO:teuthology.orchestra.run.gibba005.stdout:lab-extras 3.7 MB/s | 24 kB 00:00 2021-11-18T10:10:39.158 INFO:teuthology.orchestra.run.gibba005.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-11-18T10:10:39.158 INFO:teuthology.orchestra.run.gibba005.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-11-18T10:10:39.413 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:10:39.414 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:10:39.415 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repository Size 2021-11-18T10:10:39.415 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:10:39.415 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:10:39.415 INFO:teuthology.orchestra.run.gibba005.stdout: kernel x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 7.0 M 2021-11-18T10:10:39.416 INFO:teuthology.orchestra.run.gibba005.stdout:Installing dependencies: 2021-11-18T10:10:39.416 INFO:teuthology.orchestra.run.gibba005.stdout: kernel-core x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 38 M 2021-11-18T10:10:39.416 INFO:teuthology.orchestra.run.gibba005.stdout: kernel-modules x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 30 M 2021-11-18T10:10:39.416 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:10:39.416 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:10:39.417 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:10:39.417 INFO:teuthology.orchestra.run.gibba005.stdout:Install 3 Packages 2021-11-18T10:10:39.417 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:10:39.417 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 74 M 2021-11-18T10:10:39.418 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 90 M 2021-11-18T10:10:39.418 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:10:39.690 INFO:teuthology.orchestra.run.gibba005.stdout:(1/3): kernel-4.18.0-348.2.1.el8_5.x86_64.rpm 25 MB/s | 7.0 MB 00:00 2021-11-18T10:10:40.386 INFO:teuthology.orchestra.run.gibba005.stdout:(2/3): kernel-core-4.18.0-348.2.1.el8_5.x86_64. 39 MB/s | 38 MB 00:00 2021-11-18T10:10:40.588 INFO:teuthology.orchestra.run.gibba005.stdout:(3/3): kernel-modules-4.18.0-348.2.1.el8_5.x86_ 25 MB/s | 30 MB 00:01 2021-11-18T10:10:40.590 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:10:40.590 INFO:teuthology.orchestra.run.gibba005.stdout:Total 63 MB/s | 74 MB 00:01 2021-11-18T10:10:40.687 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:10:40.962 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:10:40.962 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:10:42.002 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:10:42.024 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:10:43.953 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:10:44.404 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : kernel-core-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-18T10:10:46.753 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: kernel-core-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-18T10:10:47.038 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-18T10:10:49.484 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-18T10:10:49.701 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : kernel-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-18T10:11:05.171 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: kernel-core-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-18T10:11:05.409 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: kernel-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-18T10:11:05.409 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : kernel-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-18T10:11:05.409 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : kernel-core-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-18T10:11:05.869 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : kernel-modules-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-18T10:11:05.869 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:11:05.870 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:11:05.870 INFO:teuthology.orchestra.run.gibba005.stdout: kernel-4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:05.870 INFO:teuthology.orchestra.run.gibba005.stdout: kernel-core-4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:05.870 INFO:teuthology.orchestra.run.gibba005.stdout: kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:05.870 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:11:05.871 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:11:05.927 DEBUG:teuthology.orchestra.run.gibba005:> rpm -q kernel --last | head -n 1 2021-11-18T10:11:06.050 INFO:teuthology.orchestra.run.gibba005.stdout:kernel-4.18.0-348.2.1.el8_5.x86_64 Thu 18 Nov 2021 10:10:49 AM UTC 2021-11-18T10:11:06.051 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:06.052 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:06.052 DEBUG:teuthology.orchestra.run.gibba019:> uname -r 2021-11-18T10:11:06.065 INFO:teuthology.orchestra.run.gibba019.stdout:4.18.0-305.10.2.el8_4.x86_64 2021-11-18T10:11:06.065 INFO:teuthology.task.kernel:Running kernel on gibba019: 4.18.0-305.10.2.el8_4.x86_64 2021-11-18T10:11:06.065 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum install -y kernel 2021-11-18T10:11:08.210 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS-8 - AppStream 37 MB/s | 8.1 MB 00:00 2021-11-18T10:11:09.382 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS-8 - Base 16 MB/s | 3.5 MB 00:00 2021-11-18T10:11:09.878 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS-8 - Extras 91 kB/s | 10 kB 00:00 2021-11-18T10:11:14.332 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS Linux 8 - AppStream 1.8 MB/s | 8.1 MB 00:04 2021-11-18T10:11:17.132 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS Linux 8 - BaseOS 1.9 MB/s | 3.5 MB 00:01 2021-11-18T10:11:17.912 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS Linux 8 - Extras 26 kB/s | 10 kB 00:00 2021-11-18T10:11:18.044 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS-8 - PowerTools 26 MB/s | 2.3 MB 00:00 2021-11-18T10:11:18.650 INFO:teuthology.orchestra.run.gibba019.stdout:Copr repo for python3-asyncssh owned by ceph 11 kB/s | 3.5 kB 00:00 2021-11-18T10:11:21.879 INFO:teuthology.orchestra.run.gibba019.stdout:Extra Packages for Enterprise Linux 3.4 MB/s | 11 MB 00:03 2021-11-18T10:11:23.599 INFO:teuthology.orchestra.run.gibba019.stdout:lab-extras 4.5 MB/s | 24 kB 00:00 2021-11-18T10:11:25.054 INFO:teuthology.orchestra.run.gibba019.stdout:Package kernel-4.18.0-305.10.2.el8_4.x86_64 is already installed. 2021-11-18T10:11:25.055 INFO:teuthology.orchestra.run.gibba019.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2021-11-18T10:11:25.312 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:11:25.313 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:11:25.313 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repository Size 2021-11-18T10:11:25.314 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:11:25.314 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:11:25.314 INFO:teuthology.orchestra.run.gibba019.stdout: kernel x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 7.0 M 2021-11-18T10:11:25.315 INFO:teuthology.orchestra.run.gibba019.stdout:Installing dependencies: 2021-11-18T10:11:25.315 INFO:teuthology.orchestra.run.gibba019.stdout: kernel-core x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 38 M 2021-11-18T10:11:25.315 INFO:teuthology.orchestra.run.gibba019.stdout: kernel-modules x86_64 4.18.0-348.2.1.el8_5 CentOS-Base 30 M 2021-11-18T10:11:25.315 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:11:25.316 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:11:25.316 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:11:25.316 INFO:teuthology.orchestra.run.gibba019.stdout:Install 3 Packages 2021-11-18T10:11:25.316 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:11:25.316 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 74 M 2021-11-18T10:11:25.317 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 90 M 2021-11-18T10:11:25.317 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:11:25.797 INFO:teuthology.orchestra.run.gibba019.stdout:(1/3): kernel-4.18.0-348.2.1.el8_5.x86_64.rpm 14 MB/s | 7.0 MB 00:00 2021-11-18T10:11:26.241 INFO:teuthology.orchestra.run.gibba019.stdout:(2/3): kernel-core-4.18.0-348.2.1.el8_5.x86_64. 41 MB/s | 38 MB 00:00 2021-11-18T10:11:26.426 INFO:teuthology.orchestra.run.gibba019.stdout:(3/3): kernel-modules-4.18.0-348.2.1.el8_5.x86_ 27 MB/s | 30 MB 00:01 2021-11-18T10:11:26.427 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:11:26.428 INFO:teuthology.orchestra.run.gibba019.stdout:Total 67 MB/s | 74 MB 00:01 2021-11-18T10:11:26.526 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:11:26.804 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:11:26.804 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:11:27.851 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:11:27.879 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:11:29.807 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:11:30.239 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : kernel-core-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-18T10:11:32.641 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: kernel-core-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-18T10:11:32.972 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-18T10:11:35.418 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-18T10:11:35.586 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : kernel-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-18T10:11:51.000 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: kernel-core-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-18T10:11:51.230 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: kernel-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-18T10:11:51.231 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : kernel-4.18.0-348.2.1.el8_5.x86_64 1/3 2021-11-18T10:11:51.231 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : kernel-core-4.18.0-348.2.1.el8_5.x86_64 2/3 2021-11-18T10:11:51.572 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : kernel-modules-4.18.0-348.2.1.el8_5.x86_64 3/3 2021-11-18T10:11:51.572 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:11:51.573 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:11:51.573 INFO:teuthology.orchestra.run.gibba019.stdout: kernel-4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:51.573 INFO:teuthology.orchestra.run.gibba019.stdout: kernel-core-4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:51.573 INFO:teuthology.orchestra.run.gibba019.stdout: kernel-modules-4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:51.573 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:11:51.574 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:11:51.634 DEBUG:teuthology.orchestra.run.gibba019:> rpm -q kernel --last | head -n 1 2021-11-18T10:11:51.759 INFO:teuthology.orchestra.run.gibba019.stdout:kernel-4.18.0-348.2.1.el8_5.x86_64 Thu 18 Nov 2021 10:11:35 AM UTC 2021-11-18T10:11:51.761 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:51.761 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.10.2.el8_4.x86_64 Expected: 4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:51.761 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-11-18T10:11:51.762 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-18T10:11:51.762 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-11-18T10:11:51.762 INFO:teuthology.task.kernel:Installing distro kernel on cluster1.mon.a... 2021-11-18T10:11:51.763 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba005.front.sepia.ceph.com, path=None, version=distro) 2021-11-18T10:11:51.763 DEBUG:teuthology.orchestra.run.gibba005:> rpm -q kernel --last | head -n 1 2021-11-18T10:11:51.867 INFO:teuthology.orchestra.run.gibba005.stdout:kernel-4.18.0-348.2.1.el8_5.x86_64 Thu 18 Nov 2021 10:10:49 AM UTC 2021-11-18T10:11:51.869 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:51.869 DEBUG:teuthology.orchestra.run.gibba005:> sudo rpm -qi grub2-tools 2021-11-18T10:11:51.893 INFO:teuthology.orchestra.run.gibba005.stdout:Name : grub2-tools 2021-11-18T10:11:51.893 INFO:teuthology.orchestra.run.gibba005.stdout:Epoch : 1 2021-11-18T10:11:51.893 INFO:teuthology.orchestra.run.gibba005.stdout:Version : 2.02 2021-11-18T10:11:51.893 INFO:teuthology.orchestra.run.gibba005.stdout:Release : 90.el8 2021-11-18T10:11:51.894 INFO:teuthology.orchestra.run.gibba005.stdout:Architecture: x86_64 2021-11-18T10:11:51.894 INFO:teuthology.orchestra.run.gibba005.stdout:Install Date: Wed 11 Aug 2021 06:37:40 PM UTC 2021-11-18T10:11:51.894 INFO:teuthology.orchestra.run.gibba005.stdout:Group : System Environment/Base 2021-11-18T10:11:51.894 INFO:teuthology.orchestra.run.gibba005.stdout:Size : 9197207 2021-11-18T10:11:51.894 INFO:teuthology.orchestra.run.gibba005.stdout:License : GPLv3+ 2021-11-18T10:11:51.895 INFO:teuthology.orchestra.run.gibba005.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-11-18T10:11:51.895 INFO:teuthology.orchestra.run.gibba005.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-11-18T10:11:51.895 INFO:teuthology.orchestra.run.gibba005.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-11-18T10:11:51.895 INFO:teuthology.orchestra.run.gibba005.stdout:Build Host : kbuilder.bsys.centos.org 2021-11-18T10:11:51.896 INFO:teuthology.orchestra.run.gibba005.stdout:Relocations : (not relocatable) 2021-11-18T10:11:51.896 INFO:teuthology.orchestra.run.gibba005.stdout:Packager : CentOS BuildSystem 2021-11-18T10:11:51.896 INFO:teuthology.orchestra.run.gibba005.stdout:Vendor : CentOS 2021-11-18T10:11:51.896 INFO:teuthology.orchestra.run.gibba005.stdout:URL : http://www.gnu.org/software/grub/ 2021-11-18T10:11:51.896 INFO:teuthology.orchestra.run.gibba005.stdout:Summary : Support tools for GRUB. 2021-11-18T10:11:51.897 INFO:teuthology.orchestra.run.gibba005.stdout:Description : 2021-11-18T10:11:51.897 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:11:51.897 INFO:teuthology.orchestra.run.gibba005.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-11-18T10:11:51.897 INFO:teuthology.orchestra.run.gibba005.stdout:customizable bootloader with modular architecture. It supports a rich 2021-11-18T10:11:51.897 INFO:teuthology.orchestra.run.gibba005.stdout:variety of kernel formats, file systems, computer architectures and 2021-11-18T10:11:51.898 INFO:teuthology.orchestra.run.gibba005.stdout:hardware devices. 2021-11-18T10:11:51.898 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:11:51.898 INFO:teuthology.orchestra.run.gibba005.stdout:This subpackage provides tools for support of all platforms. 2021-11-18T10:11:51.899 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-11-18T10:11:51.900 INFO:teuthology.task.kernel:Updating grub on gibba005 to boot 4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:51.900 DEBUG:teuthology.orchestra.run.gibba005:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-11-18T10:11:52.684 INFO:teuthology.orchestra.run.gibba005.stderr:Generating grub configuration file ... 2021-11-18T10:11:54.431 INFO:teuthology.orchestra.run.gibba005.stderr:done 2021-11-18T10:11:54.433 DEBUG:teuthology.orchestra.run.gibba005:> mktemp 2021-11-18T10:11:54.472 INFO:teuthology.orchestra.run.gibba005.stdout:/tmp/tmp.yBnnhd4rtn 2021-11-18T10:11:54.473 DEBUG:teuthology.orchestra.run.gibba005:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yBnnhd4rtn 2021-11-18T10:11:54.535 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0666 /tmp/tmp.yBnnhd4rtn 2021-11-18T10:11:54.667 DEBUG:teuthology.orchestra.remote:gibba005:/tmp/tmp.yBnnhd4rtn is 6KB 2021-11-18T10:11:54.717 DEBUG:teuthology.orchestra.run.gibba005:> rm -fr /tmp/tmp.yBnnhd4rtn 2021-11-18T10:11:54.729 DEBUG:teuthology.orchestra.run.gibba005:> sudo /bin/ls /boot/loader/entries || true 2021-11-18T10:11:54.787 INFO:teuthology.orchestra.run.gibba005.stdout:a2301e55c861490cbf6521f4f4e1b770-0-rescue.conf 2021-11-18T10:11:54.787 INFO:teuthology.orchestra.run.gibba005.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-240.el8.x86_64.conf 2021-11-18T10:11:54.788 INFO:teuthology.orchestra.run.gibba005.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-305.10.2.el8_4.x86_64.conf 2021-11-18T10:11:54.788 INFO:teuthology.orchestra.run.gibba005.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-348.2.1.el8_5.x86_64.conf 2021-11-18T10:11:54.789 DEBUG:teuthology.orchestra.run.gibba005:> sudo grub2-set-default a2301e55c861490cbf6521f4f4e1b770-4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:54.943 DEBUG:teuthology.orchestra.run.gibba005:> sudo shutdown -r now 2021-11-18T10:11:54.945 INFO:teuthology.task.kernel:Installing distro kernel on cluster2.mon.a... 2021-11-18T10:11:54.945 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@gibba019.front.sepia.ceph.com, path=None, version=distro) 2021-11-18T10:11:54.946 DEBUG:teuthology.orchestra.run.gibba019:> rpm -q kernel --last | head -n 1 2021-11-18T10:11:55.049 INFO:teuthology.orchestra.run.gibba019.stdout:kernel-4.18.0-348.2.1.el8_5.x86_64 Thu 18 Nov 2021 10:11:35 AM UTC 2021-11-18T10:11:55.050 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:55.051 DEBUG:teuthology.orchestra.run.gibba019:> sudo rpm -qi grub2-tools 2021-11-18T10:11:55.075 INFO:teuthology.orchestra.run.gibba019.stdout:Name : grub2-tools 2021-11-18T10:11:55.075 INFO:teuthology.orchestra.run.gibba019.stdout:Epoch : 1 2021-11-18T10:11:55.076 INFO:teuthology.orchestra.run.gibba019.stdout:Version : 2.02 2021-11-18T10:11:55.076 INFO:teuthology.orchestra.run.gibba019.stdout:Release : 90.el8 2021-11-18T10:11:55.076 INFO:teuthology.orchestra.run.gibba019.stdout:Architecture: x86_64 2021-11-18T10:11:55.076 INFO:teuthology.orchestra.run.gibba019.stdout:Install Date: Wed 11 Aug 2021 06:37:40 PM UTC 2021-11-18T10:11:55.076 INFO:teuthology.orchestra.run.gibba019.stdout:Group : System Environment/Base 2021-11-18T10:11:55.077 INFO:teuthology.orchestra.run.gibba019.stdout:Size : 9197207 2021-11-18T10:11:55.077 INFO:teuthology.orchestra.run.gibba019.stdout:License : GPLv3+ 2021-11-18T10:11:55.077 INFO:teuthology.orchestra.run.gibba019.stdout:Signature : RSA/SHA256, Tue 08 Sep 2020 07:14:39 PM UTC, Key ID 05b555b38483c65d 2021-11-18T10:11:55.077 INFO:teuthology.orchestra.run.gibba019.stdout:Source RPM : grub2-2.02-90.el8.src.rpm 2021-11-18T10:11:55.078 INFO:teuthology.orchestra.run.gibba019.stdout:Build Date : Tue 08 Sep 2020 07:00:29 PM UTC 2021-11-18T10:11:55.078 INFO:teuthology.orchestra.run.gibba019.stdout:Build Host : kbuilder.bsys.centos.org 2021-11-18T10:11:55.078 INFO:teuthology.orchestra.run.gibba019.stdout:Relocations : (not relocatable) 2021-11-18T10:11:55.078 INFO:teuthology.orchestra.run.gibba019.stdout:Packager : CentOS BuildSystem 2021-11-18T10:11:55.079 INFO:teuthology.orchestra.run.gibba019.stdout:Vendor : CentOS 2021-11-18T10:11:55.079 INFO:teuthology.orchestra.run.gibba019.stdout:URL : http://www.gnu.org/software/grub/ 2021-11-18T10:11:55.079 INFO:teuthology.orchestra.run.gibba019.stdout:Summary : Support tools for GRUB. 2021-11-18T10:11:55.079 INFO:teuthology.orchestra.run.gibba019.stdout:Description : 2021-11-18T10:11:55.079 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:11:55.080 INFO:teuthology.orchestra.run.gibba019.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2021-11-18T10:11:55.080 INFO:teuthology.orchestra.run.gibba019.stdout:customizable bootloader with modular architecture. It supports a rich 2021-11-18T10:11:55.080 INFO:teuthology.orchestra.run.gibba019.stdout:variety of kernel formats, file systems, computer architectures and 2021-11-18T10:11:55.080 INFO:teuthology.orchestra.run.gibba019.stdout:hardware devices. 2021-11-18T10:11:55.081 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:11:55.081 INFO:teuthology.orchestra.run.gibba019.stdout:This subpackage provides tools for support of all platforms. 2021-11-18T10:11:55.082 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2021-11-18T10:11:55.082 INFO:teuthology.task.kernel:Updating grub on gibba019 to boot 4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:55.083 DEBUG:teuthology.orchestra.run.gibba019:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2021-11-18T10:11:56.618 INFO:teuthology.orchestra.run.gibba019.stderr:Generating grub configuration file ... 2021-11-18T10:11:58.416 INFO:teuthology.orchestra.run.gibba019.stderr:done 2021-11-18T10:11:58.435 DEBUG:teuthology.orchestra.run.gibba019:> mktemp 2021-11-18T10:11:58.475 INFO:teuthology.orchestra.run.gibba019.stdout:/tmp/tmp.LrVRKP4Oyn 2021-11-18T10:11:58.476 DEBUG:teuthology.orchestra.run.gibba019:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.LrVRKP4Oyn 2021-11-18T10:11:58.537 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0666 /tmp/tmp.LrVRKP4Oyn 2021-11-18T10:11:58.681 DEBUG:teuthology.orchestra.remote:gibba019:/tmp/tmp.LrVRKP4Oyn is 6KB 2021-11-18T10:11:58.730 DEBUG:teuthology.orchestra.run.gibba019:> rm -fr /tmp/tmp.LrVRKP4Oyn 2021-11-18T10:11:58.742 DEBUG:teuthology.orchestra.run.gibba019:> sudo /bin/ls /boot/loader/entries || true 2021-11-18T10:11:58.800 INFO:teuthology.orchestra.run.gibba019.stdout:a2301e55c861490cbf6521f4f4e1b770-0-rescue.conf 2021-11-18T10:11:58.800 INFO:teuthology.orchestra.run.gibba019.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-240.el8.x86_64.conf 2021-11-18T10:11:58.800 INFO:teuthology.orchestra.run.gibba019.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-305.10.2.el8_4.x86_64.conf 2021-11-18T10:11:58.801 INFO:teuthology.orchestra.run.gibba019.stdout:a2301e55c861490cbf6521f4f4e1b770-4.18.0-348.2.1.el8_5.x86_64.conf 2021-11-18T10:11:58.802 DEBUG:teuthology.orchestra.run.gibba019:> sudo grub2-set-default a2301e55c861490cbf6521f4f4e1b770-4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:11:58.939 DEBUG:teuthology.orchestra.run.gibba019:> sudo shutdown -r now 2021-11-18T10:12:28.973 INFO:teuthology.misc:Re-opening connections... 2021-11-18T10:12:28.974 INFO:teuthology.misc:trying to connect to ubuntu@gibba005.front.sepia.ceph.com 2021-11-18T10:12:28.975 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba005.front.sepia.ceph.com' 2021-11-18T10:12:28.976 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-18T10:14:03.627 DEBUG:teuthology.orchestra.remote:timed out 2021-11-18T10:14:03.629 INFO:teuthology.misc:trying to connect to ubuntu@gibba019.front.sepia.ceph.com 2021-11-18T10:14:03.630 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba019.front.sepia.ceph.com' 2021-11-18T10:14:03.631 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-18T10:14:03.891 DEBUG:teuthology.orchestra.run.gibba019:> true 2021-11-18T10:14:04.152 DEBUG:teuthology.misc:waited 95.17843127250671 2021-11-18T10:14:05.153 INFO:teuthology.misc:trying to connect to ubuntu@gibba005.front.sepia.ceph.com 2021-11-18T10:14:05.154 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba005.front.sepia.ceph.com' 2021-11-18T10:14:05.155 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-18T10:14:05.446 DEBUG:teuthology.orchestra.run.gibba005:> true 2021-11-18T10:14:05.735 DEBUG:teuthology.misc:waited 96.76094627380371 2021-11-18T10:14:06.736 INFO:teuthology.task.kernel:Checking client cluster1.mon.a for new kernel version... 2021-11-18T10:14:06.737 INFO:teuthology.task.kernel:Checking kernel version of cluster1.mon.a, want "4.18.0-348.2.1.el8_5.x86_64"... 2021-11-18T10:14:06.737 DEBUG:teuthology.orchestra.run.gibba005:> uname -r 2021-11-18T10:14:06.749 INFO:teuthology.orchestra.run.gibba005.stdout:4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:14:06.750 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-348.2.1.el8_5.x86_64 vs 4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:14:06.750 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-18T10:14:06.750 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-11-18T10:14:06.751 INFO:teuthology.task.kernel:Checking client cluster2.mon.a for new kernel version... 2021-11-18T10:14:06.751 INFO:teuthology.task.kernel:Checking kernel version of cluster2.mon.a, want "4.18.0-348.2.1.el8_5.x86_64"... 2021-11-18T10:14:06.751 DEBUG:teuthology.orchestra.run.gibba019:> uname -r 2021-11-18T10:14:06.764 INFO:teuthology.orchestra.run.gibba019.stdout:4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:14:06.765 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-348.2.1.el8_5.x86_64 vs 4.18.0-348.2.1.el8_5.x86_64 2021-11-18T10:14:06.765 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-11-18T10:14:06.765 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2021-11-18T10:14:07.766 INFO:teuthology.task.kernel:Enabling kdb on cluster1.mon.a... 2021-11-18T10:14:07.767 DEBUG:teuthology.orchestra.run.gibba005:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-18T10:14:07.825 INFO:teuthology.orchestra.run.gibba005.stdout:ttyS1 2021-11-18T10:14:07.838 INFO:teuthology.task.kernel:Enabling kdb on cluster2.mon.a... 2021-11-18T10:14:07.839 DEBUG:teuthology.orchestra.run.gibba019:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-11-18T10:14:07.897 INFO:teuthology.orchestra.run.gibba019.stdout:ttyS1 2021-11-18T10:14:07.916 INFO:teuthology.run_tasks:Running task internal.base... 2021-11-18T10:14:07.932 INFO:teuthology.task.internal:Creating test directory... 2021-11-18T10:14:07.933 DEBUG:teuthology.orchestra.run.gibba005:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-18T10:14:07.936 DEBUG:teuthology.orchestra.run.gibba019:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-11-18T10:14:07.948 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-11-18T10:14:07.967 INFO:teuthology.run_tasks:Running task internal.archive... 2021-11-18T10:14:08.002 INFO:teuthology.task.internal:Creating archive directory... 2021-11-18T10:14:08.003 DEBUG:teuthology.orchestra.run.gibba005:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-18T10:14:08.005 DEBUG:teuthology.orchestra.run.gibba019:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-11-18T10:14:08.060 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-11-18T10:14:08.069 INFO:teuthology.task.internal:Enabling coredump saving... 2021-11-18T10:14:08.070 DEBUG:teuthology.orchestra.run.gibba005:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-18T10:14:08.073 DEBUG:teuthology.orchestra.run.gibba019:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-11-18T10:14:08.090 INFO:teuthology.orchestra.run.gibba005.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-18T10:14:08.093 INFO:teuthology.orchestra.run.gibba019.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-18T10:14:08.098 INFO:teuthology.orchestra.run.gibba005.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-18T10:14:08.100 INFO:teuthology.orchestra.run.gibba019.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-11-18T10:14:08.102 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-11-18T10:14:08.110 INFO:teuthology.task.internal:Configuring sudo... 2021-11-18T10:14:08.110 DEBUG:teuthology.orchestra.run.gibba005:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-18T10:14:08.143 DEBUG:teuthology.orchestra.run.gibba019:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-11-18T10:14:08.163 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-11-18T10:14:08.177 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-11-18T10:14:08.178 DEBUG:teuthology.orchestra.run.gibba005:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-18T10:14:08.203 DEBUG:teuthology.orchestra.run.gibba019:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-11-18T10:14:08.216 DEBUG:teuthology.orchestra.run.gibba005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-18T10:14:08.296 DEBUG:teuthology.orchestra.run.gibba005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-18T10:14:08.335 DEBUG:teuthology.orchestra.run.gibba005:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-18T10:14:08.410 DEBUG:teuthology.orchestra.run.gibba005:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-18T10:14:08.448 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:14:08.448 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-18T10:14:08.507 DEBUG:teuthology.orchestra.run.gibba019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-18T10:14:08.543 DEBUG:teuthology.orchestra.run.gibba019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2021-11-18T10:14:08.592 DEBUG:teuthology.orchestra.run.gibba019:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-18T10:14:08.667 DEBUG:teuthology.orchestra.run.gibba019:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2021-11-18T10:14:08.705 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:14:08.706 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-11-18T10:14:08.764 DEBUG:teuthology.orchestra.run.gibba005:> sudo service rsyslog restart 2021-11-18T10:14:08.767 DEBUG:teuthology.orchestra.run.gibba019:> sudo service rsyslog restart 2021-11-18T10:14:08.808 INFO:teuthology.orchestra.run.gibba005.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-11-18T10:14:08.852 INFO:teuthology.orchestra.run.gibba019.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2021-11-18T10:14:09.293 INFO:teuthology.run_tasks:Running task internal.timer... 2021-11-18T10:14:09.305 INFO:teuthology.task.internal:Starting timer... 2021-11-18T10:14:09.306 INFO:teuthology.run_tasks:Running task pcp... 2021-11-18T10:14:09.348 INFO:teuthology.run_tasks:Running task selinux... 2021-11-18T10:14:09.363 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2021-11-18T10:14:09.364 DEBUG:teuthology.orchestra.run.gibba005:> sudo service auditd rotate 2021-11-18T10:14:09.430 INFO:teuthology.orchestra.run.gibba005.stdout:Rotating logs: [ OK ] 2021-11-18T10:14:09.432 DEBUG:teuthology.orchestra.run.gibba019:> sudo service auditd rotate 2021-11-18T10:14:09.471 INFO:teuthology.orchestra.run.gibba019.stdout:Rotating logs: [ OK ] 2021-11-18T10:14:09.473 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-11-18T10:14:09.473 DEBUG:teuthology.orchestra.run.gibba005:> /usr/sbin/getenforce 2021-11-18T10:14:09.487 INFO:teuthology.orchestra.run.gibba005.stdout:Permissive 2021-11-18T10:14:09.488 DEBUG:teuthology.orchestra.run.gibba019:> /usr/sbin/getenforce 2021-11-18T10:14:09.533 INFO:teuthology.orchestra.run.gibba019.stdout:Permissive 2021-11-18T10:14:09.533 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@gibba005.front.sepia.ceph.com': 'permissive', 'ubuntu@gibba019.front.sepia.ceph.com': 'permissive'} 2021-11-18T10:14:09.534 DEBUG:teuthology.orchestra.run.gibba005:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-11-18T10:14:09.553 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:14:09.554 DEBUG:teuthology.orchestra.run.gibba019:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|comm="sssd"\|scontext=system_u:system_r:logrotate_t:s0\)' 2021-11-18T10:14:09.592 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:14:09.593 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-11-18T10:14:09.594 DEBUG:teuthology.orchestra.run.gibba005:> sudo /usr/sbin/setenforce permissive 2021-11-18T10:14:09.614 DEBUG:teuthology.orchestra.run.gibba019:> sudo /usr/sbin/setenforce permissive 2021-11-18T10:14:09.660 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-11-18T10:14:09.672 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated or references a specific commit; assuming it is current 2021-11-18T10:14:09.673 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-11-18T10:14:09.694 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2021-11-18T10:14:09.696 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit gibba005.front.sepia.ceph.com,gibba019.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-11-18T10:14:10.093 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-11-18T10:14:10.976 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-11-18T10:14:13.933 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-11-18T10:14:14.041 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:14 +0000 (0:00:00.125) 0:00:00.125 ***** 2021-11-18T10:14:14.053 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:14 +0000 (0:00:00.011) 0:00:00.136 ***** 2021-11-18T10:14:15.321 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba005.front.sepia.ceph.com] 2021-11-18T10:14:15.373 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:15 +0000 (0:00:01.320) 0:00:01.456 ***** 2021-11-18T10:14:15.383 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] 2021-11-18T10:14:15.434 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:15 +0000 (0:00:00.061) 0:00:01.518 ***** 2021-11-18T10:14:15.610 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-11-18T10:14:15.612 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-11-18T10:14:15.632 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:15 +0000 (0:00:00.197) 0:00:01.716 ***** 2021-11-18T10:14:15.651 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:15 +0000 (0:00:00.018) 0:00:01.735 ***** 2021-11-18T10:14:16.142 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-11-18T10:14:16.144 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-18T10:14:16.167 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:16 +0000 (0:00:00.516) 0:00:02.251 ***** 2021-11-18T10:14:16.175 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-11-18T10:14:16.201 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:16 +0000 (0:00:00.033) 0:00:02.285 ***** 2021-11-18T10:14:16.241 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:16.267 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:16 +0000 (0:00:00.066) 0:00:02.351 ***** 2021-11-18T10:14:16.279 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:16.308 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:16 +0000 (0:00:00.040) 0:00:02.391 ***** 2021-11-18T10:14:16.499 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-11-18T10:14:16.501 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-18T10:14:16.522 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:16 +0000 (0:00:00.214) 0:00:02.606 ***** 2021-11-18T10:14:16.541 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:16 +0000 (0:00:00.018) 0:00:02.625 ***** 2021-11-18T10:14:17.182 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-11-18T10:14:17.184 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637230456.5820577-23184-12072825168782/source", "state": "file", "uid": 0} 2021-11-18T10:14:17.204 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:17 +0000 (0:00:00.662) 0:00:03.288 ***** 2021-11-18T10:14:17.211 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637230456.5623188-23182-123147586986911/source", "state": "file", "uid": 0} 2021-11-18T10:14:17.251 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:17 +0000 (0:00:00.040) 0:00:03.328 ***** 2021-11-18T10:14:17.571 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-11-18T10:14:17.573 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-18T10:14:17.575 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-18T10:14:17.615 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4 2021-11-18T10:14:17.616 INFO:teuthology.task.ansible.out:r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-11-18T10:14:17.678 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-11-18T10:14:17.686 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-18T10:14:17.693 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* Thursday 18 November 2021 10:14:17 +0000 (0:00:00.449) 0:00:03.777 ***** 2021-11-18T10:14:18.128 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] 2021-11-18T10:14:18.157 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] 2021-11-18T10:14:18.174 INFO:teuthology.task.ansible.out: TASK [set_fact] **************************************************************** Thursday 18 November 2021 10:14:18 +0000 (0:00:00.480) 0:00:04.258 ***** 2021-11-18T10:14:18.199 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-18T10:14:18.220 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"ran_from_cephlab_playbook": true}, "changed": false} 2021-11-18T10:14:18.225 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-18T10:14:18.385 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:18 +0000 (0:00:00.210) 0:00:04.469 ***** 2021-11-18T10:14:18.408 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:18 +0000 (0:00:00.022) 0:00:04.492 ***** 2021-11-18T10:14:18.968 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba005.front.sepia.ceph.com] 2021-11-18T10:14:18.998 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] 2021-11-18T10:14:19.028 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-11-18T10:14:19.030 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:19 +0000 (0:00:00.620) 0:00:05.112 ***** 2021-11-18T10:14:19.072 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:19 +0000 (0:00:00.044) 0:00:05.156 ***** 2021-11-18T10:14:19.834 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-11-18T10:14:19.836 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.290159", "end": "2021-11-18 10:14:19.806664", "rc": 0, "start": "2021-11-18 10:14:19.516505", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.314694", "end": "2021-11-18 10:14:19.806365", "rc": 0, "start": "2021-11-18 10:14:19.491671", "stderr": "", "stderr_lines": [], "stdout": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "stdout_lines": ["d72e06d3c78c8d9639a8ca75effa043ee468910f"]} 2021-11-18T10:14:19.857 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:19 +0000 (0:00:00.784) 0:00:05.941 ***** 2021-11-18T10:14:19.878 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:19 +0000 (0:00:00.020) 0:00:05.961 ***** 2021-11-18T10:14:20.010 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-11-18T10:14:20.012 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009844", "end": "2021-11-18 10:14:19.998091", "failed_when_result": false, "rc": 0, "start": "2021-11-18 10:14:19.988247", "stderr": "", "stderr_lines": [], "stdout": "c29274177b79f72740fc714fa28b55400cd0737f", "stdout_lines": ["c29274177b79f72740fc714fa28b55400cd0737f"]} 2021-11-18T10:14:20.036 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.158) 0:00:06.120 ***** 2021-11-18T10:14:20.044 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009888", "end": "2021-11-18 10:14:20.018556", "failed_when_result": false, "rc": 0, "start": "2021-11-18 10:14:20.008668", "stderr": "", "stderr_lines": [], "stdout": "c29274177b79f72740fc714fa28b55400cd0737f", "stdout_lines": ["c29274177b79f72740fc714fa28b55400cd0737f"]} 2021-11-18T10:14:20.069 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.032) 0:00:06.152 ***** 2021-11-18T10:14:20.097 INFO:teuthology.task.ansible.out: TASK [Determine if we can skip users and pubkeys updates] ********************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:20.122 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.053) 0:00:06.206 ***** 2021-11-18T10:14:20.141 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:20.164 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.042) 0:00:06.248 ***** 2021-11-18T10:14:20.193 INFO:teuthology.task.ansible.out: TASK [Merge extra_admin_users into managed_admin_users] ************************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:20.220 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.055) 0:00:06.304 ***** 2021-11-18T10:14:20.239 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:20.268 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.047) 0:00:06.351 ***** 2021-11-18T10:14:20.288 INFO:teuthology.task.ansible.out: TASK [Remove managed_admin_users from managed_users] *************************** 2021-11-18T10:14:20.291 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:20.312 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.044) 0:00:06.396 ***** 2021-11-18T10:14:20.333 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:20.357 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.044) 0:00:06.441 ***** 2021-11-18T10:14:20.384 INFO:teuthology.task.ansible.out: TASK [Filter the managed_users list] ******************************************* 2021-11-18T10:14:20.386 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:20.409 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.051) 0:00:06.492 ***** 2021-11-18T10:14:20.427 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:20.451 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.042) 0:00:06.535 ***** 2021-11-18T10:14:20.493 INFO:teuthology.task.ansible.out: TASK [Filter the managed_admin_users list] ************************************* 2021-11-18T10:14:20.495 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:20.518 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.066) 0:00:06.602 ***** 2021-11-18T10:14:20.547 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:20.569 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.051) 0:00:06.653 ***** 2021-11-18T10:14:20.711 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-11-18T10:14:20.713 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-18T10:14:20.736 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.166) 0:00:06.819 ***** 2021-11-18T10:14:20.766 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-18T10:14:20.791 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:20 +0000 (0:00:00.055) 0:00:06.874 ***** 2021-11-18T10:14:20.988 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** 2021-11-18T10:14:20.990 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-18T10:14:21.064 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2021-11-18T10:14:21.149 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-18T10:14:21.223 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2021-11-18T10:14:21.301 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-18T10:14:21.375 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2021-11-18T10:14:21.462 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-18T10:14:21.536 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1104} 2021-11-18T10:14:21.610 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-18T10:14:21.686 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1105} 2021-11-18T10:14:21.782 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-18T10:14:21.846 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1106} 2021-11-18T10:14:21.942 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-18T10:14:22.007 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1107} 2021-11-18T10:14:22.093 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-18T10:14:22.169 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/jcaratzas", "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "move_home": false, "name": "jcaratzas", "shell": "/bin/bash", "state": "present", "uid": 1108} 2021-11-18T10:14:22.259 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-18T10:14:22.323 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2021-11-18T10:14:22.420 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-18T10:14:22.496 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2021-11-18T10:14:22.572 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-18T10:14:22.658 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2021-11-18T10:14:22.731 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-18T10:14:22.817 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2021-11-18T10:14:22.882 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-18T10:14:22.967 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1113, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1113} 2021-11-18T10:14:23.041 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-18T10:14:23.126 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1114} 2021-11-18T10:14:23.201 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-18T10:14:23.276 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1115} 2021-11-18T10:14:23.351 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-18T10:14:23.425 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1116} 2021-11-18T10:14:23.510 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-18T10:14:23.585 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1117} 2021-11-18T10:14:23.659 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-18T10:14:23.735 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/cmeno", "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "move_home": false, "name": "cmeno", "shell": "/bin/bash", "state": "present", "uid": 1119} 2021-11-18T10:14:23.810 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-18T10:14:23.894 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1120} 2021-11-18T10:14:23.978 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-18T10:14:24.052 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1122} 2021-11-18T10:14:24.127 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-18T10:14:24.201 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1123} 2021-11-18T10:14:24.286 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-18T10:14:24.362 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1124} 2021-11-18T10:14:24.446 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-18T10:14:24.513 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1125} 2021-11-18T10:14:24.598 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-18T10:14:24.674 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1126} 2021-11-18T10:14:24.758 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-18T10:14:24.831 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1127} 2021-11-18T10:14:24.915 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-18T10:14:24.979 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1128} 2021-11-18T10:14:25.083 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-18T10:14:25.136 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1129} 2021-11-18T10:14:25.251 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-18T10:14:25.294 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1130} 2021-11-18T10:14:25.410 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-18T10:14:25.453 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1131} 2021-11-18T10:14:25.568 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-18T10:14:25.612 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1132} 2021-11-18T10:14:25.739 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-18T10:14:25.762 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1134} 2021-11-18T10:14:25.890 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-18T10:14:25.923 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1135, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1135} 2021-11-18T10:14:26.051 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-18T10:14:26.073 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1136} 2021-11-18T10:14:26.201 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-11-18T10:14:26.235 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1137} 2021-11-18T10:14:26.362 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-18T10:14:26.405 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-18T10:14:26.527 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-18T10:14:26.560 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1139} 2021-11-18T10:14:26.685 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-18T10:14:26.717 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1140} 2021-11-18T10:14:26.833 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-18T10:14:26.865 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1141} 2021-11-18T10:14:26.993 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-18T10:14:27.025 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1142} 2021-11-18T10:14:27.164 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-18T10:14:27.187 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1143} 2021-11-18T10:14:27.330 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-18T10:14:27.352 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1144} 2021-11-18T10:14:27.481 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-18T10:14:27.523 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1145, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1145} 2021-11-18T10:14:27.649 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-18T10:14:27.671 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-18T10:14:27.807 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-18T10:14:27.830 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1147} 2021-11-18T10:14:27.957 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-18T10:14:27.989 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1148} 2021-11-18T10:14:28.106 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-18T10:14:28.150 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1149, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1149} 2021-11-18T10:14:28.265 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-18T10:14:28.298 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1150} 2021-11-18T10:14:28.423 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-18T10:14:28.467 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1151, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1151} 2021-11-18T10:14:28.586 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-18T10:14:28.629 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1152, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1152} 2021-11-18T10:14:28.745 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-18T10:14:28.788 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1153} 2021-11-18T10:14:28.894 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-18T10:14:28.937 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1154, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1154} 2021-11-18T10:14:29.052 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-18T10:14:29.096 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1155} 2021-11-18T10:14:29.202 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-18T10:14:29.255 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1156} 2021-11-18T10:14:29.360 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-18T10:14:29.403 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1157} 2021-11-18T10:14:29.520 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-18T10:14:29.562 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1158} 2021-11-18T10:14:29.678 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-18T10:14:29.721 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1159} 2021-11-18T10:14:29.826 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-18T10:14:29.880 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1160, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1160} 2021-11-18T10:14:29.985 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-18T10:14:30.039 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1161} 2021-11-18T10:14:30.135 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-18T10:14:30.199 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1162} 2021-11-18T10:14:30.294 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-18T10:14:30.347 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1138} 2021-11-18T10:14:30.452 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-18T10:14:30.505 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1163} 2021-11-18T10:14:30.603 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-18T10:14:30.668 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1164} 2021-11-18T10:14:30.762 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-18T10:14:30.816 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1165} 2021-11-18T10:14:30.921 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-18T10:14:30.974 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1166, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1166} 2021-11-18T10:14:31.079 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-18T10:14:31.132 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1167} 2021-11-18T10:14:31.227 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-18T10:14:31.280 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1168} 2021-11-18T10:14:31.385 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-18T10:14:31.439 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1169} 2021-11-18T10:14:31.533 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-18T10:14:31.597 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1170} 2021-11-18T10:14:31.692 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-18T10:14:31.755 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1171} 2021-11-18T10:14:31.840 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-18T10:14:31.904 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1172} 2021-11-18T10:14:32.000 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-18T10:14:32.065 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1173, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1173} 2021-11-18T10:14:32.160 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-18T10:14:32.226 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1174} 2021-11-18T10:14:32.331 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-18T10:14:32.389 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1175, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1175} 2021-11-18T10:14:32.496 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-18T10:14:32.552 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1176, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1176} 2021-11-18T10:14:32.671 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-18T10:14:32.726 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1177} 2021-11-18T10:14:32.853 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-18T10:14:32.916 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1178} 2021-11-18T10:14:33.025 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-18T10:14:33.079 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1179} 2021-11-18T10:14:33.187 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-18T10:14:33.241 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1180} 2021-11-18T10:14:33.348 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-18T10:14:33.402 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1181} 2021-11-18T10:14:33.509 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-18T10:14:33.563 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1182} 2021-11-18T10:14:33.670 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-11-18T10:14:33.723 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1185} 2021-11-18T10:14:33.818 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-18T10:14:33.882 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1186} 2021-11-18T10:14:33.977 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-18T10:14:34.041 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1187} 2021-11-18T10:14:34.136 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-18T10:14:34.189 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1188} 2021-11-18T10:14:34.296 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-18T10:14:34.353 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1189} 2021-11-18T10:14:34.448 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-18T10:14:34.502 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1190} 2021-11-18T10:14:34.602 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-18T10:14:34.666 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1191} 2021-11-18T10:14:34.763 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-18T10:14:34.817 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1192} 2021-11-18T10:14:34.913 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-18T10:14:34.967 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1193} 2021-11-18T10:14:35.073 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-18T10:14:35.127 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1194} 2021-11-18T10:14:35.233 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-18T10:14:35.288 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1195} 2021-11-18T10:14:35.393 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-18T10:14:35.436 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1196} 2021-11-18T10:14:35.542 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-18T10:14:35.605 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1197} 2021-11-18T10:14:35.701 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-18T10:14:35.754 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1198} 2021-11-18T10:14:35.860 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-18T10:14:35.914 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1199} 2021-11-18T10:14:36.020 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-18T10:14:36.073 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1146} 2021-11-18T10:14:36.168 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-18T10:14:36.232 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 1200} 2021-11-18T10:14:36.327 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-18T10:14:36.391 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "move_home": false, "name": "rraja", "shell": "/bin/bash", "state": "present", "uid": 1201} 2021-11-18T10:14:36.476 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-18T10:14:36.551 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/toabctl", "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "move_home": false, "name": "toabctl", "shell": "/bin/bash", "state": "present", "uid": 1202} 2021-11-18T10:14:36.636 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-18T10:14:36.712 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/mgfritch", "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "move_home": false, "name": "mgfritch", "shell": "/bin/bash", "state": "present", "uid": 1203} 2021-11-18T10:14:36.797 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-18T10:14:36.872 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/xiubli", "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "move_home": false, "name": "xiubli", "shell": "/bin/bash", "state": "present", "uid": 1204} 2021-11-18T10:14:36.958 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-18T10:14:37.032 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/jafaj", "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "move_home": false, "name": "jafaj", "shell": "/bin/bash", "state": "present", "uid": 1205} 2021-11-18T10:14:37.106 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-18T10:14:37.181 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/jschmid", "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "move_home": false, "name": "jschmid", "shell": "/bin/bash", "state": "present", "uid": 1206} 2021-11-18T10:14:37.265 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-18T10:14:37.344 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/kachau", "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "move_home": false, "name": "kachau", "shell": "/bin/bash", "state": "present", "uid": 1207} 2021-11-18T10:14:37.430 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-18T10:14:37.494 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/khiremat", "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "move_home": false, "name": "khiremat", "shell": "/bin/bash", "state": "present", "uid": 1208} 2021-11-18T10:14:37.600 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-18T10:14:37.655 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/kapandya", "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "move_home": false, "name": "kapandya", "shell": "/bin/bash", "state": "present", "uid": 1209} 2021-11-18T10:14:37.752 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-18T10:14:37.816 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/prasad", "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "move_home": false, "name": "prasad", "shell": "/bin/bash", "state": "present", "uid": 1210} 2021-11-18T10:14:37.911 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-18T10:14:37.974 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/vikhyat", "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "move_home": false, "name": "vikhyat", "shell": "/bin/bash", "state": "present", "uid": 1211} 2021-11-18T10:14:38.069 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-18T10:14:38.132 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/shraddhaag", "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "move_home": false, "name": "shraddhaag", "shell": "/bin/bash", "state": "present", "uid": 1212} 2021-11-18T10:14:38.227 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-18T10:14:38.281 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/gkyratsas", "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "move_home": false, "name": "gkyratsas", "shell": "/bin/bash", "state": "present", "uid": 1213} 2021-11-18T10:14:38.376 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-18T10:14:38.439 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/prateek", "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "move_home": false, "name": "prateek", "shell": "/bin/bash", "state": "present", "uid": 1214} 2021-11-18T10:14:38.534 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-18T10:14:38.597 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1215, "groups": "sudo", "home": "/home/jelopez", "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "move_home": false, "name": "jelopez", "shell": "/bin/bash", "state": "present", "uid": 1215} 2021-11-18T10:14:38.696 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-18T10:14:38.762 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1216, "groups": "sudo", "home": "/home/dcain", "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "move_home": false, "name": "dcain", "shell": "/bin/bash", "state": "present", "uid": 1216} 2021-11-18T10:14:38.847 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-18T10:14:38.922 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1217, "groups": "sudo", "home": "/home/sunny", "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "move_home": false, "name": "sunny", "shell": "/bin/bash", "state": "present", "uid": 1217} 2021-11-18T10:14:39.010 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-18T10:14:39.076 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1218, "groups": "sudo", "home": "/home/xuxuehan", "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "move_home": false, "name": "xuxuehan", "shell": "/bin/bash", "state": "present", "uid": 1218} 2021-11-18T10:14:39.161 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-18T10:14:39.236 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1219, "groups": "sudo", "home": "/home/aclewett", "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "move_home": false, "name": "aclewett", "shell": "/bin/bash", "state": "present", "uid": 1219} 2021-11-18T10:14:39.320 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-18T10:14:39.394 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1220, "groups": "sudo", "home": "/home/cblum", "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "move_home": false, "name": "cblum", "shell": "/bin/bash", "state": "present", "uid": 1220} 2021-11-18T10:14:39.479 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-18T10:14:39.542 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1221, "groups": "sudo", "home": "/home/mlatimer", "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "move_home": false, "name": "mlatimer", "shell": "/bin/bash", "state": "present", "uid": 1221} 2021-11-18T10:14:39.639 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-18T10:14:39.704 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1222, "groups": "sudo", "home": "/home/shyamsundarr", "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "move_home": false, "name": "shyamsundarr", "shell": "/bin/bash", "state": "present", "uid": 1222} 2021-11-18T10:14:39.789 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-18T10:14:39.856 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1223, "groups": "sudo", "home": "/home/shuzhenyi", "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "move_home": false, "name": "shuzhenyi", "shell": "/bin/bash", "state": "present", "uid": 1223} 2021-11-18T10:14:39.963 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-18T10:14:40.029 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1224, "groups": "sudo", "home": "/home/mdipalma", "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "move_home": false, "name": "mdipalma", "shell": "/bin/bash", "state": "present", "uid": 1224} 2021-11-18T10:14:40.114 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-18T10:14:40.177 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1225, "groups": "sudo", "home": "/home/kchang", "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "move_home": false, "name": "kchang", "shell": "/bin/bash", "state": "present", "uid": 1225} 2021-11-18T10:14:40.262 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-18T10:14:40.336 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1226, "groups": "sudo", "home": "/home/vereddy", "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "move_home": false, "name": "vereddy", "shell": "/bin/bash", "state": "present", "uid": 1226} 2021-11-18T10:14:40.432 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-18T10:14:40.485 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1227, "groups": "sudo", "home": "/home/benhanokh", "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "move_home": false, "name": "benhanokh", "shell": "/bin/bash", "state": "present", "uid": 1227} 2021-11-18T10:14:40.592 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-18T10:14:40.646 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1228, "groups": "sudo", "home": "/home/jsalomon", "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "move_home": false, "name": "jsalomon", "shell": "/bin/bash", "state": "present", "uid": 1228} 2021-11-18T10:14:40.754 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-18T10:14:40.819 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1229, "groups": "sudo", "home": "/home/jolmomar", "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "move_home": false, "name": "jolmomar", "shell": "/bin/bash", "state": "present", "uid": 1229} 2021-11-18T10:14:40.904 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-11-18T10:14:40.968 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1231, "groups": "sudo", "home": "/home/julpark", "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "move_home": false, "name": "julpark", "shell": "/bin/bash", "state": "present", "uid": 1231} 2021-11-18T10:14:41.072 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-18T10:14:41.125 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1232, "groups": "sudo", "home": "/home/pdhange", "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "move_home": false, "name": "pdhange", "shell": "/bin/bash", "state": "present", "uid": 1232} 2021-11-18T10:14:41.221 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-18T10:14:41.285 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1233, "groups": "sudo", "home": "/home/dpivonka", "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "move_home": false, "name": "dpivonka", "shell": "/bin/bash", "state": "present", "uid": 1233} 2021-11-18T10:14:41.380 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-18T10:14:41.444 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1234, "groups": "sudo", "home": "/home/adking", "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "move_home": false, "name": "adking", "shell": "/bin/bash", "state": "present", "uid": 1234} 2021-11-18T10:14:41.538 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-18T10:14:41.602 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1235, "groups": "sudo", "home": "/home/amathuri", "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "move_home": false, "name": "amathuri", "shell": "/bin/bash", "state": "present", "uid": 1235} 2021-11-18T10:14:41.687 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-18T10:14:41.761 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1236, "groups": "sudo", "home": "/home/nizamial09", "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "move_home": false, "name": "nizamial09", "shell": "/bin/bash", "state": "present", "uid": 1236} 2021-11-18T10:14:41.845 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-18T10:14:41.909 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1237, "groups": "sudo", "home": "/home/dachary", "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "move_home": false, "name": "dachary", "shell": "/bin/bash", "state": "present", "uid": 1237} 2021-11-18T10:14:42.005 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1238, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 1238} 2021-11-18T10:14:42.069 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1238, "groups": "sudo", "home": "/home/amctagga", "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "move_home": false, "name": "amctagga", "shell": "/bin/bash", "state": "present", "uid": 1238} 2021-11-18T10:14:42.154 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1239, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 1239} 2021-11-18T10:14:42.228 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1239, "groups": "sudo", "home": "/home/kevinz", "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "move_home": false, "name": "kevinz", "shell": "/bin/bash", "state": "present", "uid": 1239} 2021-11-18T10:14:42.321 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1240, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 1240} 2021-11-18T10:14:42.376 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1240, "groups": "sudo", "home": "/home/liu-chunmei", "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "move_home": false, "name": "liu-chunmei", "shell": "/bin/bash", "state": "present", "uid": 1240} 2021-11-18T10:14:42.483 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1241, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 1241} 2021-11-18T10:14:42.535 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1241, "groups": "sudo", "home": "/home/cyx1231st", "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "move_home": false, "name": "cyx1231st", "shell": "/bin/bash", "state": "present", "uid": 1241} 2021-11-18T10:14:42.630 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1242, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 1242} 2021-11-18T10:14:42.686 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1242, "groups": "sudo", "home": "/home/sunnagar", "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "move_home": false, "name": "sunnagar", "shell": "/bin/bash", "state": "present", "uid": 1242} 2021-11-18T10:14:42.791 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1243, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 1243} 2021-11-18T10:14:42.845 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1243, "groups": "sudo", "home": "/home/lflores", "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "move_home": false, "name": "lflores", "shell": "/bin/bash", "state": "present", "uid": 1243} 2021-11-18T10:14:42.950 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1244, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 1244} 2021-11-18T10:14:42.994 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1244, "groups": "sudo", "home": "/home/jsawaya", "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "move_home": false, "name": "jsawaya", "shell": "/bin/bash", "state": "present", "uid": 1244} 2021-11-18T10:14:43.099 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1245, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 1245} 2021-11-18T10:14:43.152 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1245, "groups": "sudo", "home": "/home/markw8973240", "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "move_home": false, "name": "markw8973240", "shell": "/bin/bash", "state": "present", "uid": 1245} 2021-11-18T10:14:43.258 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1246, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 1246} 2021-11-18T10:14:43.301 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1246, "groups": "sudo", "home": "/home/luisrico", "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "move_home": false, "name": "luisrico", "shell": "/bin/bash", "state": "present", "uid": 1246} 2021-11-18T10:14:43.418 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1247, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 1247} 2021-11-18T10:14:43.461 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1247, "groups": "sudo", "home": "/home/matan", "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "move_home": false, "name": "matan", "shell": "/bin/bash", "state": "present", "uid": 1247} 2021-11-18T10:14:43.577 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1248, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 1248} 2021-11-18T10:14:43.620 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1248, "groups": "sudo", "home": "/home/ozeneva", "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "move_home": false, "name": "ozeneva", "shell": "/bin/bash", "state": "present", "uid": 1248} 2021-11-18T10:14:43.736 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1249, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 1249} 2021-11-18T10:14:43.769 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1249, "groups": "sudo", "home": "/home/sudhanaruna", "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "move_home": false, "name": "sudhanaruna", "shell": "/bin/bash", "state": "present", "uid": 1249} 2021-11-18T10:14:43.885 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1250, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 1250} 2021-11-18T10:14:43.928 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1250, "groups": "sudo", "home": "/home/zl31wang", "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "move_home": false, "name": "zl31wang", "shell": "/bin/bash", "state": "present", "uid": 1250} 2021-11-18T10:14:43.930 INFO:teuthology.task.ansible.out: 2021-11-18T10:14:44.046 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1251, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 1251} 2021-11-18T10:14:44.090 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1251, "groups": "sudo", "home": "/home/mayagilad", "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "move_home": false, "name": "mayagilad", "shell": "/bin/bash", "state": "present", "uid": 1251} 2021-11-18T10:14:44.205 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1252, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 1252} 2021-11-18T10:14:44.238 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1252, "groups": "sudo", "home": "/home/arjsharm", "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "move_home": false, "name": "arjsharm", "shell": "/bin/bash", "state": "present", "uid": 1252} 2021-11-18T10:14:44.363 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1253, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 1253} 2021-11-18T10:14:44.405 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1253, "groups": "sudo", "home": "/home/melissali", "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "move_home": false, "name": "melissali", "shell": "/bin/bash", "state": "present", "uid": 1253} 2021-11-18T10:14:45.791 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-11-18T10:14:45.973 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10102, "groups": "sudo", "home": "/home/ionutbalutoiu", "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "name": "ionutbalutoiu", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10102} 2021-11-18T10:14:47.536 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-11-18T10:14:47.704 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10103, "groups": "sudo", "home": "/home/pdiazbou", "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "name": "pdiazbou", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2021-11-18T10:14:48.832 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-11-18T10:14:49.158 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/xuwang", "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "name": "xuwang", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10104} 2021-11-18T10:14:50.170 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-11-18T10:14:50.505 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10105, "groups": "sudo", "home": "/home/blaine", "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "name": "blaine", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10105} 2021-11-18T10:14:51.480 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-11-18T10:14:51.634 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:51 +0000 (0:00:30.843) 0:00:37.718 ***** 2021-11-18T10:14:51.705 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-11-18T10:14:51.729 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:51 +0000 (0:00:00.094) 0:00:37.813 ***** 2021-11-18T10:14:51.822 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-11-18T10:14:51.824 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-18T10:14:51.826 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-18T10:14:51.828 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-18T10:14:51.829 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-18T10:14:51.831 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-18T10:14:51.832 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-18T10:14:51.835 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-18T10:14:51.837 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name 2021-11-18T10:14:51.837 INFO:teuthology.task.ansible.out:": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-18T10:14:51.839 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-18T10:14:51.840 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-11-18T10:14:51.842 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-18T10:14:51.844 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, { 2021-11-18T10:14:51.844 INFO:teuthology.task.ansible.out:"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-18T10:14:51.846 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-18T10:14:51.847 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-18T10:14:51.849 INFO:teuthology.task.ansible.out: TASK [Create all admin users with sudo access.] ******************************** changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10106, "groups": "sudo", "home": "/home/choffman", "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "name": "choffman", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10106} 2021-11-18T10:14:51.873 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:51 +0000 (0:00:00.144) 0:00:37.957 ***** 2021-11-18T10:14:51.993 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:51 +0000 (0:00:00.119) 0:00:38.076 ***** 2021-11-18T10:14:52.062 INFO:teuthology.task.ansible.out: TASK [Create all users without sudo access.] *********************************** 2021-11-18T10:14:52.086 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:52 +0000 (0:00:00.093) 0:00:38.170 ***** 2021-11-18T10:14:52.203 INFO:teuthology.task.ansible.out: TASK [Merge managed_users and managed_admin users] ***************************** 2021-11-18T10:14:52.206 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "jcaratzas", "ovpn": "jcaratza@desktop 2021-11-18T10:14:52.207 INFO:teuthology.task.ansible.out:QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265 2021-11-18T10:14:52.209 INFO:teuthology.task.ansible.out:c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed208 2021-11-18T10:14:52.211 INFO:teuthology.task.ansible.out:2caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": 2021-11-18T10:14:52.213 INFO:teuthology.task.ansible.out: "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d 2021-11-18T10:14:52.214 INFO:teuthology.task.ansible.out:3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKar 2021-11-18T10:14:52.215 INFO:teuthology.task.ansible.out:QTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZY 2021-11-18T10:14:52.217 INFO:teuthology.task.ansible.out:M7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 2021-11-18T10:14:52.218 INFO:teuthology.task.ansible.out:4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp" 2021-11-18T10:14:52.220 INFO:teuthology.task.ansible.out:, "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f36 2021-11-18T10:14:52.222 INFO:teuthology.task.ansible.out:24b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9Jje 2021-11-18T10:14:52.223 INFO:teuthology.task.ansible.out:nDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, {"name": "shyamsundarr", "ovpn": "shy 2021-11-18T10:14:52.225 INFO:teuthology.task.ansible.out:amsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf 2021-11-18T10:14:52.225 INFO:teuthology.task.ansible.out:55bd1221a3da3"}, {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a2 2021-11-18T10:14:52.227 INFO:teuthology.task.ansible.out:8ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, {"name": "zl31wang", "ovpn": "z 2021-11-18T10:14:52.229 INFO:teuthology.task.ansible.out:l31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}]}, "changed": false} 2021-11-18T10:14:52.254 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:52 +0000 (0:00:00.167) 0:00:38.338 ***** 2021-11-18T10:14:52.804 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-11-18T10:14:52.806 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-18T10:14:52.830 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:52 +0000 (0:00:00.575) 0:00:38.913 ***** 2021-11-18T10:14:52.970 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"after": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "attempts": 1, "before": "d72e06d3c78c8d9639a8ca75effa043ee468910f", "changed": false, "remote_url_changed": false} 2021-11-18T10:14:52.995 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:14:52 +0000 (0:00:00.164) 0:00:39.078 ***** 2021-11-18T10:14:53.111 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-11-18T10:14:53.113 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-18T10:14:53.269 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDdkebJGXKQWBG/7wZG334P+EAdC+5VNMrjLjXhaZZbt3V9vKDQCodcU3zSOjMa/GDGg2WHQdO/vioCc6O/m61KTbgLDaaPSzHH16j/e1SaU8BIgKKU42AUBJzpPeaZ2wCC1i12Hq8ULwjEW29IDsnMortzlCSQmaTKc3DN2nCXZWQXA1rSiQ2AhIq5WNJY9S36lsg5tkex4xUajyNW4vPubLtkSv+WrzNK7ZJ8zfzP6eJEJ+Uj7CLdanBCgwoLGSPfGA5c/gyUT7mHibOUwvFB5sFVsozMPp2PXzUUIv70adJpOskLYfKY7TUSuaB4AUOPu6NVauzVIl3Tsn+uvHqvtn8KC3BPpyH7+JiFQWEt+aO+/ynprfoqCjktuf07SXo0ewoVYT2S++JEBa/N2hKRkzIoSPJ+Rvoazc8GZIjXpQRyhMdTV/LCSeyUTJ7lDQVrQVhUIHKnMm+hZmf4tLQKZvNAThO984CpY93ST5Ww07fjRLMXNZGuaz+zHKNexhWSPKr+ggChnZCOLl/F6zbDnBZoCaHR6hH4+QLz0K/FAgxN2Nn00RiOFkmIlzEioxMcwC/peTl3WzRfqPINdTftiTzcFi/c2QmlHhnxsueIwNhHOn4frkGkFmexdDrXRStERzSBJ13X4kWduPmQsn+bx5/7xwqC6M4bXpkYFOefOw== aschoen@redhat.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2021-11-18T10:14:53.291 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-18T10:14:53.452 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2021-11-18T10:14:53.485 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-18T10:14:53.633 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2021-11-18T10:14:53.687 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-18T10:14:53.689 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-18T10:14:53.835 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZt 2021-11-18T10:14:53.837 INFO:teuthology.task.ansible.out:IEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoIm6sOytKwqNf9FSQn0Olu72ZRDjAYeNFQVWTn2PIB ed25519-hplaptop", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "validate_certs": true} 2021-11-18T10:14:53.857 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-18T10:14:54.007 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2021-11-18T10:14:54.060 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-18T10:14:54.062 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-18T10:14:54.197 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o 2021-11-18T10:14:54.199 INFO:teuthology.task.ansible.out:8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2021-11-18T10:14:54.240 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-18T10:14:54.376 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2021-11-18T10:14:54.420 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-18T10:14:54.550 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAV78mqEy/VkB2BthIE/m7iE5sbTjTRS0KuH7AB0KPvZBsDIw5cL8jKyxiaPC85+aOkBa4LrP0TUFBzN87Snt+PLMz2QHBOvlSTfUuRkHVo3vWJFzVuUSzzddkYds3hAxUriAHKv6CRSy1yFBxPQQHTSATUHKWqihMElbUCZrrrfH8A7J9vwixzCSLg4KbINjfa77rxefcZwugUqiYiVUWUSOb023f+QEaDm7OP+/uzz3SjF1Y0LMwa75yctttIfkRBKjY7uFCuZdKc3l2A/fdPxbFwlZmIox3LLngdTzHMVXGbVHqq9Ixo8FSAXiI1Buy2LTMoXMJwQYSvzsv7xNwujKVlUjoE9cOOIdzCC5AziwSiJB4+tNh73c5tRUzMMC98HLOhPJriSPvOt1pMEdWDX3/evcyxvRgJUKgYnmQG7n8v8O/CLyG0sAJDmGC3U9S/3fUDUjZIKWSsc85Q3xRaJwZJIS2VZwH0zG1Gmynih8PPq7VeDx7tKuNm4uTYT8= bigjust@desktop-jsho3l9.lan", "key_options": null, "keyfile": "/home/jcaratzas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcaratzas", "validate_certs": true} 2021-11-18T10:14:54.604 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-18T10:14:54.605 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:54.748 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2021-11-18T10:14:54.750 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:54.791 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-18T10:14:54.793 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-18T10:14:54.929 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uTfMorb 2021-11-18T10:14:54.931 INFO:teuthology.task.ansible.out:nuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2021-11-18T10:14:54.993 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-18T10:14:54.995 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-11-18T10:14:55.004 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:55.015 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:55.110 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvG6+jM8aulc5CID/yE6AXPXczxq8tMgY+2sdo/ihWpgDZuFwGL4hwj8nyh5cTqZ2LEa4kRkUUIoH9avLCFN5pDBVvcj1/O06ZGnkq/hV6791UiPF5S5RGmz3MGxv0RDfjA0OLFav7u1s+ZJ6z2W1Tpy/W+g/fMYqbPc6rV+pm3Uo16+BWz/diZH8smqcty4chnnCy6gqOrcAxCZLpeyjX6Ydn3fnTLTAmhoQ9eUz7LjP4ZnFD5zL6jrSBlJ5WNTLevUzvS8eL7RuP8D3Qfn8ukIzPXG2vs594FhSc/HnvubKricvKMm0P0ki4Z0vM9VruQn7Tbeqdwpi1IfgyiAMX aemerson@work-yubi\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAv8/FJn7hz2WieoQFUGXS0bhwSwL1LCI9kkjWYNkWb8IJPrBetlkr5TsvHEKDPZGF5Sv8LsYA6njPnbOGyAHpYlnv/Gz4Hwq3hLgmXCs6JGWBQv8NS+pjwnG6Nh6JfFI0ANeg652Rk9Qt9uLYeKVKmHXXrVZAD4NMvJGfEvneQzuwwpylUmV80WAdaQw/H0EP4NScZhNhknwAs/+KPFZH+RFoUj/Cb3poIFjwyviIgyal5hjAEsoczCW3hAla/9IyC2VDS027WPiPFmBFaYK5lYYLStBQdRx+6amH76XScLFy0FEPLL5qiN0ClAptvh1oIURgipdXZwaxpf06AXG8qw== aemerson@electric", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemers 2021-11-18T10:14:55.112 INFO:teuthology.task.ansible.out:on", "validate_certs": true} 2021-11-18T10:14:55.122 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:55.124 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:14:55.186 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-18T10:14:55.291 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2021-11-18T10:14:55.376 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-18T10:14:55.377 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-18T10:14:55.460 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+2vtSo 2021-11-18T10:14:55.461 INFO:teuthology.task.ansible.out:AWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2021-11-18T10:14:55.533 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-18T10:14:55.617 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2021-11-18T10:14:55.725 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-18T10:14:55.788 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "key": "ecdsa-sha2-nistp521 AAAAE2VjZHNhLXNoYTItbmlzdHA1MjEAAAAIbmlzdHA1MjEAAACFBAHT7CHaceRLB5mJv9SYKog1wBXsavzH3G3WCBEvVyK76JIslDudZm2ycJv66r+VlGaD8sFI5Mb/KKFMKcKesLRX+wHqZg9MlkoJgm7WGoRQ5I0M1Vt7TL3uJkVCaGZHtO7BXqzTx53C1AaJ1HN+DG2MGy5mm6tHwL901UVqG4EzjBnjxA== christinameno@boxtop", "key_options": null, "keyfile": "/home/cmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cmeno", "validate_certs": true} 2021-11-18T10:14:55.882 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-18T10:14:55.955 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2021-11-18T10:14:56.050 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-18T10:14:56.052 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-18T10:14:56.113 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1Z9C 2021-11-18T10:14:56.115 INFO:teuthology.task.ansible.out:kxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2021-11-18T10:14:56.228 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-18T10:14:56.230 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-18T10:14:56.293 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkRhoBYB 2021-11-18T10:14:56.295 INFO:teuthology.task.ansible.out:0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2021-11-18T10:14:56.404 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-18T10:14:56.511 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2021-11-18T10:14:56.586 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-18T10:14:56.694 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2021-11-18T10:14:56.769 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-18T10:14:56.772 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-18T10:14:56.880 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQ 2021-11-18T10:14:56.881 INFO:teuthology.task.ansible.out:v306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwmih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrSX8nDL2WaHe0b/rjE3TZhj5VwbrG6nn/hyWmm2dWcUqotSp973yD2G4tQL9UygeSkDGmjb6whrz2mcAFJ5P4oLtIcCLyZC550dcpwV3BtP/cMAIGE6xeEARKiP8KlVGFNDRg9/l1aAd08Bepe+rJyAYD7IxOOBfgKJMKbeOWnT40RTfwiD5CXNwjzQuhzZDEbm+8zjTChFM4P1EkfR3c+0X3MYpA1AsRQY0ElvFtcn6G0yPKR+obGdIs+ydGupKh1+peGWLemHMA5e62Bs4/Lwtyebyp7AOguC3ZBJ3TZWL4Vn1q6z21cQe6AuowjPrneZWC4ifFB6OUQJqM+R00pHBcajcvsfpYOblZvTJHM726Ek1vahOYfcbEMpqWlVYo+WPRUilzl5cI3ReyAcwphebqKPbhmzCuyJw3lWBKIVDhWjEFzGkxV/iFU5rIXFm/Z0JGNFFxmY1U4GlA4lFXtL7OvEdMsiZo1x0cNmFWLu0k9fQBtiQI19ZBiA7FPKc= yehuda@crestview", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2021-11-18T10:14:56.965 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-18T10:14:57.049 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2021-11-18T10:14:57.136 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-18T10:14:57.220 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2021-11-18T10:14:57.304 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-18T10:14:57.389 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2021-11-18T10:14:57.463 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-18T10:14:57.548 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2021-11-18T10:14:57.632 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-18T10:14:57.718 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2021-11-18T10:14:57.793 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-18T10:14:57.795 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-18T10:14:57.961 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-18T10:14:58.035 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2CfQvU 2021-11-18T10:14:58.037 INFO:teuthology.task.ansible.out:xUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2021-11-18T10:14:58.131 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-18T10:14:58.196 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2021-11-18T10:14:58.369 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2021-11-18T10:14:58.453 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-18T10:14:58.538 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2021-11-18T10:14:58.612 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-18T10:14:58.706 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2021-11-18T10:14:58.787 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-18T10:14:58.872 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-18T10:14:58.966 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-18T10:14:59.030 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2021-11-18T10:14:59.137 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-18T10:14:59.201 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIKepJjIovBTCkdVyvAdptljhw9bYcwtIqV/ojdbpeuJtxDo9UyrEkNoLeVpZgOcrbgrkOE7AEixo3qB9PbD8z5NRUleV7wipSh3QwrDmSylSVReJKOwYdxUKkzesZYBGIGYzAbTKqcVzPUWCeW314+xmv90XkO/+1vgbC5uoXfbfnaiDHQimBom8QV5Egr+EhhcuCqMEqaVSvjMr1T0e6IL9gUens6Mys6czI37go6QvmgEzkBbDJJ64PsiOOFHVNk4DJVJ1c7TRtsnpIHM1YVFjsH1AnAL6UufbgNSFf5dziUB/Bz815P1/jsOGpHkUKE37DbHU5xtLGl3MmimMt4ndcG6EggBGEYBwfEWPRAsZs3qngssrNH5W0CzbysLaoovzq5VqS8SdLMu5XrRLBEB0uWWzLq2bobYymk3t/oby5zrHJV78xAuLmldqjvlPZSdkgwWNv9YBLkteBVr2HhjtuashJ6amNPbA4kCGhXMpeRhfvfqs31CBEKbTV+A8ODWbWAoQxLCcqS24x0yMi73N0UzuqDTaJMcE8ODJvOxcLNaV688QDbrC/UehpX/Bp/DM7fLHj4YhkRpZxkkN5w2kb/bBbWya4DrffhHKqn9CH1z5ynj0237PhTwCXjtRn0JzpeRgN8OraFgR2H3uPc9XNqlkFxxOBK0lRngbxzw== owasserm@redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2021-11-18T10:14:59.306 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-18T10:14:59.308 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-18T10:14:59.360 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6AKY1O 2021-11-18T10:14:59.362 INFO:teuthology.task.ansible.out:MJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2021-11-18T10:14:59.466 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-18T10:14:59.468 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-18T10:14:59.529 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2RuqiZyKz 2021-11-18T10:14:59.531 INFO:teuthology.task.ansible.out:2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2021-11-18T10:14:59.644 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-18T10:14:59.708 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2021-11-18T10:14:59.823 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-18T10:14:59.876 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2021-11-18T10:14:59.992 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-18T10:15:00.024 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2021-11-18T10:15:00.150 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-18T10:15:00.152 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-18T10:15:00.193 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHO 2021-11-18T10:15:00.194 INFO:teuthology.task.ansible.out:RxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/yBwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-18T10:15:00.318 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-18T10:15:00.320 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-18T10:15:00.322 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-18T10:15:00.362 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+zmfjEf 2021-11-18T10:15:00.364 INFO:teuthology.task.ansible.out:dVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbBmS+dT 2021-11-18T10:15:00.366 INFO:teuthology.task.ansible.out:zNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2021-11-18T10:15:00.499 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-18T10:15:00.531 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2021-11-18T10:15:00.667 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-18T10:15:00.700 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2021-11-18T10:15:00.830 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-18T10:15:00.863 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2021-11-18T10:15:00.989 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-18T10:15:01.036 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2021-11-18T10:15:01.162 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-18T10:15:01.206 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2021-11-18T10:15:01.323 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-18T10:15:01.324 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-18T10:15:01.366 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC6NWn9EzQJoeXkUbaNclYcR9Gga7HFhhXMGxdo/9ypYwlEzQTA6FnEreG3s1EmlQ4hofuc0kMhrjh0YeJZMrETWMoA0SmoX+6iR26UWVtOTk7i1v2TqkTY7llmQneHqQgmZEBXK0jF1HVP5kHY5dhagtcpfsGY5dc0eGUjfqAyh/xrCxciOE/JQ03tDcKIc5eOQIqv46JqnUS90Zr/Cov2qGKKHTa/VO1a2viOmDC/uHi5xXvII1Kh9rHp1oZ2Wm3fiGgT8xZaTJFFhWpdq3AdKfkEaV93yQcCdaUsGBHwDHcPOhxpBZpqZvcCR3I/tigDav4QViB1PRN7JnTIWCIznfrQK3r2Frl6BVFDvydwgRVS43ctEKPOJj8ELMUWX+fpjsKrA9Kn7nUU35ti7qIWKg1Cnz3lzVA29TsEg10E+nT4SVKZtRSWw/2AX0bsfxfSY30yjw5PP+bjnVh/bOOkqR2UkPBj4eeOKMD8nV1an79xP0eH+t36INaJhq6qwxE= nojha@nojha-mac", "key_options": null, "keyfile": "/home/ 2021-11-18T10:15:01.368 INFO:teuthology.task.ansible.out:nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2021-11-18T10:15:01.492 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-18T10:15:01.535 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2021-11-18T10:15:01.661 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-18T10:15:01.695 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCnOq6OHTRJuv7n0GZygBue/AE2q47pFM3KyrvmZxPRNmwtXn2r3ngHQQyc6DLZdFIv9Yn0VWu1KB/ryCdN3Xy7HAxBfHdKjtQ4vvfsWUbQF2JjhEjrsl+usgpqK1Tz6yuL4uAtFgLTN9o6gcH2bsQ15w+rEHCiYVzaGp7Cj+y+/VPBRIEHETSUZxwqiDH57uFTHxJrBIn6yhCorbn5QOjfmHUGmkxl3Geph++LbuQeha5F/DHaylMulsYZZBDEhIG8G2coDmVz8Cp1gw0kBWv63JHKnXaJboGXty2Zj36O/wdZKTE+7cV6JhxfJczhZBTb2cImIhspGwdHfnFgBoXz myoungwon@fg2server", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2021-11-18T10:15:01.824 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-18T10:15:01.826 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-18T10:15:01.868 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "g 2021-11-18T10:15:01.870 INFO:teuthology.task.ansible.out:abrioux", "validate_certs": true} 2021-11-18T10:15:01.984 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-18T10:15:02.027 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2021-11-18T10:15:02.153 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-18T10:15:02.185 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2021-11-18T10:15:02.333 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-18T10:15:02.335 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-18T10:15:02.365 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS33Kkk 2021-11-18T10:15:02.367 INFO:teuthology.task.ansible.out:e6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2021-11-18T10:15:02.501 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-18T10:15:02.523 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2021-11-18T10:15:02.670 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-18T10:15:02.692 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2021-11-18T10:15:02.824 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-18T10:15:02.856 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2021-11-18T10:15:02.993 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-18T10:15:03.025 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2021-11-18T10:15:03.161 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-18T10:15:03.193 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2021-11-18T10:15:03.329 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-18T10:15:03.361 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2021-11-18T10:15:03.487 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-18T10:15:03.530 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2021-11-18T10:15:03.657 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-18T10:15:03.699 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2021-11-18T10:15:03.825 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-18T10:15:03.868 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2021-11-18T10:15:03.985 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-18T10:15:04.038 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2021-11-18T10:15:04.153 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-18T10:15:04.207 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2021-11-18T10:15:04.312 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-18T10:15:04.364 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2021-11-18T10:15:04.480 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-18T10:15:04.533 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2021-11-18T10:15:04.649 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-18T10:15:04.704 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2021-11-18T10:15:04.831 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-18T10:15:04.874 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDklgWHrL9TMaMxIyN9MxVR6nR3xh9zfj0iR63/yOzaslX0WoVBk7CYTsRlH2GFVctvixVwrWbQgMaKe49utal/3FA6sMl8S2DTrtgC1a/exUTvU0U/+ZhyUlkyjQfRgtYOUwodNupL5NsC8VZqZshgmgXC34uye3bplx3VwvpUt9r6QxJN3/9Dbi6HxudhDCLfmvROhwQYHaFF+GglcbyjAt3uvsuwXVKBd1/vMQwbcUo9/zQlrnmWBRuqTNkXGrZauWigoi/hyuWYQ3MUbRc3LVpJncMv7BEtcj8fCVvPB09SFee3nSeTtFkm01GvRcYd3HBz/YL4Rz92wXl9VIxqs8aaJBzy+MD0NO496Rfqtz6YuZ1m7AxDIccDW+OpcPgYwaUKFXNTuVLWZXhkS0p4swefcKWRlQFF3BLOebN/Kr9jq1MFa+5pX7Gj4WF5uCIX0/fx40KVZNhfl3qywBy/d5MKwXO7PCHMiGcu2FIXdZ334MxdgiIVoX54PpRP4hs= smanjara@localhost.localdomain", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2021-11-18T10:15:05.000 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-18T10:15:05.032 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2021-11-18T10:15:05.171 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-18T10:15:05.214 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2021-11-18T10:15:05.331 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-18T10:15:05.373 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDQu/CuhCIFVGCLbA0cjn+qqcwX12cRcFA1sHyJtkj6Ltfmge8FnfgAsex/LaPJwbtbBiVl9xRcazHNfBaDw5DxMRSJF+e7WTydZC2Jm4qIj4D3Lr+imGPrJTK+kjN0QXRXknGsNn36oRF/I41cGqYRGwawFGSPZBHuav+ehDk1doTrbDlll4zMUWm2iXTcBIcJo4NR1LoE2c9/MPfbH7jKm5ke7aS0ets+EANEplkeClfCVAashtIF+Bz6a9qk4F2n0baLT/s3IQkXCwwO2fxxY03x8gWiB1n4E7sousEB+J1Skl/z0bwmaiY0C+raPoV/FyZxQuh0ocvdU7fnQbKuNoGE/Usfm9Y3g8eH81b/k4fMJL2lqXHkPft6zUV9bJsp3v1iGEkIf2+ER/QLczteNz6kw/uTPQctMEDXM17GEnBXISVrQcPSW3i93eFwWacs8iT3G4bjEQvpxSBQrhDdCCoxy8bVWqkVeDWw5u2q/3WL9Ov1NrY+G4/DYb2qONNQds0vTHCGvemU5GNjtaeCbojkZ7Z3KOeAY8080kKrsO7fve+ZMACCIFD+se8kF7NN4ZJASSqq9lJpBWvtbc0O8jCcVGNuN7exXjrcbiN1L/9HkARV+KEJU3jbXObAhAnfAaeRWBwmTfZodCu+fDd/Jor6l36tjD4kC4/CPrDtyQ== alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2021-11-18T10:15:05.499 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-18T10:15:05.542 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2021-11-18T10:15:05.668 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-18T10:15:05.710 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2021-11-18T10:15:05.835 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-18T10:15:05.837 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-18T10:15:05.878 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDDp0xz0ml2XuoQe70TxVeTo3Ib5xMinDrYNJ5eq5XYNa8ZLGcEByeDK4myzixTloAo31Rb/yDyGqv6kQ6nFChihO2aab3Ni/bsMOaJat1scrznaIYXGvLvw5KYx/qBDUxb3qW0vO0N/bB3dUPS1l 2021-11-18T10:15:05.880 INFO:teuthology.task.ansible.out:XTJaVf+KuljUk7v38ov2gsPWlofRYZNkPGQfUKXFEXc39OVj+Ex5LkehH/Z1LwjRYJa7jAdSm8hE5m8m6WborrzAA4/iFuLbhtM/Bqm4boSqa7koBVux422QX/HblSQ2KAeT1GFOS7xdcO6ndyp6mIpCZWunTjZwSLyK20NvIV/AzdAro4GZWi0D34PPtbSG344ZT1dSLeDRhYVkDjS6uutrmw9C+Ns1bo8s1ydhxL2XEsU14SWRWlbyrMF9PXyJOsaNiBNWGwc9lTly0ZlmPnN3l0AC3RIKOstkEYmI+TMj21r1tltz48e+6dH1an51wwnhNRYiODd3hbS67tmIg05BuSU5+whJ93wzXw2rC4FLE= ylifshit@localhost.localdomain", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2021-11-18T10:15:05.999 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-18T10:15:06.041 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2021-11-18T10:15:06.156 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-18T10:15:06.198 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2021-11-18T10:15:06.323 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-18T10:15:06.366 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2021-11-18T10:15:06.482 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-18T10:15:06.484 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-18T10:15:06.524 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfbsmXq2 2021-11-18T10:15:06.526 INFO:teuthology.task.ansible.out:z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2021-11-18T10:15:06.649 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-18T10:15:06.692 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDj6DxTZNodVnwJZrnSZ/jv9Cw4uYLb8MGpccmOvtwl93sVBvqq597AYnBqYiV4VBbKU3GVFbT41zkplia1iCfXoddttCOyWmEKviBXRnAsd5f80dxL0pfzrBJvCaH4NAfYgVw9JFWsvT981b+nB6vum4Vz8Dw0PM5GPnVUjsZNFkpmDPUBL4yHPmMCGP2WtUurJVD3Gm9t72XlG6Dl/vB9Qw/i4IY1SoCCbuhhNgE7IN8JXeGmVJbRwDeUlP+Q8Ti7iedV7YB/W1opt6eT5EPzX8NcxTc0c7rrDgsUWjFQYRSup0GLK9ofdHs0E2RbPPO5OSc5Z2+B1IEV7fZeyJwAyHwUgwx7sSGy7aROdvinaj/hOBglcgISyQ2CY7LTV8NGWJquo7yRCJXhZVIHfgqfBcrgWdNbr+vNBXnWe5PCtLhV8ryHPSJ/7Ru+7voQxgvwux5SdZwxXTbWDKni1f6/8bNrhRx6bmLK9xuYAgt2FhlIivI7L5kQF4etcBiaf68= deepika@x1cabon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdqbYcbJYtgCrAbLo7PcS82caXxcT8cpX0RkULaFXfaiUDs8Foy6Yf/XoEHIdpgw8kX6qBdydYXxti6HFhYDNsL5KleKu/yA+bVKlvri39CRNkNxFHAUL2CRBT5Hefj1AJQBm/BKVEN4/eb05OlJJ808Qb/aNycot/YwgpNvUIaO2yTMA0meq82wNdZmUcmyLB9QXz4QInTcoAsxq70KxX95YC938rTWpbg1hM8gzLkJJt/OD/Z7TMYv/Sc5KGOFqo930AmObQ5KPmffkWGYbLT65TxlCULnvIr63lWHdGTj5mYjib/v9ncu24az9GYRWYcicV0B/def+KVrrIp3Mz ideepika@teuthology", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2021-11-18T10:15:06.807 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-18T10:15:06.865 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2021-11-18T10:15:06.972 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-18T10:15:07.024 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCrGYBGPDQqn+2jnxKhDurSrAJvTT8dZMYGVCt6NbjpFhDFYtyvrF8Jv5NKBQynG18LwscN7a57L0Oq0e4jOEPRz//CDcAfP+L6p45L4BdUzTysN4+rQ7waMnIiYp7VjSswhGH/BnYIVKwmDqzM2fo1w/oLIT6mgwUYqAdceeswAkXBt7jgagL8ox3E4oHBqER7f60AHdTviuW953t5luVQiMjyF2fOwZuo2ycufIzBee0CwS+xyRuJQwdgD3HL4Qs2vtBCX+H8n3wC6A9JrMA5tzCDr5VZKBJZURIniwvaXfJodjO4SvBL5jAfXoMqriv8ZWHbap2fk82YE8/uPqNvSISjixJEBgQinklZ+iAOYm5tfPbhPM/8ErpN/yJ0EoGRn+nj6X6nAjXAIk3AENopeqtM7mLZ26RFIuEV5ld7eqUvAfiy6Hk2LH9Q1Z4CXaxD0gDGzUxgdAaaAgLAR4btWi2n7Tb7ZNDdOfctg2ya9ftzZBOHvCaVXSpJCry/GMU= skoduri@localhost.localdomain", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2021-11-18T10:15:07.129 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-18T10:15:07.193 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2021-11-18T10:15:07.297 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-18T10:15:07.350 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2021-11-18T10:15:07.456 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-18T10:15:07.520 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2021-11-18T10:15:07.625 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-18T10:15:07.690 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2021-11-18T10:15:07.785 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-18T10:15:07.787 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-18T10:15:07.859 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDS3HkgHb6z+gi4tN5rBL/N+WLJgN8RtUokt0YnRjpor2epRbmqgmEFRbRFqjLK9LiTuLxmkwol1/G56AJms9ixue33M6jVs73nc259LDxn2qj/NCtxeU7xdjSDuhKyItgM0yuiFjWOKSYTghNtwoR26PX7SQVbycD4NN1ZuwUbdMQA31VrLvQR7d0lYKlis2auH2Xb6WifotoEyszZz1KYRwzJvOHtHku/jAyNmTD/8kAsuCjEgUPSyyehAfdWn59tY2gM7aFyj/dtRoAghekv5gkov9zx+zjN6D2LSN7e+DRti05iJMifA3nfmdj7f8aHzXDtsDL0XNkmmT3g9N2OQ8WL4ESOFASXPPj9JGUROealgnaQ+Y64evDClhbt2L7FLbgj5sgKb+XYhpGnAiC+v3t1Rq3HZrstOYf2qSYguIo+zW9gHwzJDqH5YNCpSF4ZDCfkJ94ngl5ptQmZ/FcrH2hBs2cMoyK9EyDpcI9hBeACTzu19kaB6DrOC+UTvBgYL2sNbCvi+caIqhENJICZ21rI4u4EZqu7PVb+Y3CLgSjTEgclGYBZoxlrT/X2QHrIfZF7lLGeeh0bureedCrBg4b61SL7ZU3Me9x1iWOZMSJgVvg+qPSrzZiHbA46k8i0af5Q+geL1BuuGy76zbYd/KR0KiNZnXjdlHyRz76rpQ== kamoltatsirivadhna@Ksirivad-MacBook-Pro.loca 2021-11-18T10:15:07.861 INFO:teuthology.task.ansible.out:l", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2021-11-18T10:15:07.944 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-18T10:15:08.019 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2021-11-18T10:15:08.113 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-18T10:15:08.176 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2021-11-18T10:15:08.275 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-18T10:15:08.338 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2021-11-18T10:15:08.433 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-18T10:15:08.508 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2021-11-18T10:15:08.604 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-18T10:15:08.672 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2021-11-18T10:15:08.777 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-18T10:15:08.841 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2021-11-18T10:15:08.937 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-18T10:15:08.939 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-18T10:15:09.011 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDISEXvGI2oJLTRR15ePZLkmdYjaQJxt9V/y 2021-11-18T10:15:09.013 INFO:teuthology.task.ansible.out:BwKdGqYvnPzmLOpdmVpdQJo7ZOWwdp5tJsCy4q5uX5vIUv6Gyi3uVSGmZnrKUbsqoDNwAX5vx/gFBINIs/ZXXyD4fpUT8aoZeq1XmXdIaWG0nImsrtRnRxKP9NGZEcW8z0WPwgF0Ck+RH0qZUix6Bfbgy7vMXnivuDv+NdjEwyszcrPWvf6Krr0am9Q0+9nj/mjvk6CZLl+CH3HNdkhZuNs+qMG4XW8KhLvQB2p790XVlTHuVU4jWrFmjymggZxkhoCY/ukHH6wi2Pbx6yjjKOj8iIw1xKabJzJ7S8UKT23A41d918DUCUuEG66pN6Z4dnv+fZJxj5iEo1GdycSWIc4SpLTK3z4zDZypVKIzjI4o8VwQaN48HkVjUdTICTvGQfytFi3jX1I5nxIZiiPcxMQLR5hQggP8pn2XtvXpomn0aBc8tVuuZJLVq4zCVnhlVB6IACmb71evjFGOsoSuEsaTufUr48= prsrivas@t480.lab.blr.redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2021-11-18T10:15:09.095 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-18T10:15:09.180 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDOJg56HsyNa5vHHb52G6O5vtv9I2tdlNMjFlG3SVCCu/bVZwVeGzp1ekuNGU10owmnIvhlSldMjLn2wwTwiDjbvYJVVCPvzK63vCUcMevRsvr9EyU16JdAgrmrGMyuYYEb+wh8XWI9Dc72o84fMaBYFSSer1S9nUBL+KVLVhIe7culgADimrDgDVh2t7u2JHBI0m0nKFGJZNcIyYf+GKOM+n7SaQXIYIytvSteU5BvUIKPsDd4z5lVlWiKO3kG6jF2RnKFV6KWBWI9m8YGItdGu25mXELXN9MOlApZF3AoGTmCE2Web7uDVGvO6rz6b+dc7RXTOlbWIhtMoRqQf6mz zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2021-11-18T10:15:09.264 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-18T10:15:09.340 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2021-11-18T10:15:09.425 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-18T10:15:09.510 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2mEyxfkW1u84u5BocLCAXESj2qObWkxUd20cmPolhJYlIWLOafa69Dw5A9CjFBp0U6Jx5d0JWcwmAc5ZeffQ7t7vzmtHCZnpKkyZhN9bu6vuCh4N+I643SI/K7tdbB2E8ZE6uI7ORMAan5+t0bNSVolUVq6X1w7dIA5El54K10WNdiwgRKW6e3anNbJ3rBLGEk7gawZqDDOqTvVQmOBGWek3BjSReDvg3rkmTQLxJkiKdxnx4/s7gzH1xTpsS/OludIuSxF0BK064ZcT1t09qcjnT4Os1inV2GfYswt+UhpgqrHqXjEs0Z3y4Oy77QBKL1rDf93CP4a4+eJjqXe+v tbechtold@suse.com", "key_options": null, "keyfile": "/home/toabctl/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "toabctl", "validate_certs": true} 2021-11-18T10:15:09.596 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-18T10:15:09.682 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCitWIN7jm5KEmB6jqcA+ufKRLodxkJ1GIdaaueCdeXdMHgWNH9FUDCUJk5dcA11MxQO15DRH/cdhb3QHPGiMv4XrBeK6HHYwGttzkcUEz1EDUhpowOrnFETbPa7K39ObmRcgdvoGXOSrNZ4mvptCTz9Xb0MF+Gcg5iJ4g+qZzIVa2/ueecYY8ZorbaH4m/NWUub6Rf01Q04HfxTvKrUFswrbCoE/Aigz/Oh88RiS854XoTvV7rE1tKbyKkaungwMAaQSNnZkq4hi8nbp6pzTxJLV7N/ZYMhVpdxSbWcghFg6cy7aeoCzZMN97WcDhpdfbhRT0dbqCkMmHV6t0usDDnOss2v68UCzkxuA1Hj4uy8rRHjXBtYqI6xsrwCjvmgP05B14TpmFdG+3GdRHx2+QlhnGj7nuPf1KoWW/f3tD85DXoEmVl6RJ4KTrMeEVlOn3kdMLVH0y2hIqPTYMP5cMVNi0EdfeoBdd9kxMKMvoSVBAgmLzGVv17o1lNvVS6V1kyt7gME2PfNR2Np+U1cJVJfUJRTm28mHXBVoDXG9s0zv8+LpQ/gVPS+vsPAfxWWYGW8ZmEV3ZorDOZycSPybjHkPFzDAdUhPG0Db0o+F9ug+22F7pvifsdDZ42zqGGLbyzfIQE3AtyI7LR7Sc5tpN9rKTeSBYJ0yNcDKEj5FUHDw== mfritch@suse.com", "key_options": null, "keyfile": "/home/mgfritch/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mgfritch", "validate_certs": true} 2021-11-18T10:15:09.758 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-18T10:15:09.852 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5bCXQ/B16AKl2oevC93R0U+3OrTyd3XEypouJy4LjIzXLX/Go1C1ViERwDAeHmqiUTqJUL+KZ0kMo8U7zlhNBk9PucbMZCqdqx5hkiCAo4y65lEXmuPGimRU2mK9TpcDTLWoyrD/EEhwzT6gmw3ytVTxi7qAb0tQUCQB+pW4+Zr5u6HZzgu9kLGxp7zsGtMA84Zqm5ql72mGuS0bUN1ajm8LWBetFuzOOW6YGfnKt29cLV2h1itVewA9DKM5G70B91eK4LjoNddCkqVA8L+v6LMQNU2pejUzPap98hmFUpQMNxlWQ0+B7UjfbkHWe+mIsSkdr3FfCfqWvsL0RiHcZ root@lxbceph0", "key_options": null, "keyfile": "/home/xiubli/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiubli", "validate_certs": true} 2021-11-18T10:15:09.915 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-18T10:15:10.009 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDT+6B5Fr99p8xe9Zo5x8ULcdeA6ne727iVJp/xaguGwGHj6AhuK+R/CjznnHk0yA+6kiblNzjvbnsuzO8T9c8Ayv5KU07MxP1y1pymdYBpEh3NTXmhB6QOTCNTQbT14PL6MVgzK17SqarFCYXoEGuyK9jaBdN9QM76vhEaXc/2Osg+d8boJTkOk7lOPHbzeOCbQU3d+jX0VFOgAQS5OFz3Ug/X7nB0D0LN8bt5FlCZiGO95Iwls/SyPDbVXc9ot8oh4ME7kd7sElokBdYdXPauibRxWKjSDn+hV6kZfSzqwnMFaZ1TC+Av6zNsBuZucNSp3/Ws3T5i9i+21eyS4+qVE8IiX2aVKYuC9afb2lPLbdG2Iy1CqiaeGPkZfiGT9P8iQPOkqae45859UzFAd/XzKjBcmus3lSArKG1EyZl03HQ5P2J60pErCXq8W9mPjxAze2ReLRXJVEgTXnmdhCptcg6PZ4d/k4BEddbdnoX6/BEgFxLEJ64HpTeTVcDXHpipCpxFSRvgyPH/wQGKAvt8AfKBhmeZs7LuyGOhJiOon4DDaShHpE9wTnJ5qlnyg44+u6NCwelGPMAkHKEO4OgcjSsyXm+HYUpxG2s4poloIJzvU6oa3dvJsMZFhcb8CsW75sBYE+YngS/1fg1WU88ZOdaa1yF4F87pVZycpZqY1w== jan@jfsuselaptop", "key_options": null, "keyfile": "/home/jafaj/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jafaj", "validate_certs": true} 2021-11-18T10:15:10.083 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-18T10:15:10.179 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo8wE/b2/EDwV018ENfcENVfXSF7vnXAwBSzNVScgxdqr2DVKTWDzhoI0m5CXTqI2HLnJVFDTgN3t5/fFcmwmSAP8ic8wU1JznSPZXN7qEQrcEsU/cwHeuzyutibg1ItTWWtoXYV8SFnVom8NF3UwXF8I+Vj6VF1EStWCcClgPjLbiOm8vIgaouXtbUIFv25GpadXyUtwiHEq1NKUPLgka8Usm8ibyS9hY9KmNWlD9AfmnwAImc8Urn2dErcsfAltxoGUHCI7ZBHGpzg+6dpynNR+giJMrjwWzREaCHmiJX3g6jmHuuY54eSOs6cxqi3E4jNHVWXPe/tEF3l0klEvl jschmid@suse.com", "key_options": null, "keyfile": "/home/jschmid/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jschmid", "validate_certs": true} 2021-11-18T10:15:10.254 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-18T10:15:10.339 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDnQfkkxYWLhMdoQ4RsZxWTXBpbzsssgeRfvV5q+n0mW60dxQ+9rjDXUTsRkmh45B5EhNWlKwyIUcQ5HpgJk6XQvYU6MPboWjriCTngmoUbwNIjOjyazkBbxfbwUiRDb+x1EyVm4Kt0rgj3nhqqxf3krqO2SlKgsVaY9b7+NTfshXb9T73/RRLtvwUOFkjp2B+w0SQs7Ka1GenmHSY/6xP25Mb8q9QW/2nuf1mV9rTd5l2ZHREzgG7gQFhjgUq3w6zCCfcCGwrPb4omqd9xiYLDw8l1vfQ7UPbuOqK1rFM67r7JQDG3yyJjCdWgRUI/ysbbXj0fyT+QOPZGK618V8yZPVlq5loQzYI39zAWZU9L9X9bkQCsJfjU5Yo9f/zOaecnWfUxC84NKpbG7k6XACdUIB9JGGtL6RPtgBU+k6Ts7EemIUCyMYm/GX+PYU3GnmmdqW9yBeyZoldwDCWLq05vjLXj+R3J2UrMl5x+fhP+KEFd1ZgNc7PV+CF35/ux8UE= kachau@localhost.localdomain", "key_options": null, "keyfile": "/home/kachau/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kachau", "validate_certs": true} 2021-11-18T10:15:10.413 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-18T10:15:10.518 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDQujcXnq9qOCmTWs44GwKOw48BxZGBmo9AeFk3KPRx33Cz5hS7UHPYvJy03KdoMySgxJtuxsOSvjJSPxpXesTtArO5giW8RLyuVsu9q5j/GhPKyABttuGQyexiRokrHQFLVifzgqwsUARwHarWH16Oa1n6fZPFNqSH56c872zS4Pwqgkzx99NKRWh/B+fIk8VmDzzP1qvQAnUXDeTeTOzapAL+8fSNTp3QnhmZbvCHYwUxfSqJyzq1wBL+517WrvzvX7yCY9B0wzm72sIO4daV6UDyAL1B72QpB04vEZZ/skwS/0jmokfBn43HHCMPy/Mxywfi54alFJzIu4pti30V kravishankar@localhost.localdomain", "key_options": null, "keyfile": "/home/khiremat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "khiremat", "validate_certs": true} 2021-11-18T10:15:10.571 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-18T10:15:10.676 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCoqsDnRqAeNPi5xiIfFl2i2zqcwLTvcAso3R9+QAfSChw4+wcQzmMV8uQz1jt8UReefg2QL6bwvcQPj5Zw7ADqUjfxm1K0ezgH6RrtHgRZ1SVseTvJUvzmkDZ2gr2ToZAJYsaV7gBLJLZ7TOiQ6jzrtitiKqJZdpZfzadjShecY1TdMo8bSS7XfbRcwri40u82TRM825B4L//QuhMI7akPqa3iJbGEAQPhkGLI3kz19ryVG1UwvAkkt7TQ68zz+piXSmB2CMRti51shT4NuAOq6Qe9y2Obicf88ItkYxvySMQ5jWi2bo7Zhwuq9jUH8lK6I6PHrYc8LOsR9gE/hqkXxTQrkOXEDtHN1mr/KKLrXO0GeBdgh8Gj4gcwgd1RUCE+T9q09WO9j7c0piWK9Fs1+q1FjH06/AfmP4qob1TlJMHhtPyOp+lk2XvABP+sqW4vyrgmXu5vJU+Hgq3X9KE7bKh4WkCem24Np4uA+irhpvZmIoHyINsYW46lGfwJvM8= kapandya@localhost.localdomain", "key_options": null, "keyfile": "/home/kapandya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kapandya", "validate_certs": true} 2021-11-18T10:15:10.740 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-18T10:15:10.845 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNEEz49M5KdLcp0cbKrE9iihrH5PEhsPgnAxac+aQwvnTstOOlUOyR+TvHiRa7sgXHuFX/UXo+k3Qmhs5U/sMZWZmmN3Jb3fKT78lSBbGnByclfPoGVTTLOHxwo+RFE79Sp3e30oshJ3DwqYgiX6JjM8B2Y7d5Tv0Ss5uEZswvmCEjdTLDSsoxrsOjVxBpuArOfCxes8PnKDdq21mWldpP66iwFel2GgOGSc85iVHKcOE2OpVMazMzXoMSMFoOpCULKjFfXBuDIqkXwJmtLJaiCgcVmTR56KXh7JpZ7vAeJ9ttv9qgOckqKdI3jEjeDT+TrdLlRWghBE7FRkm0vmun prasad.krishnan@macprasad", "key_options": null, "keyfile": "/home/prasad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prasad", "validate_certs": true} 2021-11-18T10:15:10.904 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-18T10:15:11.020 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCu9CW99ySPXSKQpLbefu1A0KqbUQIzvUOJizIu4azEgdlOqUnOMR/GC6jgOdiVL5mNb/U5bg7yQuEHgPAtmPRotvbI6/FSwIAR9+GgiuKSOJCa4s7QzWbHwv9g7wS2SLURw8UERSzlLlT8KQyGj+GkBhToWp4PTXC7te61c8XJNGF6giLmIAky4SH8uPI1zeLwwviJQomjFWZZ1RTbcRJxvGPjPtuUKDlF7QgXTLE9ZgsNopusC6PfRd7N8Udkl2OYPAzA+Jun0IRnQyjRXG3c2sYXQR8YYGICsxvnm4l81vKdxRL34K7LqBUHQXUcoCjJy7+/2/1dca/AMHgi4sZwgeYQ/U9jZg5jbm7o4MpDUFsS8W6OO/ZPiuYTswGBNRXhPmbGFnfa9dBXBS0p+buHF8PcTSLH0Dp2nhHkK1ehGmBFVPw6nPj3wXA9BKuNc+g7AiNUyRKyCWroFJ0VwUQGbI6ZMccO2cI7QpYmIqPCl3am/vUSNq4j0m/iURR7+t0= vikhyat@redhat", "key_options": null, "keyfile": "/home/vikhyat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vikhyat", "validate_certs": true} 2021-11-18T10:15:11.084 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-18T10:15:11.189 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCipD0d1tI/Cff3AeOZTQ9eb6pZ/NOCAOw7MZG/JgpCs8+T3WqiUEYefsb2PuSa85vV2GC7kq0M9ux7+U+vZZf05geYiU2S9eTucLEu2+YE+RaAvIK+ZB134/33JSPGIVubXgGWZw/ZFCEYXmYk3kyEg1YDIk/BEaoG7PsDiSB4j0W7/WiV2bEEdSlTXt5C1/kH0qn4H9wQMiBSpdMgdaRWw60HjObDd6LASeUVgabbyclypravZdpYBnits4ayoN8VG1aZe4Qhm1SzP/CfxAAYfxo9NbqSBWJmn3iSN8UKHhCFrRCTaYic3z3usr8784VsA7z/LxK0fs6xjhoxRTa3 shraddha.agrawal000@gmail.com", "key_options": null, "keyfile": "/home/shraddhaag/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shraddhaag", "validate_certs": true} 2021-11-18T10:15:11.242 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-18T10:15:11.348 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpE5V9JG1WhkHSYqjqaijBb1MLyjcKQlmj5WQ8w5832n6x9J4yDO8wI4qmiX3XeiXPlmW6XjAq5keyukrQe/yVI6NDXzgRxaHDmNj1AR73gyUVqRXpJprrqqsnLHawIRovrBD/HNhTv/2G8xG3BHakac1+qj7tZe4Jjx0aG1HbRhhJ5Q98EgvTkDAhktnlvF9OXXC1WI7QirHx0pRHa40SYyFLfOQDbQSCzb1TAAY5NGn3SwK3s2mWeoEsAJpCLrkNfSTbR3Z0mylAJUn+PayqhJegjwKmLaONjx8ZHXN970JHgojBBGOD30J/NnJQ7N6eRl+ekjpHmLAYGbe2oCwD gkyratsas@suse.com", "key_options": null, "keyfile": "/home/gkyratsas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gkyratsas", "validate_certs": true} 2021-11-18T10:15:11.401 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-18T10:15:11.517 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC9sZe9p48s6RSpluK1R97X9tsN3tWiidPbdyXvyMUXifYQb3nth9wMWUakrVBp+QGEkqALLIf3so3MfgbRvYexzNfHvRT7Lxn8D/isiCpWa4aLM/0alprV+RI38dR0mI3IVb3aIEYmgp2IY4yzybWTHCmS1VUrUJJ0pOfXOssq0xgo3qeaSQBHYRKasqR8GWAD5MWpG6/kg6gxI7o0aHVVTXy5ADB7NS1LEZr06xxNm4exeYvl9TzXrbGZWf2gC8ZpXhmFHI80A+TKEZRU6wmcju7G69nyEEF8/ebcBKmZB4eTsDN7qR7lc9dxKxiiZcJXc/MWy4bSu69NhOeuq2xx7bdexS8OHKdgYH9gsJolu5zgN20IHzaRgswO3XIe3nh2Ud8wntwBCwmJ9bf5YByITGjpOhntkvWAP3AXkQ1B4HXCdlUNW+4pMexDe2D05LHOwxcS8RVIH6ELu8rWe/QBA+DFcyZz4xE55pbfVt3FCEFrAxUn5qkyzszwPMjtK4XAnn9kmnw2B0k6XLZOZd+n7W8ege6wih+gwfDhYMZX0qzi3HdAK7nk5vEOFibCztLaogzfc6fdFRx8OIWJQXqx5I1641FU3UE6sVxku4IMDTq2GVyUWKdSN6y8gBiDPVe3xu4qM4xghSnaAmfB45IrcNvibBjikNva2FHt8lcutQ== prateek@prateek-Dell", "key_options": null, "keyfile": "/home/prateek/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prateek", "validate_certs": true} 2021-11-18T10:15:11.570 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-18T10:15:11.675 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFmmTp8+YDXU27xnSPxhWwouslpkvp1eULVp63taoXceDOnH8EMWv0wiEjN/P+Fcf/UB+iU8bELyHubZiqnOUr9f2pGX4jkJ6Yty1p5BUK4my7Si5J0/JawEDVQm4HpFWMKUVKYumvz3UFuBoINHVTqr1cLIDAt7mdeKfJqFB45AqxDUIPP4d8iznNCw+QO2CMxk0o/wMNHbygZZrHAiDngXQxwhe6oR17RfolhREy0JjHgojRjxgagpG7O8WW3OPI5Outnz5Pvraas5q7w+b3xbB9vdTObW/Nii5VOpTdIsFzBvp46hLoRSIcB8pRLUrxPJBPOY7G0zbopDRLB2zLNGKIH2zxEHJOeY928uUbWT22b9mGu/L95FFY7hmeRAicCUeixMTgXgczeQlHDn5eqQzLI3PNP7JX/0dauCD27GRKsDUnpIDj9RqgCQDVueIQQMC6QMa9dYQmps0r9Ljp8R84WjYFRP9oOI+POOzbgmRO0JCVnPqz9MKyGVby9/WFBHcvG6xmwACez00oqe62z+rhcavGXViX5CxGMV6vUTXugBa4ZkXlzs+djzYWfZ33ZKVeRIwj2Pu1PRTGzB8e2BaKqJMN0FVtzpV4hom4Y/9vIPyDpjRjNuKzrkYW1M8PxBxn+EJUPMLhr3jFMCo6HSxHoFXy8BzZoFkZWqap3w== JCL@IT-MINI-JCL.local", "key_options": null, "keyfile": "/home/jelopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jelopez", "validate_certs": true} 2021-11-18T10:15:11.740 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-18T10:15:11.845 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdbJDYY43Zu0EKAGgrSKEobyXIxdhT0AeTT3yBoNY+YdYDScimJsQzK4hKNJIn1xC3klr0dSnsqeJru+SA4GMhbdcsmVyudhutCw75R/vFoRHOwaeVS2SMiBAtDbAYGQ3dh6LapkmXeLURcycNbebUV4HM9XsYqnuL8J2XyY4tRKgHrAd6OQw4jsXDOxwTRlHM822N/2kgv8iEwiXAJoUoymbr8mnfSxuuaH0oiKBwuaK1wuaDrlJyXkXNslPq89/1f8hJfjixY2dQdW7Xk5m3t5ptQxWENpw79OMRJ4cDW4G7LrtFONom5KQ+9TBZJIhNgJobkqI4qwinrWF8qMW5 dcain@fullsteam", "key_options": null, "keyfile": "/home/dcain/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dcain", "validate_certs": true} 2021-11-18T10:15:11.899 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-18T10:15:12.007 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDs2+6XwRPdiDHT+63Yab00VBulg96/OLEORtNUvm7TDRMpcx4OD2oOnbsE4rG3dOdXNgT17H15c6MWFX2a2uC2h1j4hJTa+dG567HrYXRHG60Kwg5Sviiuq/ETPoH/r3OSvHs0HJ4Y9qYPQ5j0k7gG1XgIY3QHDWNRsXiyRXP9FEfoaOKABDTUoLPjqRX+4ExJd1Nz6DLxqIlre8wfqF5L1l12vec8JU3HB5NSRa87HxKFtLLIAtw7B9H/HggqX5wWVEnXq2qN4o6OOePhaO5cjWAZxOtT+AJTyHkeyaWLwIGOHBVZS5BKti6jLc+PxQxAflYlu9X3xh/2FlA+9H+ABZwMHE3ruUfTVbviYBbtccMCvkzcvFgnvaUCHjd7Iv/T8/JHNfBgFgigcX0Vei0+PZQ5oC5b7YpKT241NA8DCGZNgr1KuL9LazkvbkbpDcaHUOrkWsmSW1RRMC6ffYkbAI9QiBJFpImDAWP1u+1yCGhzPKBfGNt91GcLCD6ML90= sunny@devBox", "key_options": null, "keyfile": "/home/sunny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunny", "validate_certs": true} 2021-11-18T10:15:12.070 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-18T10:15:12.072 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-18T10:15:12.175 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4pIcNiZKVIfT9GxyTe/B8G2GyHKxrAle3iExEzLH5bBCKtBrottX1y66KBzQSsrAb0z9h+A+uxlswlY6VM/gNos9VRB6x4NRB4ADY1Bku+JsKs5aXwRB1zz2ueZhrFN9hJwMl1heLICx85ksHBdm0q+JPdUAV+/LBdr0H/IjWveV34WL3Awf7QikzyKhzUciMB2gN9PJXTW0bl8PP56y60ys++L3nMSRJ+15uPcWl8MS3D2vABII0Tu+3PsxzrTTNodElyQ6G/fwyFfWhdp7fkidjR7mDDx8NyWfCl2rKejXv9LnVC0wb3tFoQqvwdz6shN4E51EIEGXHcLUeRpBhL2pFOqIZ0qfnmLIQVZ88RKMTgo42CgtmS5UzxCLOyKOh9GxF7DDEajTinJFJJVbNJ5xF494H2geSnmP1o1AecGsGbCZ4ndhS9unSfIZLAyv1J3wZlAlMsvxXgY7yrh1srUiASVyKK8jba1IT+v3TXR8kQUCNsLKKbvuX/l0IXME= xuxuehan@bogon\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBd4eSizc2zAkWDy3mFZUhELO2wXDgkVxDNM/Nw2zT1li3L+6YOjFfdT4NOxpkg5laLd54bdKb5GVRA6iKqAO+aqo53xHHJGC8OY5eJaUPjtpypgIWO4Qzbos2ZzsC+nX5jvi8O9nM+JkabSW5iFv3gGPTqHixFYkxK2NIBa/UtXFOhmb1wZ6CG5Q+WObCosBUEMWokC8ntCADfhi6qDsO2fol6mYUhYEE/0nhQ5uLRrVIM5QM5dhrQVEeAs4KcYpmPDw6q6AKgx/f5zObh5OSJFTVsgx2cqzdQVJVDDx2OD2QVRtZ9fgvI2EGmKSwe1TUQOdqa5bmsVIp2Jfi8MC1 xuxuehan@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCwIokXSvPYP3TRlSw0SBgmMFW5jVltGf4c6CqjIW4KKCgsL4c4Vs0FztRyDGc9p0krZUoGJCZHErVToXm6/lSq8JlfrlLX4X4yh37fUifWqc2UTJGeH8kLaP3WEt9vT8eQ9h8t2GqlMlGQU8KzVAdC+c5IwrbGRsS6S7D09/y0rklkhdJ6nuj8cssN/2TzLF9YIvVcFZHdyznk84eB7TgpPKD88MOpTnEgWFlD4vAWEuHpkuxgj1KI9LscgSFcW9/RxLeRxcV0GypZ8jPmczoCnin/ZOstCTpbcmjLd 2021-11-18T10:15:12.177 INFO:teuthology.task.ansible.out:+LW1kgGXXQSkf09iHeJ/cyCw6ooZOkynVwwmI9Uz2ZaMedCUBpG0bKclIerJ9jn+CoTs3U3Orhd9+6MVtCHX9VNJbVa4q0KCS1sp5S3HDrYkgUyawUxdYorrLZcqfRHWWo1luiridmuQdr8lQ6dvNpz4rhsCrAG6S1eeaC/s+o0Rzpv1YxU64JzquZ6WNR+W3U6Bg3iYkSoDCK9byf0rsptyL8= luqixi@luqixideMacBook-Air.local", "key_options": null, "keyfile": "/home/xuxuehan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuxuehan", "validate_certs": true} 2021-11-18T10:15:12.228 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-18T10:15:12.335 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDMOuxxTZyxz/TEVA+ODgtLrNcSsUhKE64BZg/Ub96LLffQXQc9SYT/0YI4wxu2vSsky05PnVSON7jqGxunCt0+AdRqxXhW4ttmRIOz8rq8SiMnnLayV34nIF1G0aYTkgY4ej4+VmSVIHU3bb5mp/Q3D0hxQwDPdgOJWNyW9oYerHbnx6lVgchvsZHB9VO09GNHcAsyUz4p+xBf9iR7eS74p4dZmUbth/oBBqpOa4NgNr69iyZ9a/pNDLxaVQoIpDFrevk5UU5nUHQq2frFNxF/Y2Ja1EBXCavvPF/m5v3J3xNEu3SI/GbLFCPKCKeBDpXJbe1QqTBKJjMl9qGmKEJ3 aclewett@mac", "key_options": null, "keyfile": "/home/aclewett/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aclewett", "validate_certs": true} 2021-11-18T10:15:12.389 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-18T10:15:12.505 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCdTLDprr3DXtsgiqrB/miglJwSkY7BAv+OW9sC0ZHQf8Y4dFoUtr7q9fd6W7ehKL6aMjya/8eQSMPRoEIZFD8f2KPCuE74Wgwgv2cpAkFmLjcPtjixqLo3LGFCyEJWGLQxjlthdzx59mpCWgBsEJQmlKP36JIYjILIMtXtsETIUGFa8QPIn9sMdIgutPPf3yB/6DHcR7C6yIAuvbJactEsiCt4C8+uJinvCii3PzYOMAEd+mictPGk8nOCQFZrI+ZmwTz4UbJylxFqnX8lhhoPIUEfNAXlb3lkZWH1LaFOxarbmupuPYcg2rT0+kFtyNr3/mAx0FO01jADYooqcW1Z cardno:000604936806", "key_options": null, "keyfile": "/home/cblum/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cblum", "validate_certs": true} 2021-11-18T10:15:12.558 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-18T10:15:12.673 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDPUCIVfNQOOG+uAeKWo7tLAdgGO/oQu4exTE3XLfyTVdd8u6pbQCmIDFEnbGgMtlYuWJlCJtxJIzEZJ5HIwf+po3y7kb7HxEeWnEb9DsqJB4nCRE8fHnNLgF3bh9gvE7sOZdNXEKqtsnGcaaS81oXQ6QgkFGQzlOBOqxj7jIvad7AtNWD3WbJi/uTVDsWcukU51tn/aEW+hHMD7Y5QJkLH7O0PrCeEZCUCWoiMP7sNwACBym0DsqX+POkGJOaGx9EeNhGVA4B6o3xYXJPqmFbgMWMfG3/Y3SiheZjxzySMQ7FKW4Q817NaWqbjtLZQsSZw7JNqNFkcdTzVZwwCOJ1AAecajpniKeQLnyiWQ3Z/EkSGGwtDj67wo7uqT85tpOyLfYhQm6Zp+xSh+I6s0YJ0xO/huLKzeT5D1r5vVMk2VdcLD3CCxXUwZgaMUxYAC2Wq6mpIkxVZFQLbGuA/dWkQbFsrpbf7ES+kh+uzp4R6dQ29OjXbVcSfF2vyIuA+VUKoyj370YOZQhs50yuAJ4BSHlEgoJdRzi3XUX48h45XHiZcCY3X8LTX6a+0KAIgqeAWdFhRgQtAxoRYjhOxC3k/boBc8sEQ3o4pkxnhtE5Y/tnM2CPkPMX9HWYirNf9GyZTYcR/5rDf4ETQ18G68WLaNK758OuUPjSkwttcyLd4dw== mlatimer@suse.com", "key_options": null, "keyfile": "/home/mlatimer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mlatimer", "validate_certs": true} 2021-11-18T10:15:12.716 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-18T10:15:12.832 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYh28a9R3a7jpRfPqVAL9EcD+S6KkZzKTfCmRn4s8Fg39kUZsgnWUZQ3jUxKSeBA00te7WMR8CsIEzulm7f+/egNuPcvzNI/SaaCDtVMaxqlEuW85ll8uBQi3s4SLmOu9oS+5oid4cqTrGTcG6uhl29oWS/53SxoGh+T+y6GesO2cYRuTpcUHxGMvIgZe/bKtVGdP1y7rQd62e8emb9UupMBxaHpkYj9AaMuLjovHbBgecWbe4PlzPWNzl+eITVk2d6CxxIem4/bw9VHkRjQZlhL2nbwRgtczLYhlaZAd4ePEtsqA+7nTDjTDhXXHVIf1pDAsJbZEdgQCSGH3FzxtrQ2hZJrH/NIKdHk/OtI06e7POSGj7PcHzTvMjQSFnTpJXinxwzn0lvFSlmABN/00lIE0p2ZXfPs6dgWJ17JnTq6dMUoTiGhfKphPHyfSXJCzfa2VB+lQQ5eAaa9cRXy9pLmWGHXVGz2hsBMtyYmTjR/wr8kdTzeK+Jk4opBtGgcxDustg59b9x/jvgoc3HCdtnkqLTug2KmutB6kb+4KnVO07GsSp0RmNtDmCRcXs9YN/eia9ICtIGDWPc3YDRppsw1Vktza/+ZW5vGzIKILZTo4SNGcg19zQw4Qxd9eLkXfB66vE2CQvA90CGo7mcye+UWjjXLr7i0cDEszAloQ9aQ== srangana@redhat.com", "key_options": null, "keyfile": "/home/shyamsundarr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyamsundarr", "validate_certs": true} 2021-11-18T10:15:12.885 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-18T10:15:12.990 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRZyOnj6D9tCw5o4+ujpos5Uj1O0XVvea798DsXPRh8bEE1pLkARQJLv4iW6LsG3x/CXruahmwT+6C/VHppIsbgtpadMWdCTPYrsjctPK0/N9nr4kQEL6XeK3/GHFnwqYcc+LySpNNfbKrgN4qWOwdZBhQjSV7K7FJd4ZYSm4wp6TVbvKKp7o+JdeM2zhstfC9AcCtBv/TpxixFFq/+y8/Z0PwqN1YyHduDOr1dr1DWn4ZzrkhiTYfPOltx0jweD6zTJoTAJDqae7kBA+3XH3dUGX3n7Tchsa3bnIKVz9sLQvH/vPro61I+Xig6MQh77JsylNvpwb1LLOEzDf7dxl bigwhite@wrjj37deMacBook-Pro-2.local", "key_options": null, "keyfile": "/home/shuzhenyi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shuzhenyi", "validate_certs": true} 2021-11-18T10:15:13.054 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-18T10:15:13.158 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEcI3X9mNxtHRSvi2gVFavu21kRCWDd1erXW3d/1zWnoUvRxe9ft2xA1c3Bmo067GqhFudPcXoYJvz3atAGR9k3n1UTtTJe95XRZ1Zmn/boi6mn7I2oRVFpW/KjxaiM3iN2SHKknMtcs6qRTioapYCU7u924oc0izqPBvkrC73cfVF4emH1ERWEcQBTxWub6N6Mn3xaDmJ5xnGlNvDY70CC9osoa2VRNJM7GU9eUQClHirPbSooDvvVKfTGD7YfMH76j6PdDR/a/cgNeiMevtMbeFGhu1SOEHb1ihCNoGq2vQFPPWwwTCzMI05XuUEc4iaxw/kbGBMpWbmIvswIMQrRwgwLZk67GGpf/dEeutI6WseeNKNuHnTzzx43AW9G2coGq0RKE7OuA5Cqj0CO7Kcf5UA4AqIIroLETVBrrEV6qzpkD74QBZXPl7gbSZIyxLpvtQoMfSSzN+Mj184LmQoURCqIT+yM5gddF5/S5I+rpw81vBj5M9ZskyzVQAo0H8= michelledipalma@mdipalma-mac", "key_options": null, "keyfile": "/home/mdipalma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mdipalma", "validate_certs": true} 2021-11-18T10:15:13.212 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-18T10:15:13.317 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+tqgRGdlbb7NMefZVPCtbzVZBapxmmPcKaUtqT7E/9AKRoHuroZQ7KJQfO15POpIfEja7BugBt5F95aW2Bd9/xhulzC4/JjiZYc6ST5Na03BrcudI3YcktoGR8Mm7ZVzSojvm0SKtLLHM5Su17JpCC7BitMdao1mETlUOklEXc6pgbr9XHOayo1zeuos8DB90iA8TQ2soR/POD1Rix4GKniCHXz10+iXQFYPsif1HsQ3rh8Vi1M0cTq98bMSmfsKODil8KIxf+lvLCL4GAgDYEyxnstiTFh5GAcIMOOo2dl1fDb/Oa981CxWU+xxJD+M7AEJVeyAqqAnShvZU6y1L kiefer@kiefer-uchi", "key_options": null, "keyfile": "/home/kchang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchang", "validate_certs": true} 2021-11-18T10:15:13.370 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-18T10:15:13.485 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDjj3bbbLvd4IHeFrSJyM9N6uKXA7ElQrzfcisKRGjUPON8IsAWkXQeAnHoBsIQv7tRGudXOrK+tbfv7crLI0/CxL+o0cCVW8bxuTEtdz07ZFsND9cppCc7Yq+wHsg7nQ/n0QfxnlYc0T9pATXUoT+aW4c3NQoDbsupLSkNs1C+G/MEBzz6iH6tgrv43OAOUccfQbC+IYx4RIKL5MteEjVrZanNELIG+jsYe+CZLdsONk1nR8+xKQw19Sm/jkKdl1K9NXoVPEBQmFXrYl6G+7tCdWeU3Vq24lM1X5p1mVspcG6FyyctcuP/8+zhL2L208DrXlOVPcqHR/4FEf3Wmk89 vereddy@vereddy.remote.csb", "key_options": null, "keyfile": "/home/vereddy/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vereddy", "validate_certs": true} 2021-11-18T10:15:13.539 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-18T10:15:13.656 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC+EkUbnaeC7Dqtq2N4/dX9v+WGlrgRS2ygHhlbZy4KHbd6+Q9T5NAWtqnFwqcbFpYYUBwMvz8zLo6HYN6gNskRN0qTiFKPQdtnydF0Tx1KHrdGGcX3G2lxyGH5P8nrqReXAPPvRiVc2/Mj7APCTmY2JftkSS1qYcTleeueivVyho6z6uD1AyC7OXANhtn7kGeIY/NvVKBhDr+3TuPmpPwPCQMcJUyZWCHYyp47v2vzNBy2Etp7WjGwOnfZ5ULiJGjH6PCXx0YfpmTUOPVkNbV6Om+0YJ3fcLlmQ/2nsdsWfOKvoAr+1uzO81h7ZBX9LVEitj8YU3WeSCV2vqS2VvOpq5NyHXWGq+ZkOCfhy4Z9MvMG+6hqp4p4z1JMpKsZ191kP7eAQua41GkTSQPlEfF+um1UV6ZjNzhB68utOXyGDoDcxct9oOdnhhjwu5W4/0t9iBHuMn02iHRYVrUWOH2FXVysR0p5x/L2xdvNPiTgFAZ2eN+EFWmdan4e9mAAw3M= gbenhano@localhost.localdomain", "key_options": null, "keyfile": "/home/benhanokh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "benhanokh", "validate_certs": true} 2021-11-18T10:15:13.699 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-18T10:15:13.815 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBYtdHKBXQcXQFkEW8fSwlFK/xZM16VcFY288ABI/DPfejTStHhxiRvmlsWzMy0Ar5WadZ8FU1ptjA3MKBEY1Do1r1Ul369k3zHCvxXyg9QGGMNPYfHmnNeoF4GEgoJpuounPs0mkLmrPTR+cR+/XuaZZt38nsad8M/zJetnolvqCWpcV87D7+Rt8F32J6kGDknC4ikEe8I0n7F+goOmJhlgkqegbKEeJ/EMnOItwVZHFwaC+sxOq4IlYp2f1aZMKGAtr5+ICwYH1SMCcvnp3qWL8O//t2tvguZgQxzIs6Nf5GaxwdQkh4CvjbWiCkIbGFJ57YICS6k++KMXMbEnwh jsalomon@Josh-laptop.tlv.redhat.com", "key_options": null, "keyfile": "/home/jsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsalomon", "validate_certs": true} 2021-11-18T10:15:13.868 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-18T10:15:13.994 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9ltUNitnn0FNwMeiGkBnozpBN5ziVR2MreaqkfqTQY2TgI24559xuILyy+TnAKumhemZ8i8nIQ876Iso85OzIXbUbRM45hpL/bMQX7pWyMIRNeFKrCDwf18OT0DPc8aeDOAFQ6YoN0j4awUENjdZuuAW80cfcjoQO3m7ORF8wBF0IvMWwPDIQQrz+Li31ECgXg6VC7K3e+BNHlfNQ/2/ahS0+V4J6JYFsylZL0r2tydhDMd6rR8QA9c9BgeBz7+KWobGtiZVe7KReTzJ0O38PxNd8br3aS50j5BiN63gch8eFxPAROaUMnuiavu6OTDy4/aeL3Zc5WpUy3VyyumWf jolmomar@localhost.localdomain", "key_options": null, "keyfile": "/home/jolmomar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jolmomar", "validate_certs": true} 2021-11-18T10:15:14.038 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-18T10:15:14.153 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoefxOfeArToGucfWG7y1tyLF2I1J/IkBSlmxxEJyHyDUB6ElXjYIJReoiPfmB0xLEmINpmt8QA4XN/8UbR1r9LFOexlZZbX1LSbihi11LXCvfIJWqkHVwIyKHRTu/duMrntBFVENJ0LVf0GSWVTtllXaDA+fMkp6/ra/hlRHQbx19UXy/9+Pogj8Xl+SntnMGiHlX8FFq2A2tUqhdQSf/1GW1HfUIa5WtwdEqIpKpAgMM7sOW9i3QAmLAMo8HiKrArSiy7jrRUODCqsTJsfifxEbmnOS0ZtmDh0eeWL/Dyqbz99Rg4WbFNeK8oyZYr7D6bEAhd2az2A+wycPx4Nq7 julpark@julpark.remote.csb", "key_options": null, "keyfile": "/home/julpark/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "julpark", "validate_certs": true} 2021-11-18T10:15:14.195 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-18T10:15:14.197 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-18T10:15:14.332 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQD03otezqmbR7v9dq62mWH5Kkg692jdmDZk6Ve4vux0A0YhxBuXDCyBWLE1Z4lLNxQahvK0pGsgokp+Uk+Q6aU+ZnF/E2jLp6YWerFXIHY3M7byObJx9+QuVBfNI0bZBkV3+vSjhSCGOYU+TrTHsKZqhsTcejZjmL3gFLmWfU6dTh0sX05qz97cdJl3CMPhCIR3KjtkiPygj417/N7wet/Efv1t79TvyS7dtK1oz+zRLEpKi/fZjvpXb8xec7as72Y0XexsWMDyZJ/N8PijTQ5L6EfLMV7ae/bWGzNAKsoC1dHVY7q/Q4pzktC6zU0Rc9sDRMtrgFg+q+04BfveSLfxTb9tqf7SbSvh7IAG1eKiEuDT/uy3T6Uiw+CiZ0eIqYzZscO/aDjUArGbS8eyaycybdYCBK9Jz38i0mYKkXg855yoVuIExr6MXieYwyVoVW8gbx1bAslaafrzra2dkAFByOJ0sbosPFRgR2+boUSxD6IaE+ALgno4T/0CI2RMiH0= prashant@cephdev\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC4m0LAcC7XiFiXFtYcCvZqX1CtyV9JU+VUEawZJpWrGTOr8c+vIexq7+WKg+eIUMot4+dtfwG8lByS1VofglIe5/quv17Xj7dO/hF2WkV8O7RYt7NhzmrKg54yB73pbRpvqzGceWWDvGRsWQGzbY7ARqOp4FPIDJvgXABCkak+hmjXyXpvXN418CBDbDmxHWwFb9QtB/MpQFiFrfl1EMDj8DaXZNWgo5J/qytic6LgiyPHhHfhSylk4cl9TGftNatobpMjqBT0O2/plk/qf+7pHPuvGSgihjijdpEPzVfctXE2OmsQAIZgkzXeCqts+s6ZYdUKq1FvpV5rMM8ZLqfCkDjEzFENJS68YYE2EjxAEgMzj7h/sWc4B5I5pxkAqVAQSGjYRu6rCCbFz8PXUdTyW+Vs1YeylnlBMiCa4xE4gwvW3HlWEnumtyURd1PRENrGJsJ/0uX6bpltbSg4sGACRYpLPJMm3OhqI3Jm/J/e2NLjfCw+svU2447xnfJOh68= pdhange@vaquita\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCoeyVaMjhcGrWQB+4Rq+SSIi8+OY/kx2s1vofiGt1gu3RNtFmG0Df1VITJJ32dbzaW7kTNxaRvhldNd/n7yEMssG+Wg+a5WKvSudlbVMmscbSXdFuVbcCW1jNrTGCYrxL7Sn5e7NQEQfAsCbfXwTcYBw33NdBVovC+gs2V3sZGvX3Y0akZONNuVg1mhu0L4m1/5IegJh005KeilwetHA2A5Dr10RG6oyIgT7t4z5gZXsrOiG3UQBXaekILYV9jxMWoFXGkVLc8TpL9SUAdxE3Owc0u1XiPqYYlEN+zDvE0554Zj8Oc2ZO6HRXCZXQFvzXeCD12YswcOfkIDmJRF7GT prashant@mauli", "key_options": null, "ke 2021-11-18T10:15:14.334 INFO:teuthology.task.ansible.out:yfile": "/home/pdhange/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdhange", "validate_certs": true} 2021-11-18T10:15:14.365 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-18T10:15:14.490 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDg7xW5+Mk7pG5MjLxOc7GTvDTCPBJj2L3MEQZIapmmo6t8uPODwDewXncSzrKDH6zFVE4TTTD9fJdu+BhyT+jCFgXrEOMMabj7vJsg0wO0SWqr+4NECFPhD9y4ewfYiewBeXisclA5Bto91v93AtYpZBCdmPYSi0BEcPVc6S3iBUD0PzIrL62I/kBAtm0f/bScRiT7XvQJXvkbEObW2yS2XhUv2qgq1VlFvO1jl3B85KMTHVb8+LrKpQWOKfRfxJ74c51y6tnEjZLFO6Xn0JevqOhd8gPQIXueFZOM0g0pNp1mbtGaaBlEIibbrzo2p9kzsdvJeHMq1XuMIi1/Qyj9 dpivonka@dhcp-41-144.bos.redhat.com", "key_options": null, "keyfile": "/home/dpivonka/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dpivonka", "validate_certs": true} 2021-11-18T10:15:14.522 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-18T10:15:14.660 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC0m+8wna4RnrOcuCUj971EBe4cFiTXVkEWkIsUX3yeCUwMaS/ZjaoOjcdYX7cYpCp1ilo4FSO5BsochU0RiMbQEwLGcE0zB2q1ac8+yYKCuWWyknig2t4bOReu5OrXvl6mj/9R+p7clFlYhwIoNG5ZZ/2eTbo3nH7gWgaOKaPbTtvEGg/5R/qjQKg8OTC8oix6kLsaNTisQJ78Zd7b4ukg9bO0jlq/2UhQOBM072sU1/kJpWTkcA0xxm3nsC4rWPwapgz7UwBmMdyx116GZgWdfQecTLKO7b8pyJw21npk2ntUmeMi7WPZGX6VI3IpaAhBjW3KiATAb8JbAQh8F9bmejkw6x7zrP3hYKQOg3A+U8DKRRo/Ad+f0zz9gjC42DUvMEOr09RBdxZcEAPY7H/YRWEqbA2zPX3Gfth4b7/letzM3m9ToUvVfSt1CdjaZD+gIia9pCgDMb+j1j2w9reG4F7Us+W/1f5pYCyFyrm4XO3AdoYM9/FOAOR3vffTIQU= adking@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJOefD/VJfS15LRyuVDLluKv93Zgocsl8BhiDMimvBNbrGWc795v2+eevWuwaL/SlL44SnsNZ9Mz8FVn9YuFoQiHLg7cHZNLg9EJh5SMXzZzwLZHnF02MdI2CU6U++9nmh8FtBrdBWKzZ7o+01wOw+52dYOxvP7IJ7C/vjwOLgfigEN8Nd1PrxALVNIQz7fsiet0n3odk9PJfoqTu3IloXm9qbQiPFyfMA6b8a20RdLZCJDGGG5rd6gtsyeFHoAPZEz8FEUlNkow7NM7ZhdxOz/fWXyMZ27KmY8WSAgflbxysMzexyifkGzypiE3NQ10hdPGBgoYsHrAN4Qmte1/Z4aI5nxrNzLy/uNc+L/Bp/0XkLj9zfoiFFOReXvlz/laAV6LpbHyacr+iCwv9rlI7echXmvC6mSJXfBPuyR1uromUXpYRhEkn5uiOsCIQCuYpx2jeil7JV+LJlF62lLSndOv4g12Gq2TEZ4Bhsr2902kftPkLFenyfDTh3A2qGGNM= adking@localhost.localdomain", "key_options": null, "keyfile": "/home/adking/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adking", "validate_certs": true} 2021-11-18T10:15:14.692 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-18T10:15:14.694 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-18T10:15:14.819 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCs6q2b5NcUsNXl+w1Mrc7idNvGdwWkL0XRX5zTw22UNpQyqPkSrRTFKi4NxoY8ucv8JoLnaJL7hYSRHKTh7SqH78uPLZX0FLtoHvpYLgUgJzzJ5AOW5uekIhCMCm+3egmFnEBwFcNxtGnU2es02ByXNEXRxt4/LQ0f8K6lMqxVRSKYcltvWzlA7WFFdTnYMunbCYOdpw88RXm2pYjGIHRBnie7+pFiFSS6K/mkzQcfLiJmahgLSaYslI0ho1vQd8xfNLmZ700C5F4VTUlT/mJK/dI2LF3OfaPTsyqKNzOchrjLFx5b6dhZ4WZyqu7VKsHNm+xHZwT8VP3LPGSVVBdmEsiCsmV4g4QTI5ssZLi7siZDpaFp72nVAIO1i6kBGuiF3or+J4LmIh8ZRKzTc0DRDOw7S+IkWu1fv2UhYg83z6wrz4HeczI+bnolFFWW6HgGV3MFaUeRTRvrbxw2DPoEGQ+cjP0wsjyEhxlScwdh8W8IbVpNl+7mBe45YGUH2hg83Lst5QQxD4PHelriu40moWRHFKCnKfNesb4L1uqu29o8f+/PgpLdrWE/P5zIKe2ReWJyScYAI7jTMlFw+xgf+0TKryk44NMy90l3ei0umlx4qsFbbEv+lhzAALrUJ/da7fsQw7eIVykmcscBeYr99/YSYk4MGdk4jVCiHsQkdw== amathuri@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDJ3ch+pU88/tX5TVVFl/1pPief8drYLRkK4BtfJk+xVNxX9qkDtOtiLAU+OugYF1/xk9hE9zTbm3UBL23unrzhlR80t8f2FiF1YFhHVzeZ/p/OunmkU0RFQzkMVuwKVOUNulw9FwpEZ/0Bjfxvaims0SBWaCzBgE5g0R+Ofdq/bVF82K8vU5Laa3KZ/cCdGzFgW00cBvPAKIpQ93g8TRqsCsFvR37nY9v5SU1hJ9araEp6LRA86tUt3EFtxD2tRcmqKGtCb0kOr+rRXWVGiaUBiedHxFudIy0+TNj4fNrJwpoC0hcBO9ek4Bh6hM7Zqzum9HpkPGlz84jkm+r+xMThaZCh8iFkgxyK+bw8B8smaVJD04ob9Wb4RYoFYfQ7TEkPkO9gr+UsSesbP9fWfucemUqwK0htOOtpc1YRwdOPcdPJWAfx9J5+YVL8BTWYBaTdmHslOKeUGM5fCob6QxC6Er9xweys9jh7MXttSpe013bY7P4ZDRF8uWvygpsytPE= amathuri@redhat.com", "key_o 2021-11-18T10:15:14.820 INFO:teuthology.task.ansible.out:ptions": null, "keyfile": "/home/amathuri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amathuri", "validate_certs": true} 2021-11-18T10:15:14.851 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-18T10:15:14.992 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCt4sQTrDDg562IWY9Bw2fxFR7Y7b5lfo9egHa1qNFR5K4gt8lUwQXgzcxZK5dgSTZXHDGxrbYKWsdb8NbpgU/YjSqDUIptMZrhTI6pdHKZ2usY+nieaJj0NIZP/S7M93BbJeoNBYACjvDUr+vXEg6ZL3uAj+zFXr/4te+p4NqJBl4bSpvjcRK12O+F6HE3Q93j0Vlfs8IbXP4vcPcqOW+2usXw7JPdfjwuACJxrLTx/0mBsv8qXJDfOpPIHAMA/9SdTAzhs6XMo+fOwVOKkV+ki2fO3sl8pE16aFOkI3cYX36nkYYpZ2bJLnIPcLv37i3Nypl8eNLA4gzjkDf1o/KLO5vXOs76H189WGLqjh0SHAx/3KO6mrIhTq8Bv6YWoT3ntg22fXaxeajNhHcQ0bKZtGOAb0W1FcMRbSTkgEFAassYxlpTtuaCDIuA4fUVKW97Zu62eDDsSUtTWak/Yf940qAbptPPAw4ljmrvZRcjM9y6mGU8lKi5H4QoEOfbPok= nia@fedora", "key_options": null, "keyfile": "/home/nizamial09/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nizamial09", "validate_certs": true} 2021-11-18T10:15:15.127 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-18T10:15:15.177 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC//ZCaEeVN/J09FtsvuZ4eEs4rTBtYoQyG+ZpuWkJLL90VyJeYrZzRsgvveKW2W9oFxCFcMy7IBhLes0TZ/X/4Ox9eUmP/eyqK8fBqT3K1F1W/uOmKLFhlQhkxxj+p9BOMBD5trfES/QJQ6UFSYIS2WhWaitDgONjoLMR6wXZ9r7yZeQBxbmG4wGI0Cwx4Wgg+I59UbE/5iUfnX++gN3rXrPnv9V0yFeciS4HvXRFXdrIzvQFHcZMmpOOmGruHXN/ME2dZCG+kaZhZdI6kICSlOwpU7TU1lv99zjBCeEzGfFkjv041ykKdNVR3qE0k5u0AOMqxJBORL/woSCdGvrBXqju2G/2ohl3B4zD6TAve+JLfWOV5C20NFRPPbTd53JaNpV9OQqwOfVniowzSYYBdedjm9sq6YwhJt8iBXze3OA8ZO0GPXo7PC2MyrrUtu6uu3DZqU4x0cl8iJxqOlx5pH0Gydj8nuUG0+X6wHZzPXZRe5M7/RzmvXch9koG6FQMiikNjUkK8Guz4NMBdAYUpxYkdPGBhiuELoaAcgIVzSGoZTuICpNYwAxBHk6q18G8Qd8vaeUdGdim4YvwycsSOwFE47wg/XmpCHrNJUZzzB9UD7Kn84TG82LAmCuAzpzcp0uPjsBckbXzj9Zt0hRgF80yDgUazsQkbgtd2p8KxIQ== loic", "key_options": null, "keyfile": "/home/dachary/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dachary", "validate_certs": true} 2021-11-18T10:15:15.211 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-18T10:15:15.372 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDwVh9KqjV0b+65aBxQV66IUwNo3D5zTbN8U6Kh6eE4QtaIVe5Mmvi2SBbGMSWofE0zIIw2JmsI5LzdOoCyZl/3gNDPHQd6D9o0xRHQv94giZ2a5K+mW79foAxsuppTjV/Fbg8EZ/19W91+BqMWotlMR66ka0RPT/6U8V5mzXoydSminViO/B6q7ZYzIIgGZqaTsSxCMvz5BAzzeEaGfSlGxw5MOye9sF/tDppuRKG4rMUZULEWGuxgXAtabtXCduocAArqAY3BRJEgj7JetPdPNjipGrULyYQmT7GeknvP/waC0sPm5o8t7taJca7Vu9qKKMKPAqiK4KhlrW/yVBFliT2CjAdVuYvGj87LCcEn6NMeF+4ONwDz++YwjrAWQT2zHUJPvLnYOZPiD1LUm3F34cEHD1y4Uf+oeiYgriUMauskfFn+ShbTmWWooFRFyNobzweg9aMBZSkA+kFFifqOV1FwHTOYg342NumRGB8svK0vvTUID7AU1Ev8YXYqCEGbb0UHth/1pEbAF103enLTtPZ6qKua74rE0qJ89OF9dZXv4JY9+8Juyps7bi2XEyHNm1nHZOY5tqdY0eKFmSGJMoWBDzGgdMjmXlWp4jnY2fC619nZqxMrCQpeT70CqnBhtBemUuu6jHYUbbrPjnXIkH3FZ7/qvZt0jF0IMP9FGw== amctagga@redhat.com", "key_options": null, "keyfile": "/home/amctagga/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amctagga", "validate_certs": true} 2021-11-18T10:15:15.374 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-18T10:15:15.543 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtiHTDuQk8EDH5R+JfDMucI4ZpOzKN5SLD+j35QLLySgGXholoDxtqjHnmRjM1rpj5SIaXjHBZdJi7iax+1MRywHYBi5BfTtzYPgA+NH8mt+XkcdkEuFPcYxGh6fMQDQWb2g9Euze/6qi0W9mbYXvvb1/Q3bhVCXg1UgKD42BndWEpbMYFfzJLZWPtOD/lg81pwUmf/4BpPFv52sy87lQVfkkvcUliLObR4S0TI5hPLYxBS+RXmHYKgvPMB2QJ9wum62lJ+YM1MxPygS0OWbIB6UQGXmvxRXA4osXkxJ8ksPPCupOgFNiiYro91cQh3mmi6iHc9kMz5R1aNGGOfDdlnLx9DRSIiNcacjXEVNFaoM0x441f4GeU2ZR8/7uq2dfk7QjPlh1eJGxG9pzRiQ8JCDF1car0eYwXdMTsQoQqpIi5imqcELdcqGGp9FhzFElgUwpf15JYlkouVhS6hq4LDjhLNk7dDT8fmCEnHOPcbxaTgN7J3idnJK6zeIniuuk= root@iZj6ce071s2zz3reioxn93Z", "key_options": null, "keyfile": "/home/kevinz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kevinz", "validate_certs": true} 2021-11-18T10:15:15.545 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-18T10:15:15.702 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-18T10:15:15.704 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1YAaxAvlRgu72huAggHpoDKSgtF/b00ACfUX4Wk5NyLFbYI3PAQapHNcNL4mIsH8pc6YkdjcJ5N/F12aEupJGQ0Q06OS324xapnaBoUy1hQl9IvhtPqTLEwR0X5xLIAhNBLIEJDNVg13MKwr0u5YVUXdrQRu7Kj9RXAPBahNZFo/Ed+cnR3LICQWliHeHFrk/DU2DUHol3a5wAPxrowAG0AxAecP6/7rASMmitvLQwdQcfIJAhWYgfyXzudg+gOmAEgv3O3U4QOikgmkm/EabUXLJnlTj6yuhtuuctdJr73UT3wLGAGmphLKCkug27kb1nTNoDa+PW/+grP63zhU1 chunmei@otccldstore05", "key_options": null, "keyfile": "/home/liu-chunmei/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "liu-chunmei", "validate_certs": true} 2021-11-18T10:15:15.860 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-18T10:15:15.872 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDLbPdDb+XHOD2fo8g3RacATj0cG07uELwUvqQP35y+JmhNRSb/ttaysFLA5ss0y77TiXx22saP3ECEm5SnuPg5IERkPQmXiw84ATTNfLnzx2G5H223SLaTQiGfSgniBCJHVPCJfNahJiurlZoOAlwDz6SKXTUiivVrFJ22iTBDCQUO6HFQKjE7aM3RAo5mZXKVlTXzM6WOd8vlzk3HMzV0/91JR6H86Lt9MEzXT4dOzqmtxd8gS6U+vA+50zOIspdK+orTRJ0PO2Fn8c1RSYM8g7uqQtpDcOEHderW8TRsqBbDxpyslK6hRX5urUNBX506XE6JNoViLNvCofgseCGj yingxin@yingxin-server", "key_options": null, "keyfile": "/home/cyx1231st/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cyx1231st", "validate_certs": true} 2021-11-18T10:15:16.032 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdqw+8an6CHqsagFqXfuzQi1zCFHCh0e9pDtYz+ylA7L+7vnJLjTR7km0bb4Z6VTUh7h0/nUfF6faPzD2KGmTKvS+mTpeOUaN/H8O8j8qqh90f8z4T8F8L3DwqQbPf/R0izXmTgz0FZObFHmj+G8a+D4ndxF80EPzKkML/G0Hg2GEVdYzazSY4imSY2f56ul6qByBknhFshaTo2DUDcdbDDokF6lO6WgXhY0MJrT24CUSMyZmyi+3hF7vowW2dfbJ+SuDft4XmPDnIxRhDWWvi12jZb8Le7SWYzUlu7fAGbWe63VJqNh992myI61aZshApDD24+1xqIoo+Z/XkQD3l sunnagar@localhost.localdomain", "key_options": null, "keyfile": "/home/sunnagar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sunnagar", "validate_certs": true} 2021-11-18T10:15:16.034 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-18T10:15:16.204 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-18T10:15:16.206 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDTlsh9TFwLCeeD2RR+56VhRZ0hp9CHj72U3Z1gbMpxpcg6PYEDzb+0qPVQp1/cIhcwwy0sm13yFl/A5i0iCRpyqB2MbyaXjj0HgkNinxLBFkPSiW2C83lfAyAhG/gLk+FcmWE4+xVrE29aoSM0JtcNtp+q83UGdnFcvhFe0pgJbt5vITo3ZMJND/UZrzeewyK8Vy4Rvpfy8aHYi2Eq+7WQrRHwUwxn0CwsxldnUfmZtu58d+Rtt78LRF0mvcScNlC7q5D+8htmYwkWkK639w5IB3xPv+Z5cV49Psi24Q+9BIr9Zo9/OnnCTauAi5ivDlh+kk/iBksAE8rQpMhvfuSFnNoq2O87aPQvNQHdRCcOa7FVIDcuocu6AB8UP4cGcJreT4+BW5Zbk6vQeJZhmj9yExpRj9MuONy5793nKuAMPn9lOjuXRfK7A5Tb3OOhpEJK1/MjtdZz4mNmFFfFIZ24hgTZO0pOiMwDf/tQ6BG7H8NS9g3QmXPyZajUocw6Szs= lflores@redhat.com", "key_options": null, "keyfile": "/home/lflores/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lflores", "validate_certs": true} 2021-11-18T10:15:16.374 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-18T10:15:16.375 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGq2g8OFN5msjIn5CNB2BRss9eIyJRk3r+7RQcnBOQid jsawaya@redhat.com", "key_options": null, "keyfile": "/home/jsawaya/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jsawaya", "validate_certs": true} 2021-11-18T10:15:16.533 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNIdsy+yA0QjwkvjzTiH4lKB+txlh4oGkgC0r1l9swmFvD+MuzNNkD+oB/YscT51tJXsP5/wZDZMuk60xds4Os2ejoIBvzdGBgZ1G2B33etHPmzgTFE7ZegBkMlvWYmrJ9YS+iaMvXn0MMtqfE4zq0kemVAA4NBfFZMhHPJMKCg7Gj31MR0S0b7dcPx7Jnpg4A45oHr0qnufeqZYQaHGgo+LO2xdoV4V2EswWr7YG+b1wI6DzFZBbNsGyQd+cE1BzQ8NmETPNNpDPk5dCyBS7U+4ZTf/WbWk3+Cn+Ky47iWfxcscupQRkCjmTYI/uCMhnrpGU0zEHkbFwLTS6wqDtDmVHm++xof3xSsGJ2cE/vZySZGHqdxqVXfT8gt17h35rME8eX3TU392rjfK6kjEUD3UgwJJp4NFzQIEXi2HTmDYx/Vi9nuId3V1NrDz98QLPUd1ijiy1DuzI0BJPE/DTDmsb7hNXNIcAV8VRc1243W3eaee/Pdg/wmwfkrgjTU3s= shuaiwang@Shuais-MacBook-Pro.local", "key_options": null, "keyfile": "/home/markw8973240/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "markw8973240", "validate_certs": true} 2021-11-18T10:15:16.545 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-18T10:15:16.692 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+ZvZuogU+WfyGj4BR2xYllNoQqAoxQ6AM0IYddBV2pL1xgTM/SopuAxDRP0q2stpozMtjVjlvuiIgr/caqyTuOgYtYCvB09ppefqdnCDrJJBCOKpjUEnCpAKcBMMuz9V32Zqt5FgpIi0Mu7Gp/QCvB97imxEkoUunpdX/8Ri/xz0nJO+QqoJX5wOn91jG49XnkMCLzx+MuafhT90WFO9CV1sIVREZS+X2C7ACQuhx9Qwk7R4BXt2f3M4dA0K2nLwaAnVW50M1y6Gs50Wl+ojDR1itySOxv8YpwyRlRTOzQTyVMnG0Qsaxxwp+hy4b/vQW3NIUvHYdTyvqALTQdGHT lricomor@lricomor-mac", "key_options": null, "keyfile": "/home/luisrico/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "luisrico", "validate_certs": true} 2021-11-18T10:15:16.704 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} 2021-11-18T10:15:16.860 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIKjxTgyhL1yFriyNvvuhUc6SE8+6f6lT6FTF8cZL9uiz matan.brz@gmail.com\nssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIM8l7qvSQR7fnZdQ1yB1F1jgde0OmLcwcDFzc/o2dYBb matan.brz@gmail.com", "key_options": null, "keyfile": "/home/matan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "matan", "validate_certs": true} ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= 2021-11-18T10:15:16.862 INFO:teuthology.task.ansible.out:ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-18T10:15:17.022 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCkFTEUxQkQ1cplOLOf86Teu4qTYGkMqWtjIwzsU/AcimjFolSI5fJ3B72PH7bhQKkSnOlTjiOos2LrD5i/XgxkJD6icVWwHO11lczsq/8K5x0ZMJbJaiT3QphBB4yItoge2Y4/7g4o/78Ne+U7eZ1L5fgeO1fExtIaEXK1lS8pVlpZQXyproTIzp1WLHoaXb38Mxc5jAtuvEKfEycdX3c8k/9ti2qBCZnmjPH05WOxkqCRyNBT+bSJZyFMYt9RDUuycn3BYVSXTAzPW0qwgvKY5vij+qiFoxij7nKNMH7w6C0arolCcJxhiMyEF3UbTuOxgVONWyqFk/vScGGSYj9ytQYjv0L1cFyOVhlpbu+tnptulfQ3faMpjROE/eYxTIoY7OPDgWbFqEUJ4eEhKwAC7aYIYUhvoI/8k+4u64nsyEJQdHXmB+OY3WE5TegYUCuqSsdPY74eO1o8dDgxF363eggDSBmYqSSs+Tpu9TNhJG7iJFX1tiAPwmKvjVrJOac= ozeneva@omri", "key_options": null, "keyfile": "/home/ozeneva/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ozeneva", "validate_certs": true} 2021-11-18T10:15:17.024 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-18T10:15:17.190 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDepyzA+MeQT5oRM52SxmUUKVAzkcrH/NqFxoCpBAjUSioTMaB1h0PhHE00nvHnKRvqWdPl8LCBWS3Ncjh30r9lwHaP+oPy4iLQEc7D2Mwn7WyPh5cq9N3UF25C0AlMG744k1tBNb97qy73OJI+oc5pAj4vUpCC1Ut9pMP5E5pQCx/kwgSOpC7mk0dYr/H5FxjPb0ca55eisFTLXraHPSChdrHjlYC5XpOZ9csilTwFdF0fJdu0nMDwIxGvwTOaUcIcfNLkpGB2Sj/pAM4L9pVsIbeE3C8d978MZ8Ff+ksQ0T8eNzew2ZjSkSuV+oR1sBCJYZ7mbDQuYLKAs5DanO1VFJvgjBJm1zP2ONu+g0fn/j04qIosuudziwoG/dOTkFo+6dBvF5hQi7TbZOIUVFr5dBlGS+O4eoK0gi/wpzun227E4dadY9uB1wiZ/PTD/5og+gxWG32RkHqqX3ALlK4m8JKzrq214nZ7Dt9CNewiUkR15uRkDasGIdiu6qb4Ez8= ArunaSudhan@sudhan-linux", "key_options": null, "keyfile": "/home/sudhanaruna/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sudhanaruna", "validate_certs": true} 2021-11-18T10:15:17.191 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-18T10:15:17.352 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuHIpWAz6Sk3ATLvTG4KS24JUzgqQBEm4EesPgf1cEG+xK4gISUixaVC9OSNS/KR+8/yoWAhmw992p8cp7mWXxqrRC9kIrthLWvD6Jjz3HTXgarO2oNibeVu27kK/Fm2vvUNACARBkoC5YXd6IuoZOEg1bJu06DLw5Y7pGMqZRVDOrE8WUDwr27roZSgU2/N+18Y1LYn4gwSvWpuC/IotLyGSpW7/dgrZAIreRoYboMdTSlIjjuzeWvYx/AnZmkeEo0IhfyuBRl7ZQwxSFYHn9Z1+iQkt+O9hEZYSZuYRuyFPRqHNMKCEj1iYVRMcwbf/x2/dhjfmbWmjOMJoNNwm+DpixHHbId6Idx82GlAtCgQSTe9aG783oCeZYuVUr1plIRjeEsdjY9UBRYKNknEAChKjMSbxysvO3Dy4yrU2r8qo1iBS1fi4HUg12asCLrJX7vSCvOhOn7ltqDTmt5UiLSn+eCzXpOTBDWz7McB28FoYyR+Rwz5GOH3ITFhPyhXc= wzl@manjaro-wzl", "key_options": null, "keyfile": "/home/zl31wang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zl31wang", "validate_certs": true} 2021-11-18T10:15:17.365 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-18T10:15:17.523 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIi8JMOVD91QR7EXBkhxeAsB2UO2gyWqYPiP6HjJO/TzzMKf7QtO928XzdORwQ1/jm2hDF1kaNPaU/XIHD0hHSvfICS4ELQcBPa5uPya6d5Kn5fVlpGqBcXBxKGbHB01PGjn0214eupt2LebWxkm7TP/BGDHKXXaoR748AlbyyG2L3TaNoGkwQiEoZe3CWgH4qkrf2CEpyfOa7BM7U0h+lceJxIGe+Yo6Ll14zyngDBa059E+ndFTpkQ6vECII7FdB1+A4Orhu40XHZgyVnlRudD1l80pIVnZves8N2zHZhQo8hp0sB5oY8HENiB09j7Xa6YQ/c1c2wm9E2xJHSNo7muFiHz48vQEgvNmu0lZdbVwXIy3IgLEBHjs6Kyqjtg618V4UaoP/LBOqtWtLd6TvGJ3qBlNyvhO5gZ2DGeLMN2WWoHxfl3VM+QGCGI2dnzUyHhfG1VBDYj8fzWXOuUVpVCMUw8fEg8GWmYLDwm3SbdMACWU87J0kAmaDPKcwwL6AwtWJZr/p89sSypl6y50JlOoDrbDbxrIbHQgbf1tcEgPOuLUN+O06qpi+OxKMtFdbvz+NQ4V4CpXpvMMQZj5AbuHp0EJ5Vme/Kcmpl/xoYGyFDzOEGR8lw6LMz+CpQ4GtnK5XXe1Xn3TJh6Tn2tVyS20p7artemGQQquCN8iQOw== mayag@gett.com", "key_options": null, "keyfile": "/home/mayagilad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mayagilad", "validate_certs": true} 2021-11-18T10:15:17.535 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-18T10:15:17.682 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDFG1CoPZEh4KBANdJZIzLsutHsF6tAYZTdDdEW+5E+8YyNHOy42D8iBLg+eCAbIl4SFmJTsPNtyO4L8/Ut79tkG3usA9nuGoAwGYuctZUTgOiTiV61940Y+NTvwan9vFNoknVi/3qIGNSXdm90I1aWRTKLCXRbGA1qvu+qyJv93O8LFaPni2TJmtAebY/xf0fHhW2fURUoeoCsoobrTkPA8SojT0A3SM+31iOD7sxbmsqLBR790wz/FHh152PiqpupIijS9TaZgGuVpejM3rgAC7H2kVmKJlrmDlmfcbKLS6BBi+uUDi6ta8whnDRq03nP/4LJE7ZDIxX3I4mHztZeJggURlsfpJdo99+VHkeWlGDBIP41QgD4UX1neuMcIO3nuEnZmLeJyvo9JOR/I7AudbQCDPjSMNbrF+el70mWLhvPe33NA3x6eOBRPc3r+qrSwMhXEPatZlbywJRY+O6yC2TYqdlUKsUEVA/D0Iw7tO+pf3yH3Y/iUDJJLvViRZs= Arjun@localhost.localdomain", "key_options": null, "keyfile": "/home/arjsharm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "arjsharm", "validate_certs": true} 2021-11-18T10:15:17.704 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-18T10:15:17.850 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCXZDAUNEK4+/6Y+ywEtFnabnfvZmzzHhO6y4PbRHgx8SoQ8+7au/5ElB0vjjiJJSChnDymdqP0UzwcShzhWA8is6K9c6tXUHg6NcgV5tN2xYYmGIIWwm66Z1kYH6u1x2Jkv9LO04rXgebkzXPPYK401agCWjkjUv5acZE12+M/B6d4h2lpFjzBqZ/mmRNp0tHdCapdG/nS1i6GRi3Yi3fQ89CbiZArG9268DSEnLe+npeyBMVdDkWpVIytQ6pU1+g0prrePIVaMvrK3yEooduD4HeLr4liqkINj6rCs90xedPcFi0++UaLFRcgWh3OOnrI952Oe19dx5hlbmcnMPGjaXnkng2keWFyZMOQRRti5l8C/TXPUTaYGWEoqFEEabIKnCura0NWuZHpeF9xEK0tnvNVeauuUfkPxWQ7PH8QQ/9XjOkKbmy0+2q9tug8RC5i5NwcRE4W3ijM7pLwhWMdxkmIOe3w1taPq8HU95hMQchl2749oj8DRyVePVK9aH0= melissali@melissali-ubuntu", "key_options": null, "keyfile": "/home/melissali/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "melissali", "validate_certs": true} 2021-11-18T10:15:17.872 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-18T10:15:18.030 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCYdmNB3np8OLc49B4cAh59CdNYIb4fAq2XBQ1sbOZMMZmhpFobyy+i6s4lBnovMNWAB6HmpsECHrKRU4IFl9lQ7vV+++J08SLoAkl6G0Gk9tmbgEs+/ovCZg+qUfZA1ZccSAPHmtqfZOiJcnlIlhQq2BoFnLUwmpeIQ4H5D+Y2q7DMdyGkdCenH80aD5KuiwLIyiBL9q7RYz0U5cdCO3wDFU4+5XuZiT8VYDUgp3mWPpAiPdGsJmCn41tpt3PViPDQlKh4vLW0ieQUJI/v2f6oHbM9YkxSoVlwLcrjTv+Nl+dVymqVTF4UaT1kz+ZnoH6khKZxSHvKm9YHc4LNZKYoVdyCxdZvBfxbEbXpT702vLqDNGEfZSlzJs5kVqP30m8fI/yzTQeD7tgjzzrKWdLZacyo+9cWeH6nFfZAQuZ9ug1lv3UAs5x6MsidEH5u6Iymi8BE+mUsOXnSpSfUDDo5n6+CMVe93brdW21iSX9Hbuz5RKB6xile1ROHpvpi1u7VQ9Hp3FIZFFiix9S5jniyB2OqjGKTO6RULfPsJo8sXCLq9YKq9zrkpMv5wURMQKnjtS5OHUWh0cde3U/VikPIfLkzEsfLV8ICAksyuWHQJGVUMxhPmSTKtRsPScbklekT+n65rexDt4Qr73YOy9BUIPV4Mo+kkl4ugQd6VCKJ6w== ibalutoiu@cloudbasesolutions.com", "key_options": null, "keyfile": "/home/ionutbalutoiu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ionutbalutoiu", "validate_certs": true} 2021-11-18T10:15:18.042 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-18T10:15:18.188 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDuyLB5rnyjlglcHVCoCSG7pDVJQcTYq/I2yGr3ohK9p6boWxk+zW/a2Q7+qNdKk2DtUC4WvvZ76BU56FC6/LPIUKSJLbN/Xv9/dnZcqKf+ZVlCQgMrE8yGoWt8WLtejJ1iBj0EdoDfYwDiL09ygUim1L1hNxFDOVq9RA2Lo6Tqk5lcAgjoCnU4NZY2YzTXOUSZTzsv/1bd6WVudKHJuWF6ZPb+mbbMoWqwnUZCHwjW8PgTXaPhk1929P0ftWT4ncfKnCc46LXf8OkvzQgCrLyh8964tGKPWppp3wNg2AJ/zFvRY8kkJZSxOawp9Gu8+kCNwWUmLvE9bqYJKT7EMDrU+8TMUEWLFl5fGoxoLWD113PPBcFrpUhvRAJa625eec8a/inv4cqPf6dY6qyXAReXURJm7LnHT4fDq+F6op8+tmZT6Tzkw4+YMUd9h0XDJ4pnPQpk5tjWER/HuWm73+ialXo+ERQWnnVCB1IXq1FEOeF8YAslKC7aSYIZjG9uUkM= peristocles@localhost.localdomain", "key_options": null, "keyfile": "/home/pdiazbou/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdiazbou", "validate_certs": true} 2021-11-18T10:15:18.210 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-18T10:15:18.356 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2iBYL614KRYvFhow408yzMljYRdfyMmbnkUVN8waja4RCsmxTpvIU1aBQ02bMTsY/0n+WMWAbI1D6C1HbuG+JbFYBLSgPCTSG8FIpukFU8y1by8piPu2/ZBD1XdFcPO6u1Nr/tZC08EXhfqvnDAVJUyg6rLLs5+TFKAiPSuv5GyrMRWvMI8eoPk+4u2r/ThxXZTDaIfJhPXlULMLL5ZxR4KZU+WtWbCGSFDGjSugCqdTzpZyX5jUq9C9JB83RxojCtI5n9rCoXLcGOvW9HBnVMxhS56zE8BwxLxLhGy6S1lOoyBPzu7w6XIc160JjCK5iAmlXRqG93nWEVrhZkxCz wangxu298@foxmail.com", "key_options": null, "keyfile": "/home/xuwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xuwang", "validate_certs": true} 2021-11-18T10:15:18.378 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-18T10:15:18.536 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKSdu3rI8o3qId+GU5KYsxB9CLPTODJFiwy+ww6SgrNKgPfiaSUsZAvcQwoxHfuaEXj6VGaOS6HyFFmvHKhzbecSQCzPIucIuKJJDA7VTaA9Jet0aT2b8Vk4p0Ud9j4WoausmxEdBQC+ZpJxSuqajplejYK1Yi3YEqXSCvM6Md76HCustS8efPvzLsLYttDd34Lw0/zp7ALE8hrepLYJgzQS5Z6btvQEjL7lvtHk80/Y+M6ZIQAl6nPcjb8u+wfs/lxcRA5i94GsZhEoYAeMQptJNvOaA5vYK4QtNyV6lyjGVJl4RUUAtLKKp4JE/kdx7sa0Gy99L+u4MjzBoP5B7SkdJnJx7FioXEen5l5DpiJ6xRixw+SjbqEffW4HHI5+1k6jP6kuHPbWfcrw693+aiFVDQA+myzfWo7iDTjY2H5CtnCh+wr1t3VktXhoyPob/XfMPzMNg4W8nA9KVePwzEXSy2Ro0t71GiFQqBviUuqfktqz4a52PqGyFHtskhFAH3H/h6JYM88vfc7Bw7P/u4eVaoCNgNIbLA/kmf689Q1H2KENj2SX7CDwNL9GCOy/pg89qai63+PFT8258zTi0TywWduP1D0DXXtIB3e5K1yK4Zt6VCinXZAze4bsT+z8y4f9W2Xs/FhhtUmo3mOiDJuaGmuWRzHQQTjL//v/Rimw== blaine@brgardne-mac", "key_options": null, "keyfile": "/home/blaine/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "blaine", "validate_certs": true} 2021-11-18T10:15:18.547 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-18T10:15:18.745 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDM7LPHiaPQXdE+yt9cn7UMuRr8k/LjSUmMrnrAqp8ySQtX6OA3/NcOsxg6FJ45chZqeoXwhsYEW+7pTInDqFlOlmVynR26lWnZfk9DjBJZcloUCn8y5MR9QitNYsOMs5KwCEFmBH6sP+2vCFocXBnKQcVZLRfip3MEG4LoWYfI4ir7fLmK1Hr5G+GhtMstXvVSG4VE4IgbU9/LRIOv7P9qFn4bRJoUSiS2dDbUxVIuneA9bIEnB9ZEVGahEzlUhx6qDSs0FvrnneCQ1ayOFpxClzjT5GuKk/J3LJvWAw8CAwDXCf3FzsWQsvb5ru5VSazUI9uA3o9wWkbLW2oZPgtzI8lmwbL+MT58T92tqaJOPID3IZDGjzNrRqU5BQYpvFYHpHRRiqV625og+ktYfXgO+dTbgAxScomqutydI4cyJusDtnWtljWnEocS+2hUSZpmB6B3Wj70TuuzsbYrcrJ/NgRpQNX4dwHCJl6vPT+xkoLh1imYAC7klf7cnrOyGcs= choffman@choffman.net", "key_options": null, "keyfile": "/home/choffman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "choffman", "validate_certs": true} 2021-11-18T10:15:18.815 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:18 +0000 (0:00:25.821) 0:01:04.899 ***** 2021-11-18T10:15:18.837 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:18 +0000 (0:00:00.021) 0:01:04.920 ***** 2021-11-18T10:15:18.910 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-11-18T10:15:18.911 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.921 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.922 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.932 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.934 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.943 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.945 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c3599 2021-11-18T10:15:18.947 INFO:teuthology.task.ansible.out:7b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.956 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.958 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.969 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.970 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.980 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.982 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@desktop QI358a0dizGe6T42hCYj1A 139ab306be981d0a669ec2288a2529503882deffceb28bdfc9bde2b70a825898"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:18.992 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.151 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-18T10:15:19.162 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.173 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.175 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2021-11-18T10:15:19.185 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.196 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.347 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-18T10:15:19.358 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2021-11-18T10:15:19.495 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-11-18T10:15:19.506 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.518 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2021-11-18T10:15:19.520 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.530 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.531 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.533 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.533 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aa 2021-11-18T10:15:19.535 INFO:teuthology.task.ansible.out:a55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.544 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.546 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.556 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.558 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.569 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.571 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4 2021-11-18T10:15:19.572 INFO:teuthology.task.ansible.out:d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.581 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.583 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.583 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.595 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\nyehuda@crestview yUJ7nsAXRv78MgIyxJ93Yw 5b872feb20cbd895a5d8c87956f9cbd491471654b1a29aa8c13826cd95a44c40\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.596 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.607 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.609 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.610 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.621 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.622 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.623 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.624 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.625 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.637 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.638 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.640 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.652 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.654 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.665 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.667 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.677 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.679 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.680 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'o 2021-11-18T10:15:19.682 INFO:teuthology.task.ansible.out:wasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.692 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.695 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.696 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.707 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.709 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.711 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.722 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.724 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6\nprsrivas@t480 jciDaqMz2kZbSRymwpJiqA 68baba83dd966fe9536bc9a822428710b10a28781f695bc3fb750482a94b0e8c\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.734 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.736 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.747 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.749 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.750 INFO:teuthology.task.ansible.out: skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.751 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.762 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.764 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.774 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.775 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@snowmon CjHOevVvBm+PwhjnhZYM7g 7393d3a95b1874764fc4e7ae2d481f1859b336e16e1ba53c49d126585e11ba56"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.786 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.788 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.800 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.802 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.812 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.813 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.815 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.816 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.817 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.829 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.830 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.831 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.832 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.843 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.845 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.857 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.859 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.869 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.871 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.872 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.883 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.885 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.896 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.897 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.907 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.909 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.910 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.921 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.922 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.932 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.934 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.945 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.946 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.947 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.958 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.959 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.970 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.972 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.985 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.996 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:19.998 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost w/vFHwM/x4hUGlKJCteKiA 97933f044fdd8b3cf57ad744ce032728b06f354b0d719790def82b2f5b9a6133"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.013 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.021 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.024 INFO:teuthology.task.ansible.out: skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.024 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.025 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.036 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.038 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.038 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.039 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.050 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.052 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.064 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.066 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.081 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.083 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.085 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.096 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.098 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.098 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.099 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 k0lrZNIKWMH/VrZupJ9diA 03bfe34ee6e9a541e10426a3cc1e1046655420d4d0a79ce5667bec1b469a0100"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.099 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.100 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9 2021-11-18T10:15:20.102 INFO:teuthology.task.ansible.out:715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.111 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.113 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.124 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.126 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.135 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.137 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.147 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.149 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.149 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.160 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.162 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.173 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.175 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.186 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.188 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.199 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.200 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.212 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.212 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.213 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.213 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.224 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.226 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.236 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.238 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.249 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.250 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.252 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.262 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.264 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.274 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.276 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.290 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name" 2021-11-18T10:15:20.292 INFO:teuthology.task.ansible.out:: "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.311 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "pdhange@mauli hqKEk1OuI2Wmi1CAcJk5CQ f49d854572b5efe9514b4d741e336adb3534d00b22b0a505142d82eccc2f7535"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.322 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.324 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.335 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad 6vBnL22Dfp8d9grCNtSoHw c8270453301dbec76f8070809078087ff892c74360b80a82002d58c50af19ec4"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.336 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.337 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1 2021-11-18T10:15:20.339 INFO:teuthology.task.ansible.out:bc951bfc673757267\namathuri@lenovothinkpad MhlrEG4X+iKq2d2GxwMbmA 812cfea500340140144ecb27f7851b86d8daff658f173189fceec8e61b59cbf2\n"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'nizamial09', 'ovpn': 'nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nizamial09", "ovpn": "nia@redhat OA+N80Ps0Ua7PfuVF4+M8w a9b0ecf7a28ef91e0653b0193f3f95967d6a671eff21ee8a99620a5a972ba409"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'dachary', 'ovpn': 'loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dachary", "ovpn": "loic@tulipe 1NGxatlPDW6m9FLwzG2Gng cc19cfe2d2101909e9e0ae6b207d7e8dccafd8ec1f4594bdd006dda6b67a80b5"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.350 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.352 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'amctagga', 'ovpn': 'amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amctagga", "ovpn": "amctagga@redhat20 DsFh00Ttjtomgs5nlTX3SA 713280e601e14a8fecfe190490e362f5f97bba3517b2bcfd4abd5230a45fbaa1"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'kevinz', 'ovpn': 'kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kevinz", "ovpn": "kevinz@linaroceph a2GchLhkaayg78xuUnI0sA b545e84634e614099b00d50e593933eabf0793035eaa439b6d82ec669f69de7f"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.362 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.365 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.374 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'liu-chunmei', 'ovpn': 'liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "liu-chunmei", "ovpn": "liu-chunmei@otccldstore gKMLlCSH99LCDse00ja0Kg 2c140368bca0e48102330631f91e5299298461a24cab483b9765293eafb2050c"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.375 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'cyx1231st', 'ovpn': 'cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cyx1231st", "ovpn": "cyx1231st@yingxin-server C3qUn5JXYFehgyfol2lnhw c5f306797eac838797ea99b07bd0f5e8e185052887b82ba5c343a42eb271747a"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.386 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.386 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sunnagar', 'ovpn': 'sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunnagar", "ovpn": "sunil@sepia-lab j6h8NzyTGEE6WHYT3uiOXA eda7763cdd544d8e7198cefee77f38641d44c8a6aa4d37b8b1429620641809ae"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.387 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'lflores', 'ovpn': 'lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lflores", "ovpn": "lflores@fedora CqF8+5Scni+GHCfHkm3AAA 0771c83aa58141af4704f4b01bba4490638ee2033fdabe5a2a4b8e06768b29c2"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.388 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.389 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.403 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'jsawaya', 'ovpn': 'jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsawaya", "ovpn": "jsawaya@thinkpad jEJaJNljo4e2sHstFCNljQ d0042e4c40344f7fa350d3e0b748686aea00c4757ffbe32a41f3b119463d9f46"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.405 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'markw8973240', 'ovpn': 'shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "markw8973240", "ovpn": "shuai@mac d7Tqhwnt5D7+jeeqKQ375w e6ac2fb0750350a007d00bba1354989402199dc012150a84805be57a92e6f06d"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.415 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.417 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'luisrico', 'ovpn': 'lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "luisrico", "ovpn": "lricomor@lricomor-mac DI4SNq2EznedeK8Cztt2ug e05bc16840e8c3c45f641852101ad921abc248013ec89a599c27c275767b5347"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.427 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'matan', 'ovpn': 'matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "matan", "ovpn": "matan@main-win vEAxj3ZM9DjxBi/jfjc+jQ 9c30b8fcef9bdc804090947a92e1e60cc21d3f280f261bc3f4cecac64541dc6e\nmatan@thinkpad JJuwaWbac2lbcH5pCGON1w 521fe30e3a950915a1b538913c1af76198c4133018b7869d348740c708b38a7d\n"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.429 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ozeneva', 'ovpn': 'ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ozeneva", "ovpn": "ozeneva@omri qB3om9JUxgVneOibFeRq6Q 92277afcd0bce888f60dceab4b2e8695ebbf7241dba09e3350a12c4fffd6ebd5"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.440 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.440 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'sudhanaruna', 'ovpn': 'ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sudhanaruna", "ovpn": "ArunaSudhan@sudhan-linux t/fhf5WR4vQxW3F/Lx7Atw 09248b17c9abfe802ca4be1b93ad318138f54fb60b073ff857c2effadb27a997"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.452 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.453 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'zl31wang', 'ovpn': 'zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zl31wang", "ovpn": "zl31wang@sjtu Et6K7OVsdRTnvOY5iuvUxA a7f66c06b405df269ac8f28a4b2c9f00d087091082c53ed5e03517e3811d9fc2"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.465 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.466 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'mayagilad', 'ovpn': 'mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mayagilad", "ovpn": "mayagilad@mayagilad-ThinkPad-T480 AGw0uOFkRU6SX8Kp3nyGuA d29a792aad9cc6038dfc2e3471f6556b50ef73562b1bc6231c39d8daf20a19d0"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.472 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'arjsharm', 'ovpn': 'arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "arjsharm", "ovpn": "arjun@thinkpad_local 06szrDO7vKFS7BSicSbDsw e1284059b3e0604191a0f35e2841f22835b0e75249e637d8297edbee458ccf39"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.487 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'melissali', 'ovpn': 'melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "melissali", "ovpn": "melissali@melissali-ubuntu pooAecOHrOtZ3gXewVMxnw 36860a4078c773f47e1a58d2f120ec79e468142120ff6a816cb6ffbb9fd9ef07"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.514 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'ionutbalutoiu', 'ovpn': 'ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ionutbalutoiu", "ovpn": "ionutbalutoiu@macbook ruUdfqkSfEhKctGGLeQvkw 0a6cab2332041d56ca8b1216242195af2ad8d0ec6360fd6c1dd080f5f43240e1"}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'pdiazbou', 'ovpn': 'pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdiazbou", "ovpn": "pdiazbou@thinkpad BNtoPcISV462wNeprZDOcg f6faca031e6549014132b4c66e53721c9d934a09d0d9d0f36e2dd31f90be1ce4"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.516 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'xuwang', 'ovpn': 'xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuwang", "ovpn": "xuwang@laptop 2U0uRjvVh8eE4iSkFzK2Kg 2a9db1c375a032cc0a892ca2d0721f9d7303e2db5a7eab647870d7c2022ee2e8"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.536 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:20 +0000 (0:00:01.699) 0:01:06.620 ***** 2021-11-18T10:15:20.544 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'blaine', 'ovpn': 'blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "blaine", "ovpn": "blaine@laptop RkDSJBkoRKI0UaxdQuMNCw abcfdade65dd772c066c0c63e712fb03240d676d72eb341186b0c0a94d4a4547"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.544 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'name': 'choffman', 'ovpn': 'choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "choffman", "ovpn": "choffman@choffman.net 56rg/lHPXPRyVivND7+0Uw ca591258cda719a5a0bf5d5f4fa87976773625249d29ff6012ad6efeac33da2c"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.596 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:20 +0000 (0:00:00.059) 0:01:06.679 ***** 2021-11-18T10:15:20.616 INFO:teuthology.task.ansible.out: TASK [Filter the revoked_users list] ******************************************* 2021-11-18T10:15:20.618 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.644 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:20 +0000 (0:00:00.047) 0:01:06.727 ***** 2021-11-18T10:15:20.663 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:20.693 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:20 +0000 (0:00:00.049) 0:01:06.777 ***** 2021-11-18T10:15:20.895 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-18T10:15:20.897 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-18T10:15:20.940 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2021-11-18T10:15:21.068 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-18T10:15:21.236 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-18T10:15:21.331 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2021-11-18T10:15:21.385 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-18T10:15:21.479 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2021-11-18T10:15:21.543 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-18T10:15:21.638 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2021-11-18T10:15:21.702 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-18T10:15:21.787 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2021-11-18T10:15:21.863 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-18T10:15:21.949 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2021-11-18T10:15:22.026 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-18T10:15:22.108 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2021-11-18T10:15:22.185 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-18T10:15:22.261 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "name": "gmeno", "state": "absent"} 2021-11-18T10:15:22.340 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-18T10:15:22.418 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "name": "alfredodeza", "state": "absent"} 2021-11-18T10:15:22.505 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-18T10:15:22.591 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2021-11-18T10:15:22.665 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-18T10:15:22.740 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2021-11-18T10:15:22.815 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-18T10:15:22.902 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2021-11-18T10:15:22.982 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-18T10:15:23.058 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2021-11-18T10:15:23.145 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-18T10:15:23.221 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2021-11-18T10:15:23.296 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-18T10:15:23.381 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2021-11-18T10:15:23.456 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-18T10:15:23.531 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2021-11-18T10:15:23.606 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-18T10:15:23.692 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2021-11-18T10:15:23.757 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-18T10:15:23.844 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2021-11-18T10:15:23.921 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-18T10:15:23.998 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2021-11-18T10:15:24.083 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-18T10:15:24.156 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2021-11-18T10:15:24.230 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-18T10:15:24.304 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2021-11-18T10:15:24.380 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-18T10:15:24.465 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2021-11-18T10:15:24.538 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-18T10:15:24.612 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "name": "jj", "state": "absent"} 2021-11-18T10:15:24.696 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-18T10:15:24.771 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "name": "amarangone", "state": "absent"} 2021-11-18T10:15:24.846 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-18T10:15:24.987 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "name": "oprypin", "state": "absent"} 2021-11-18T10:15:25.009 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-18T10:15:25.148 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "name": "adamyanova", "state": "absent"} 2021-11-18T10:15:25.160 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-18T10:15:25.296 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "name": "sbillah", "state": "absent"} 2021-11-18T10:15:25.307 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-18T10:15:25.462 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "name": "onyb", "state": "absent"} 2021-11-18T10:15:25.466 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-18T10:15:25.615 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-18T10:15:25.617 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "name": "jwilliamson", "state": "absent"} 2021-11-18T10:15:25.777 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "name": "kmroz", "state": "absent"} 2021-11-18T10:15:25.779 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-18T10:15:25.938 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} 2021-11-18T10:15:25.939 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "name": "shehbazj", "state": "absent"} 2021-11-18T10:15:26.105 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-18T10:15:26.122 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "state": "absent"} 2021-11-18T10:15:26.274 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "name": "asheplyakov", "state": "absent"} ok: [gibba005.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-18T10:15:26.427 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "name": "liupan", "state": "absent"} 2021-11-18T10:15:26.428 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-18T10:15:26.595 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} ok: [gibba019.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "name": "adeza", "state": "absent"} 2021-11-18T10:15:26.746 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-18T10:15:26.755 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "name": "pranith", "state": "absent"} 2021-11-18T10:15:26.897 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-18T10:15:26.920 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "name": "dorinda", "state": "absent"} 2021-11-18T10:15:27.080 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=zyan) => {"ansible_loop_var": "item", "changed": false, "item": "zyan", "name": "zyan", "state": "absent"} 2021-11-18T10:15:27.239 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=jdillaman) => {"ansible_loop_var": "item", "changed": false, "item": "jdillaman", "name": "jdillaman", "state": "absent"} 2021-11-18T10:15:28.217 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-11-18T10:15:28.661 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item=davidz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "davidz", "name": "davidz", "remove": false, "state": "absent"} 2021-11-18T10:15:29.597 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-11-18T10:15:30.187 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item=wusui) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "wusui", "name": "wusui", "remove": false, "state": "absent"} 2021-11-18T10:15:30.997 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-11-18T10:15:31.623 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item=nwatkins) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "nwatkins", "name": "nwatkins", "remove": false, "state": "absent"} 2021-11-18T10:15:32.348 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-11-18T10:15:32.990 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item=sidharthanup) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sidharthanup", "name": "sidharthanup", "remove": false, "state": "absent"} 2021-11-18T10:15:33.784 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-11-18T10:15:34.357 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item=varsha) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "varsha", "name": "varsha", "remove": false, "state": "absent"} 2021-11-18T10:15:35.080 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-11-18T10:15:35.239 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-18T10:15:35.386 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-18T10:15:35.545 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-18T10:15:35.692 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-18T10:15:35.767 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item=hmunjulu) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "hmunjulu", "name": "hmunjulu", "remove": false, "state": "absent"} 2021-11-18T10:15:35.852 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-18T10:15:35.927 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2021-11-18T10:15:36.001 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-18T10:15:36.077 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2021-11-18T10:15:36.151 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-18T10:15:36.236 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2021-11-18T10:15:36.310 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-18T10:15:36.384 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2021-11-18T10:15:36.458 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-18T10:15:36.544 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2021-11-18T10:15:36.609 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-18T10:15:36.667 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:36 +0000 (0:00:15.973) 0:01:22.751 ***** 2021-11-18T10:15:36.706 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2021-11-18T10:15:36.857 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2021-11-18T10:15:37.005 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "name": "fche", "state": "absent"} 2021-11-18T10:15:37.126 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-18T10:15:37.128 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637230536.7613056-2777-181135075394932/source", "state": "file", "uid": 0} 2021-11-18T10:15:37.149 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:37 +0000 (0:00:00.482) 0:01:23.233 ***** 2021-11-18T10:15:37.166 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-18T10:15:37.169 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "name": "jbainbri", "state": "absent"} 2021-11-18T10:15:37.220 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-18T10:15:37.222 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => { "msg": "Host gibba005.front.sepia.ceph.com is running CentOS 8.3 (n/a)" } 2021-11-18T10:15:37.243 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:37 +0000 (0:00:00.093) 0:01:23.327 ***** 2021-11-18T10:15:37.312 INFO:teuthology.task.ansible.out: TASK [Remove revoked users] **************************************************** 2021-11-18T10:15:37.314 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "name": "kdhananj", "state": "absent"} 2021-11-18T10:15:37.352 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-18T10:15:37.354 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-11-18T10:15:37.377 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:37 +0000 (0:00:00.134) 0:01:23.461 ***** 2021-11-18T10:15:37.399 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:37 +0000 (0:00:00.021) 0:01:23.482 ***** 2021-11-18T10:15:37.449 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-11-18T10:15:37.451 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:37.472 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:37 +0000 (0:00:00.073) 0:01:23.555 ***** 2021-11-18T10:15:37.733 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-18T10:15:37.735 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.057151", "end": "2021-11-18 10:15:37.711744", "rc": 0, "start": "2021-11-18 10:15:37.654593", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-18T10:15:37.756 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:37 +0000 (0:00:00.284) 0:01:23.840 ***** 2021-11-18T10:15:37.827 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:37.850 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:37 +0000 (0:00:00.094) 0:01:23.934 ***** 2021-11-18T10:15:37.867 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-11-18T10:15:37.869 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "checksum": "b3b89f3dabc35f78585fcbe6afcac330df9308f6", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "69c3df528743245bb36ff3b8fc484a02", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637230537.4916654-2932-5468116546925/source", "state": "file", "uid": 0} 2021-11-18T10:15:37.893 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:37 +0000 (0:00:00.042) 0:01:23.976 ***** 2021-11-18T10:15:37.920 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-11-18T10:15:37.922 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:37.946 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:37 +0000 (0:00:00.052) 0:01:24.029 ***** 2021-11-18T10:15:37.963 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-11-18T10:15:37.966 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => { "msg": "Host gibba019.front.sepia.ceph.com is running CentOS 8.3 (n/a)" } 2021-11-18T10:15:37.987 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:37 +0000 (0:00:00.042) 0:01:24.071 ***** 2021-11-18T10:15:38.016 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-18T10:15:38.018 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.040 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.052) 0:01:24.124 ***** 2021-11-18T10:15:38.069 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-11-18T10:15:38.071 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2021-11-18T10:15:38.094 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.053) 0:01:24.177 ***** 2021-11-18T10:15:38.122 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.146 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.052) 0:01:24.230 ***** 2021-11-18T10:15:38.165 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.191 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.044) 0:01:24.274 ***** 2021-11-18T10:15:38.232 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.255 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.064) 0:01:24.338 ***** 2021-11-18T10:15:38.342 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-18T10:15:38.344 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.364 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.109) 0:01:24.448 ***** 2021-11-18T10:15:38.456 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [gibba005.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-18T10:15:38.477 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.112) 0:01:24.561 ***** 2021-11-18T10:15:38.484 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-11-18T10:15:38.486 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.071900", "end": "2021-11-18 10:15:38.447529", "rc": 0, "start": "2021-11-18 10:15:38.375629", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-11-18T10:15:38.509 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.031) 0:01:24.592 ***** 2021-11-18T10:15:38.546 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-11-18T10:15:38.548 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.576 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.065) 0:01:24.657 ***** 2021-11-18T10:15:38.594 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-11-18T10:15:38.596 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.620 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.045) 0:01:24.703 ***** 2021-11-18T10:15:38.647 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-11-18T10:15:38.649 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.671 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.051) 0:01:24.755 ***** 2021-11-18T10:15:38.691 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-11-18T10:15:38.693 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.715 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.043) 0:01:24.798 ***** 2021-11-18T10:15:38.716 INFO:teuthology.task.ansible.out: 2021-11-18T10:15:38.743 INFO:teuthology.task.ansible.out: TASK [common : Set the releasever] ********************************************* 2021-11-18T10:15:38.745 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.771 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.056) 0:01:24.855 ***** 2021-11-18T10:15:38.791 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-11-18T10:15:38.793 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.815 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.044) 0:01:24.899 ***** 2021-11-18T10:15:38.842 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-11-18T10:15:38.844 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-18T10:15:38.867 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.051) 0:01:24.950 ***** 2021-11-18T10:15:38.885 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.911 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.043) 0:01:24.994 ***** 2021-11-18T10:15:38.938 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-18T10:15:38.940 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:38.962 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:38 +0000 (0:00:00.051) 0:01:25.046 ***** 2021-11-18T10:15:38.980 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-11-18T10:15:38.982 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.004 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.041) 0:01:25.088 ***** 2021-11-18T10:15:39.032 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-18T10:15:39.057 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.052) 0:01:25.140 ***** 2021-11-18T10:15:39.075 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-11-18T10:15:39.077 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.101 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.044) 0:01:25.185 ***** 2021-11-18T10:15:39.103 INFO:teuthology.task.ansible.out: 2021-11-18T10:15:39.130 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-18T10:15:39.131 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.157 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.055) 0:01:25.241 ***** 2021-11-18T10:15:39.186 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** skipping: [gibba019.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-18T10:15:39.188 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-18T10:15:39.211 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.054) 0:01:25.295 ***** 2021-11-18T10:15:39.230 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-18T10:15:39.232 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.255 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.043) 0:01:25.338 ***** 2021-11-18T10:15:39.283 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-11-18T10:15:39.285 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.307 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.052) 0:01:25.391 ***** 2021-11-18T10:15:39.334 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-11-18T10:15:39.336 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.359 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.051) 0:01:25.442 ***** 2021-11-18T10:15:39.389 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.414 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.054) 0:01:25.496 ***** 2021-11-18T10:15:39.432 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-18T10:15:39.433 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.459 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.045) 0:01:25.542 ***** 2021-11-18T10:15:39.488 INFO:teuthology.task.ansible.out: 2021-11-18T10:15:39.490 INFO:teuthology.task.ansible.out:TASK [common : Set the releasever] ********************************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.513 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.054) 0:01:25.597 ***** 2021-11-18T10:15:39.530 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-11-18T10:15:39.532 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-18T10:15:39.556 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.042) 0:01:25.639 ***** 2021-11-18T10:15:39.596 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-11-18T10:15:39.598 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-18T10:15:39.619 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.063) 0:01:25.702 ***** 2021-11-18T10:15:39.636 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-18T10:15:39.637 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.660 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.041) 0:01:25.743 ***** 2021-11-18T10:15:39.689 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-11-18T10:15:39.690 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.712 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.052) 0:01:25.796 ***** 2021-11-18T10:15:39.730 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-11-18T10:15:39.732 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.756 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.043) 0:01:25.839 ***** 2021-11-18T10:15:39.797 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-18T10:15:39.825 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.069) 0:01:25.909 ***** 2021-11-18T10:15:39.833 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-11-18T10:15:39.834 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.859 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.033) 0:01:25.942 ***** 2021-11-18T10:15:39.913 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-11-18T10:15:39.914 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.941 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.081) 0:01:26.024 ***** 2021-11-18T10:15:39.947 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-11-18T10:15:39.949 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:39.973 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:39 +0000 (0:00:00.032) 0:01:26.057 ***** 2021-11-18T10:15:40.011 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-11-18T10:15:40.013 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.036 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.062) 0:01:26.119 ***** 2021-11-18T10:15:40.066 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-18T10:15:40.068 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.090 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.054) 0:01:26.174 ***** 2021-11-18T10:15:40.108 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-11-18T10:15:40.110 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.133 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.042) 0:01:26.216 ***** 2021-11-18T10:15:40.162 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-18T10:15:40.164 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.187 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.054) 0:01:26.271 ***** 2021-11-18T10:15:40.205 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-11-18T10:15:40.207 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.229 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.041) 0:01:26.313 ***** 2021-11-18T10:15:40.258 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-11-18T10:15:40.259 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-18T10:15:40.284 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.054) 0:01:26.368 ***** 2021-11-18T10:15:40.303 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-11-18T10:15:40.328 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.044) 0:01:26.412 ***** 2021-11-18T10:15:40.357 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-11-18T10:15:40.359 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.384 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.056) 0:01:26.468 ***** 2021-11-18T10:15:40.402 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-18T10:15:40.404 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.426 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.042) 0:01:26.510 ***** 2021-11-18T10:15:40.455 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-11-18T10:15:40.457 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.479 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.052) 0:01:26.563 ***** 2021-11-18T10:15:40.518 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.542 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.063) 0:01:26.626 ***** 2021-11-18T10:15:40.623 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.645 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.102) 0:01:26.729 ***** 2021-11-18T10:15:40.707 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-11-18T10:15:40.709 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-18T10:15:40.732 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.086) 0:01:26.815 ***** 2021-11-18T10:15:40.741 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-11-18T10:15:40.742 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.776 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.044) 0:01:26.859 ***** 2021-11-18T10:15:40.860 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-11-18T10:15:40.862 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.885 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.109) 0:01:26.969 ***** 2021-11-18T10:15:40.970 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-11-18T10:15:40.972 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:40.992 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:40 +0000 (0:00:00.106) 0:01:27.076 ***** 2021-11-18T10:15:41.073 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-11-18T10:15:41.134 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} Thursday 18 November 2021 10:15:41 +0000 (0:00:00.124) 0:01:27.200 ***** 2021-11-18T10:15:41.207 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:41.236 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:41 +0000 (0:00:00.119) 0:01:27.320 ***** 2021-11-18T10:15:41.319 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:41.343 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:41 +0000 (0:00:00.107) 0:01:27.427 ***** 2021-11-18T10:15:41.361 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-18T10:15:41.363 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-11-18T10:15:41.585 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-11-18T10:15:41.586 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-18T10:15:41.607 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:41 +0000 (0:00:00.264) 0:01:27.691 ***** 2021-11-18T10:15:41.731 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-18T10:15:41.733 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-11-18T10:15:41.758 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:41 +0000 (0:00:00.150) 0:01:27.842 ***** 2021-11-18T10:15:42.070 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2021-11-18T10:15:42.218 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [gibba005.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-11-18T10:15:42.445 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-11-18T10:15:42.447 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2021-11-18T10:15:42.470 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:42 +0000 (0:00:00.712) 0:01:28.554 ***** 2021-11-18T10:15:42.583 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-18T10:15:42.585 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-11-18T10:15:42.610 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:42 +0000 (0:00:00.139) 0:01:28.694 ***** 2021-11-18T10:15:42.701 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-18T10:15:42.703 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:42.725 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:42 +0000 (0:00:00.114) 0:01:28.808 ***** 2021-11-18T10:15:42.807 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-18T10:15:42.808 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:42.830 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:42 +0000 (0:00:00.105) 0:01:28.913 ***** 2021-11-18T10:15:42.923 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:42.946 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:42 +0000 (0:00:00.116) 0:01:29.030 ***** 2021-11-18T10:15:42.955 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-18T10:15:42.957 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2021-11-18T10:15:43.020 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.042 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.095) 0:01:29.126 ***** 2021-11-18T10:15:43.138 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-18T10:15:43.140 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.166 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.124) 0:01:29.250 ***** 2021-11-18T10:15:43.246 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-18T10:15:43.248 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.271 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.104) 0:01:29.354 ***** 2021-11-18T10:15:43.310 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-11-18T10:15:43.312 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2021-11-18T10:15:43.341 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.070) 0:01:29.424 ***** 2021-11-18T10:15:43.350 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-11-18T10:15:43.351 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.377 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.035) 0:01:29.460 ***** 2021-11-18T10:15:43.416 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-11-18T10:15:43.418 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.442 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.065) 0:01:29.526 ***** 2021-11-18T10:15:43.449 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-11-18T10:15:43.450 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.474 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.031) 0:01:29.558 ***** 2021-11-18T10:15:43.534 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-18T10:15:43.536 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.557 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.082) 0:01:29.641 ***** 2021-11-18T10:15:43.564 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-18T10:15:43.566 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.590 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.032) 0:01:29.673 ***** 2021-11-18T10:15:43.618 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-11-18T10:15:43.620 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.643 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.053) 0:01:29.726 ***** 2021-11-18T10:15:43.661 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.685 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.042) 0:01:29.769 ***** 2021-11-18T10:15:43.713 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-11-18T10:15:43.715 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.739 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.053) 0:01:29.822 ***** 2021-11-18T10:15:43.809 INFO:teuthology.task.ansible.out: TASK [common : Mask sleep units] *********************************************** 2021-11-18T10:15:43.811 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "sleep.target", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.821 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=suspend.target) => {"ansible_loop_var": "item", "changed": false, "item": "suspend.target", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.823 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=hibernate.target) => {"ansible_loop_var": "item", "changed": false, "item": "hibernate.target", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.832 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=hybrid-sleep.target) => {"ansible_loop_var": "item", "changed": false, "item": "hybrid-sleep.target", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.857 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.118) 0:01:29.941 ***** 2021-11-18T10:15:43.929 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-11-18T10:15:43.930 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:43.956 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:43 +0000 (0:00:00.098) 0:01:30.040 ***** 2021-11-18T10:15:44.025 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-11-18T10:15:44.027 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:44.047 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:44 +0000 (0:00:00.091) 0:01:30.131 ***** 2021-11-18T10:15:44.117 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:44.140 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:44 +0000 (0:00:00.092) 0:01:30.224 ***** 2021-11-18T10:15:44.209 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-11-18T10:15:44.211 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:44.232 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:44 +0000 (0:00:00.092) 0:01:30.316 ***** 2021-11-18T10:15:44.302 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-11-18T10:15:44.304 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:44.329 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:44 +0000 (0:00:00.096) 0:01:30.413 ***** 2021-11-18T10:15:44.512 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-11-18T10:15:44.514 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.681872", "end": "2021-11-18 10:15:44.500617", "rc": 0, "start": "2021-11-18 10:15:43.818745", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.029583", "end": "2021-11-18 10:15:44.500568", "rc": 0, "start": "2021-11-18 10:15:44.470985", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:15:44.536 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:44 +0000 (0:00:00.206) 0:01:30.620 ***** 2021-11-18T10:15:44.558 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:44 +0000 (0:00:00.021) 0:01:30.642 ***** 2021-11-18T10:15:48.040 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-11-18T10:15:48.042 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:15:48.065 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:48 +0000 (0:00:03.506) 0:01:34.149 ***** 2021-11-18T10:15:48.135 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-11-18T10:15:48.137 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:48.158 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:48 +0000 (0:00:00.093) 0:01:34.242 ***** 2021-11-18T10:15:48.218 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-11-18T10:15:48.220 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:15:48.240 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:48 +0000 (0:00:00.081) 0:01:34.324 ***** 2021-11-18T10:15:48.247 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-11-18T10:15:48.249 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:48.272 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:48 +0000 (0:00:00.031) 0:01:34.356 ***** 2021-11-18T10:15:48.311 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-11-18T10:15:48.313 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:48.335 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:48 +0000 (0:00:00.063) 0:01:34.419 ***** 2021-11-18T10:15:48.343 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-18T10:15:48.344 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:48.375 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:48 +0000 (0:00:00.039) 0:01:34.459 ***** 2021-11-18T10:15:48.406 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2021-11-18T10:15:48.408 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:48.442 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:48 +0000 (0:00:00.066) 0:01:34.525 ***** 2021-11-18T10:15:48.463 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-11-18T10:15:48.465 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:48.487 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:48 +0000 (0:00:00.045) 0:01:34.571 ***** 2021-11-18T10:15:48.506 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-11-18T10:15:48.508 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:48.531 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:48 +0000 (0:00:00.043) 0:01:34.615 ***** 2021-11-18T10:15:48.602 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:48.624 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:48 +0000 (0:00:00.092) 0:01:34.708 ***** 2021-11-18T10:15:48.915 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-11-18T10:15:48.917 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-11-18T10:15:48.939 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:48 +0000 (0:00:00.314) 0:01:35.022 ***** 2021-11-18T10:15:49.041 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2021-11-18T10:15:49.064 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:49 +0000 (0:00:00.125) 0:01:35.148 ***** 2021-11-18T10:15:50.100 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-11-18T10:15:50.102 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:15:50.127 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:50 +0000 (0:00:01.063) 0:01:36.211 ***** 2021-11-18T10:15:50.219 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:15:50.246 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:50 +0000 (0:00:00.118) 0:01:36.329 ***** 2021-11-18T10:15:50.584 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-11-18T10:15:50.586 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-11-18T10:15:50.693 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2021-11-18T10:15:50.951 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-11-18T10:15:51.047 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2021-11-18T10:15:51.295 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-11-18T10:15:51.320 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:51 +0000 (0:00:01.074) 0:01:37.404 ***** 2021-11-18T10:15:51.411 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2021-11-18T10:15:51.439 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:51 +0000 (0:00:00.118) 0:01:37.522 ***** 2021-11-18T10:15:51.477 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-11-18T10:15:51.479 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-18T10:15:51.501 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:51 +0000 (0:00:00.061) 0:01:37.584 ***** 2021-11-18T10:15:51.591 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-18T10:15:51.615 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:51 +0000 (0:00:00.114) 0:01:37.699 ***** 2021-11-18T10:15:51.906 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-18T10:15:51.907 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-11-18T10:15:52.036 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 13355, "state": "file", "uid": 0} 2021-11-18T10:15:52.247 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-11-18T10:15:52.374 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2021-11-18T10:15:52.586 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-11-18T10:15:52.647 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:52 +0000 (0:00:01.031) 0:01:38.730 ***** 2021-11-18T10:15:52.686 INFO:teuthology.task.ansible.out: TASK [common : Include dnf_system vars] **************************************** 2021-11-18T10:15:52.688 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/dnf_systems.yml"], "changed": false} 2021-11-18T10:15:52.713 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:52 +0000 (0:00:00.066) 0:01:38.797 ***** 2021-11-18T10:15:52.723 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-11-18T10:15:52.725 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "2fbc67b36d59f66fc2621f3ca2dcf60dea2167a5", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3612, "state": "file", "uid": 0} 2021-11-18T10:15:52.754 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:52 +0000 (0:00:00.040) 0:01:38.837 ***** 2021-11-18T10:15:52.796 INFO:teuthology.task.ansible.out: TASK [common : Include dnf_system vars] **************************************** ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/dnf_systems.yml"], "changed": false} 2021-11-18T10:15:52.818 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:52 +0000 (0:00:00.064) 0:01:38.902 ***** 2021-11-18T10:15:52.878 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-18T10:15:52.880 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-11-18T10:15:52.906 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:52 +0000 (0:00:00.088) 0:01:38.990 ***** 2021-11-18T10:15:52.945 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-18T10:15:52.947 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:52.957 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:52.968 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:52.979 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:52.981 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-11-18T10:15:52.983 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2021-11-18T10:15:53.012 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:53 +0000 (0:00:00.105) 0:01:39.096 ***** 2021-11-18T10:15:53.032 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:53 +0000 (0:00:00.019) 0:01:39.115 ***** 2021-11-18T10:15:53.070 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-11-18T10:15:53.072 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:53.081 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:53.092 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:53.103 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:53.126 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:53 +0000 (0:00:00.094) 0:01:39.210 ***** 2021-11-18T10:15:54.105 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-18T10:15:54.106 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:15:54.127 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:54 +0000 (0:00:01.001) 0:01:40.211 ***** 2021-11-18T10:15:54.156 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-18T10:15:54.158 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:54.180 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:54 +0000 (0:00:00.052) 0:01:40.263 ***** 2021-11-18T10:15:54.279 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-11-18T10:15:54.281 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:15:54.303 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:54 +0000 (0:00:00.123) 0:01:40.387 ***** 2021-11-18T10:15:54.330 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (non-RHEL/CentOS)] ******** 2021-11-18T10:15:54.332 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:54.354 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:54 +0000 (0:00:00.051) 0:01:40.438 ***** 2021-11-18T10:15:54.561 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-11-18T10:15:54.563 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-11-18T10:15:54.584 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:54 +0000 (0:00:00.229) 0:01:40.668 ***** 2021-11-18T10:15:54.737 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2021-11-18T10:15:54.761 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:54 +0000 (0:00:00.176) 0:01:40.844 ***** 2021-11-18T10:15:54.967 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-11-18T10:15:54.969 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-11-18T10:15:54.992 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:54 +0000 (0:00:00.230) 0:01:41.075 ***** 2021-11-18T10:15:55.030 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-18T10:15:55.032 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:55.054 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:55 +0000 (0:00:00.061) 0:01:41.137 ***** 2021-11-18T10:15:55.155 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2021-11-18T10:15:55.179 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:55 +0000 (0:00:00.125) 0:01:41.263 ***** 2021-11-18T10:15:55.218 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-11-18T10:15:55.220 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-18T10:15:55.242 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:55 +0000 (0:00:00.062) 0:01:41.326 ***** 2021-11-18T10:15:55.250 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-11-18T10:15:55.251 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:55.252 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2021-11-18T10:15:55.288 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:55 +0000 (0:00:00.045) 0:01:41.372 ***** 2021-11-18T10:15:55.453 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-18T10:15:55.455 INFO:teuthology.task.ansible.out:fatal: [gibba005.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-18T10:15:55.477 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:55 +0000 (0:00:00.188) 0:01:41.560 ***** 2021-11-18T10:15:55.497 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:55 +0000 (0:00:00.020) 0:01:41.581 ***** 2021-11-18T10:15:55.515 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-18T10:15:55.517 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:55.542 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:55 +0000 (0:00:00.045) 0:01:41.626 ***** 2021-11-18T10:15:55.707 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-11-18T10:15:55.709 INFO:teuthology.task.ansible.out:fatal: [gibba019.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2021-11-18T10:15:55.731 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:55 +0000 (0:00:00.188) 0:01:41.815 ***** 2021-11-18T10:15:55.769 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-11-18T10:15:55.771 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:15:55.793 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:55 +0000 (0:00:00.061) 0:01:41.876 ***** 2021-11-18T10:15:55.926 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-11-18T10:15:55.928 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-11-18T10:15:55.951 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:55 +0000 (0:00:00.158) 0:01:42.034 ***** 2021-11-18T10:15:56.181 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2021-11-18T10:15:56.182 INFO:teuthology.task.ansible.out: 2021-11-18T10:15:56.205 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:56 +0000 (0:00:00.254) 0:01:42.289 ***** 2021-11-18T10:15:56.558 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-11-18T10:15:56.560 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1391", "ExecMainStartTimestamp": "Thu 2021-11-18 10:13:52 UTC", "ExecMainStartTimestampMonotonic": "19471323", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Thu 2021-11-18 10:13:52 UTC] ; stop_time=[n/a] ; pid=1391 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Li 2021-11-18T10:15:56.562 INFO:teuthology.task.ansible.out:mitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127293", "LimitNPROCSoft": "127293", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127293", "LimitSIGPENDINGSoft": "127293", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1391", "MemoryAccounting": "yes", "MemoryCurrent": "671744", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203668", "TimeoutStart 2021-11-18T10:15:56.563 INFO:teuthology.task.ansible.out:USec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "988", "UMask": "0022", "WatchdogTimestamp": "Thu 2021-11-18 10:13:52 UTC", "WatchdogTimestampMonotonic": "19471338", "WatchdogUSec": "0"}} ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/nrpe (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1383", "ExecMainStartTimestamp": "Thu 2021-11-18 10:13:52 UTC", "ExecMainStartTimestampMonotonic": "18841998", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Thu 2021-11-18 10:13:52 UTC] ; stop_time=[n/a] ; pid=1383 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "984", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgress 2021-11-18T10:15:56.565 INFO:teuthology.task.ansible.out:Bytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127293", "LimitNPROCSoft": "127293", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127293", "LimitSIGPENDINGSoft": "127293", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1383", "MemoryAccounting": "yes", "MemoryCurrent": "671744", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "PIDFile": "/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "on-abort", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "S 2021-11-18T10:15:56.567 INFO:teuthology.task.ansible.out:yslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203668", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Type": "simple", "UID": "988", "UMask": "0022", "WatchdogTimestamp": "Thu 2021-11-18 10:13:52 UTC", "WatchdogTimestampMonotonic": "18842014", "WatchdogUSec": "0"}} 2021-11-18T10:15:56.584 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:56 +0000 (0:00:00.378) 0:01:42.667 ***** 2021-11-18T10:15:56.604 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:56 +0000 (0:00:00.020) 0:01:42.688 ***** 2021-11-18T10:15:56.736 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-11-18T10:15:56.738 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001130", "end": "2021-11-18 10:15:56.721341", "rc": 0, "start": "2021-11-18 10:15:56.720211", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-11-18T10:15:56.760 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:56 +0000 (0:00:00.155) 0:01:42.843 ***** 2021-11-18T10:15:56.767 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001151", "end": "2021-11-18 10:15:56.743675", "rc": 0, "start": "2021-11-18 10:15:56.742524", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2021-11-18T10:15:56.791 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:56 +0000 (0:00:00.031) 0:01:42.875 ***** 2021-11-18T10:15:57.844 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-11-18T10:15:57.846 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:15:57.873 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:57 +0000 (0:00:01.081) 0:01:43.956 ***** 2021-11-18T10:15:57.912 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:15:57.936 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:15:57 +0000 (0:00:00.062) 0:01:44.019 ***** 2021-11-18T10:16:23.884 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-11-18T10:16:23.886 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-80.el8.noarch", "Installed: selinux-policy-3.14.3-80.el8.noarch", "Removed: selinux-policy-3.14.3-67.el8.noarch", "Removed: selinux-policy-targeted-3.14.3-67.el8.noarch"]} 2021-11-18T10:16:23.908 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:23 +0000 (0:00:25.972) 0:02:09.991 ***** 2021-11-18T10:16:24.520 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-11-18T10:16:24.542 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:24 +0000 (0:00:00.634) 0:02:10.626 ***** 2021-11-18T10:16:24.762 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-11-18T10:16:24.763 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: selinux-policy-targeted-3.14.3-80.el8.noarch", "Installed: selinux-policy-3.14.3-80.el8.noarch", "Removed: selinux-policy-3.14.3-67.el8.noarch", "Removed: selinux-policy-targeted-3.14.3-67.el8.noarch"]} 2021-11-18T10:16:24.785 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:24 +0000 (0:00:00.242) 0:02:10.869 ***** 2021-11-18T10:16:25.148 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-11-18T10:16:25.150 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2021-11-18T10:16:25.172 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:25 +0000 (0:00:00.386) 0:02:11.255 ***** 2021-11-18T10:16:34.225 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-18T10:16:34.227 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:09.525461", "end": "2021-11-18 10:16:34.212125", "failed_when_result": false, "rc": 0, "start": "2021-11-18 10:16:24.686664", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-11-18T10:16:34.249 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:34 +0000 (0:00:09.077) 0:02:20.333 ***** 2021-11-18T10:16:34.630 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-18T10:16:34.631 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-11-18T10:16:34.652 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:34 +0000 (0:00:00.402) 0:02:20.736 ***** 2021-11-18T10:16:34.829 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-11-18T10:16:34.831 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.012068", "end": "2021-11-18 10:16:34.811527", "rc": 0, "start": "2021-11-18 10:16:34.799459", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:16:34.852 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:34 +0000 (0:00:00.200) 0:02:20.936 ***** 2021-11-18T10:16:34.883 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-11-18T10:16:34.885 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:09.541971", "end": "2021-11-18 10:16:34.870027", "failed_when_result": false, "rc": 0, "start": "2021-11-18 10:16:25.328056", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2021-11-18T10:16:34.911 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:34 +0000 (0:00:00.058) 0:02:20.995 ***** 2021-11-18T10:16:34.912 INFO:teuthology.task.ansible.out: 2021-11-18T10:16:35.027 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.001379", "end": "2021-11-18 10:16:35.006543", "rc": 0, "start": "2021-11-18 10:16:35.005164", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:16:35.051 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:35 +0000 (0:00:00.140) 0:02:21.135 ***** 2021-11-18T10:16:35.292 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-11-18T10:16:35.294 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2021-11-18T10:16:35.318 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:35 +0000 (0:00:00.266) 0:02:21.402 ***** 2021-11-18T10:16:35.493 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-11-18T10:16:35.495 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.014904", "end": "2021-11-18 10:16:35.474179", "rc": 0, "start": "2021-11-18 10:16:35.459275", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:16:35.516 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:35 +0000 (0:00:00.198) 0:02:21.600 ***** 2021-11-18T10:16:35.683 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-11-18T10:16:35.684 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.011006", "end": "2021-11-18 10:16:35.671104", "rc": 0, "start": "2021-11-18 10:16:35.660098", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:16:35.706 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:35 +0000 (0:00:00.189) 0:02:21.789 ***** 2021-11-18T10:16:44.694 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:09.485749", "end": "2021-11-18 10:16:44.676900", "rc": 0, "start": "2021-11-18 10:16:35.191151", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:16:44.717 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:44 +0000 (0:00:09.011) 0:02:30.801 ***** 2021-11-18T10:16:44.882 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-18T10:16:44.883 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-11-18T10:16:44.905 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:44 +0000 (0:00:00.188) 0:02:30.989 ***** 2021-11-18T10:16:44.944 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-18T10:16:44.946 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-11-18T10:16:44.967 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:44 +0000 (0:00:00.061) 0:02:31.051 ***** 2021-11-18T10:16:45.007 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-11-18T10:16:45.009 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-18T10:16:45.030 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.062) 0:02:31.114 ***** 2021-11-18T10:16:45.078 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-11-18T10:16:45.080 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"apache-arrow": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["redhat-lsb-core", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist", "CentOS-PowerTools-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}, "CentOS-PowerTools": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RP 2021-11-18T10:16:45.082 INFO:teuthology.task.ansible.out:M-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-11-18T10:16:45.102 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.072) 0:02:31.186 ***** 2021-11-18T10:16:45.141 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-11-18T10:16:45.143 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-18T10:16:45.165 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.062) 0:02:31.248 ***** 2021-11-18T10:16:45.319 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-11-18T10:16:45.321 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-11-18T10:16:45.345 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.180) 0:02:31.429 ***** 2021-11-18T10:16:45.481 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-11-18T10:16:45.483 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:09.614268", "end": "2021-11-18 10:16:45.460182", "rc": 0, "start": "2021-11-18 10:16:35.845914", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:16:45.506 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.160) 0:02:31.590 ***** 2021-11-18T10:16:45.513 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-18T10:16:45.515 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "name": "ubuntu", "state": "present", "system": false} 2021-11-18T10:16:45.538 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.032) 0:02:31.622 ***** 2021-11-18T10:16:45.540 INFO:teuthology.task.ansible.out: 2021-11-18T10:16:45.567 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-11-18T10:16:45.569 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:16:45.590 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.051) 0:02:31.674 ***** 2021-11-18T10:16:45.619 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-18T10:16:45.621 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:16:45.641 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.051) 0:02:31.725 ***** 2021-11-18T10:16:45.680 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-11-18T10:16:45.682 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2021-11-18T10:16:45.704 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.062) 0:02:31.787 ***** 2021-11-18T10:16:45.743 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-11-18T10:16:45.745 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "dash_stream": "", "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2021-11-18T10:16:45.766 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.062) 0:02:31.850 ***** 2021-11-18T10:16:45.804 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-11-18T10:16:45.805 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-18T10:16:45.827 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.060) 0:02:31.911 ***** 2021-11-18T10:16:45.834 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-11-18T10:16:45.835 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-11-18T10:16:45.860 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.033) 0:02:31.944 ***** 2021-11-18T10:16:45.871 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"apache-arrow": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ceph/python3-asyncssh"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["redhat-lsb-core", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb", "iozone"], "packages_to_upgrade": ["libgcrypt"], "yum_mirrorlists": ["CentOS-AppStream-mirrorlist", "CentOS-Base-mirrorlist", "CentOS-Extras-mirrorlist", "CentOS-PowerTools-mirrorlist"], "yum_repos": {"CentOS-AppStream": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}, "CentOS-Base": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}, "CentOS-Extras": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}, "Cen 2021-11-18T10:16:45.873 INFO:teuthology.task.ansible.out:tOS-PowerTools": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2021-11-18T10:16:45.897 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.036) 0:02:31.980 ***** 2021-11-18T10:16:45.936 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-11-18T10:16:45.938 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-11-18T10:16:45.959 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:45 +0000 (0:00:00.061) 0:02:32.042 ***** 2021-11-18T10:16:46.112 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-11-18T10:16:46.114 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2021-11-18T10:16:46.135 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:46 +0000 (0:00:00.175) 0:02:32.218 ***** 2021-11-18T10:16:46.287 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-11-18T10:16:46.289 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "name": "ubuntu", "state": "present", "system": false} 2021-11-18T10:16:46.310 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:46 +0000 (0:00:00.174) 0:02:32.393 ***** 2021-11-18T10:16:46.328 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-18T10:16:46.330 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-11-18T10:16:46.351 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:46 +0000 (0:00:00.041) 0:02:32.435 ***** 2021-11-18T10:16:46.359 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-11-18T10:16:46.360 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:16:46.382 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:46 +0000 (0:00:00.031) 0:02:32.466 ***** 2021-11-18T10:16:46.390 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-18T10:16:46.391 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba005"}, "changed": false} 2021-11-18T10:16:46.417 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:46 +0000 (0:00:00.034) 0:02:32.501 ***** 2021-11-18T10:16:46.425 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-11-18T10:16:46.428 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:16:46.450 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:46 +0000 (0:00:00.032) 0:02:32.533 ***** 2021-11-18T10:16:46.640 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [gibba019.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2021-11-18T10:16:46.661 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:46 +0000 (0:00:00.211) 0:02:32.745 ***** 2021-11-18T10:16:47.131 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-11-18T10:16:47.133 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2021-11-18T10:16:47.154 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:47 +0000 (0:00:00.493) 0:02:33.238 ***** 2021-11-18T10:16:47.193 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-11-18T10:16:47.194 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "gibba019"}, "changed": false} 2021-11-18T10:16:47.215 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:47 +0000 (0:00:00.060) 0:02:33.299 ***** 2021-11-18T10:16:47.285 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-18T10:16:47.287 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba005.front.sepia.ceph.com", "ansible_hostname": "gibba005", "ansible_nodename": "gibba005"}, "changed": true, "name": "gibba005"} 2021-11-18T10:16:47.309 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:47 +0000 (0:00:00.093) 0:02:33.392 ***** 2021-11-18T10:16:47.685 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-18T10:16:47.687 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-11-18T10:16:47.708 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:47 +0000 (0:00:00.399) 0:02:33.792 ***** 2021-11-18T10:16:47.728 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-11-18T10:16:47.730 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "gibba019.front.sepia.ceph.com", "ansible_hostname": "gibba019", "ansible_nodename": "gibba019"}, "changed": true, "name": "gibba019"} 2021-11-18T10:16:47.752 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:47 +0000 (0:00:00.043) 0:02:33.836 ***** 2021-11-18T10:16:48.075 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-18T10:16:48.077 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-11-18T10:16:48.102 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:48 +0000 (0:00:00.349) 0:02:34.186 ***** 2021-11-18T10:16:48.134 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-11-18T10:16:48.136 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2021-11-18T10:16:48.158 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:48 +0000 (0:00:00.056) 0:02:34.242 ***** 2021-11-18T10:16:48.537 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-11-18T10:16:48.539 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2021-11-18T10:16:48.566 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:48 +0000 (0:00:00.407) 0:02:34.650 ***** 2021-11-18T10:16:48.575 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-11-18T10:16:48.577 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-18T10:16:48.605 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:48 +0000 (0:00:00.038) 0:02:34.689 ***** 2021-11-18T10:16:49.008 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-11-18T10:16:49.034 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:49 +0000 (0:00:00.428) 0:02:35.118 ***** 2021-11-18T10:16:49.042 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-18T10:16:49.043 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-11-18T10:16:49.068 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:49 +0000 (0:00:00.033) 0:02:35.152 ***** 2021-11-18T10:16:49.235 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-18T10:16:49.237 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-18T10:16:49.259 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:49 +0000 (0:00:00.190) 0:02:35.342 ***** 2021-11-18T10:16:49.414 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-18T10:16:49.416 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-11-18T10:16:49.437 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:49 +0000 (0:00:00.178) 0:02:35.521 ***** 2021-11-18T10:16:49.445 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-11-18T10:16:49.447 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2021-11-18T10:16:49.471 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:49 +0000 (0:00:00.033) 0:02:35.555 ***** 2021-11-18T10:16:49.617 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-18T10:16:49.619 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1254, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-18T10:16:49.640 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:49 +0000 (0:00:00.168) 0:02:35.724 ***** 2021-11-18T10:16:49.652 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-18T10:16:49.654 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-18T10:16:49.677 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:49 +0000 (0:00:00.036) 0:02:35.761 ***** 2021-11-18T10:16:49.841 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-18T10:16:49.843 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2021-11-18T10:16:49.863 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:49 +0000 (0:00:00.186) 0:02:35.947 ***** 2021-11-18T10:16:50.026 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-18T10:16:50.028 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-11-18T10:16:50.049 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:50 +0000 (0:00:00.186) 0:02:36.133 ***** 2021-11-18T10:16:50.057 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [gibba019.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1254, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-11-18T10:16:50.082 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:50 +0000 (0:00:00.032) 0:02:36.166 ***** 2021-11-18T10:16:50.449 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-18T10:16:50.450 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-11-18T10:16:50.473 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:50 +0000 (0:00:00.390) 0:02:36.556 ***** 2021-11-18T10:16:50.491 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-18T10:16:50.493 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2021-11-18T10:16:50.516 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:50 +0000 (0:00:00.043) 0:02:36.599 ***** 2021-11-18T10:16:50.923 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-18T10:16:50.925 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2021-11-18T10:16:50.951 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:50 +0000 (0:00:00.435) 0:02:37.035 ***** 2021-11-18T10:16:52.666 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-18T10:16:52.667 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.036640", "end": "2021-11-18 10:16:52.649360", "rc": 0, "start": "2021-11-18 10:16:50.612720", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:16:52.690 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:52 +0000 (0:00:01.739) 0:02:38.774 ***** 2021-11-18T10:16:52.719 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-18T10:16:52.722 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:16:52.742 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:52 +0000 (0:00:00.051) 0:02:38.826 ***** 2021-11-18T10:16:52.770 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:16:52.772 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:16:52.793 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:52 +0000 (0:00:00.050) 0:02:38.877 ***** 2021-11-18T10:16:52.832 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-18T10:16:52.834 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8_stream.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8_stream.yml", "skip_reason": "Conditional result was False"} 2021-11-18T10:16:52.856 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:52 +0000 (0:00:00.063) 0:02:38.940 ***** 2021-11-18T10:16:53.148 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-18T10:16:53.149 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.035195", "end": "2021-11-18 10:16:53.129992", "rc": 0, "start": "2021-11-18 10:16:51.094797", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:16:53.176 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:53 +0000 (0:00:00.319) 0:02:39.259 ***** 2021-11-18T10:16:53.207 INFO:teuthology.task.ansible.out: TASK [testnode : Clean up Stream distro-provided repos] ************************ 2021-11-18T10:16:53.209 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:16:53.231 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:53 +0000 (0:00:00.055) 0:02:39.315 ***** 2021-11-18T10:16:53.251 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-18T10:16:53.253 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-11-18T10:16:53.263 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:16:53.265 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:16:53.288 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:53 +0000 (0:00:00.056) 0:02:39.371 ***** 2021-11-18T10:16:53.328 INFO:teuthology.task.ansible.out: TASK [testnode : Include CentOS Stream specific variables] ********************* 2021-11-18T10:16:53.329 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8_stream.yml) => {"ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8_stream.yml", "skip_reason": "Conditional result was False"} 2021-11-18T10:16:53.355 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:53 +0000 (0:00:00.067) 0:02:39.439 ***** 2021-11-18T10:16:53.603 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-18T10:16:53.605 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-11-18T10:16:53.758 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=CentOS-AppStream-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "aa5ad73629677ef17172417e50d2cdadccb7a3f2", "dest": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-AppStream-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-11-18T10:16:53.949 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-11-18T10:16:54.108 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=CentOS-Base-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "4ed3c0272e6c4ec99169cd68f0b43d40bdd4b296", "dest": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Base-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 380, "state": "file", "uid": 0} 2021-11-18T10:16:54.298 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=CentOS-PowerTools-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "20107eac0ba9a84b318fa5f29b02a387051bff98", "dest": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-PowerTools-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-11-18T10:16:54.324 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:54 +0000 (0:00:00.968) 0:02:40.407 ***** 2021-11-18T10:16:54.461 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=CentOS-Extras-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "a862f43d3b3c7b8b592aa7dce23a6d013ab20bc3", "dest": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-Extras-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 382, "state": "file", "uid": 0} 2021-11-18T10:16:54.727 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-18T10:16:54.729 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-11-18T10:16:54.802 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-11-18T10:16:54.804 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=CentOS-PowerTools-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "20107eac0ba9a84b318fa5f29b02a387051bff98", "dest": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "gid": 0, "group": "root", "item": "CentOS-PowerTools-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 397, "state": "file", "uid": 0} 2021-11-18T10:16:54.828 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:54 +0000 (0:00:00.504) 0:02:40.912 ***** 2021-11-18T10:16:55.141 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-18T10:16:55.143 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'apache-arrow', 'value': {'name': 'Apache Arrow', 'baseurl': 'https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch', 'enabled': 1, 'gpgcheck': 1}}) => {"ansible_loop_var": "item", "changed": true, "checksum": "86b924db6e383ddad921a207c09a708e6cca6a67", "dest": "/etc/yum.repos.d/apache-arrow.repo", "gid": 0, "group": "root", "item": {"key": "apache-arrow", "value": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}}, "md5sum": "183d0889f7213a1e38c7f48965d7549e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 215, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637230614.7603633-15042-129867446623992/source", "state": "file", "uid": 0} 2021-11-18T10:16:55.167 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:55 +0000 (0:00:00.338) 0:02:41.251 ***** 2021-11-18T10:16:55.248 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2021-11-18T10:16:55.581 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-18T10:16:55.583 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-11-18T10:16:55.657 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-11-18T10:16:55.659 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'apache-arrow', 'value': {'name': 'Apache Arrow', 'baseurl': 'https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch', 'enabled': 1, 'gpgcheck': 1}}) => {"ansible_loop_var": "item", "changed": true, "checksum": "86b924db6e383ddad921a207c09a708e6cca6a67", "dest": "/etc/yum.repos.d/apache-arrow.repo", "gid": 0, "group": "root", "item": {"key": "apache-arrow", "value": {"baseurl": "https://apache.jfrog.io/artifactory/arrow/centos/8/$basearch", "enabled": 1, "gpgcheck": 1, "name": "Apache Arrow"}}, "md5sum": "183d0889f7213a1e38c7f48965d7549e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 215, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1637230615.2773168-15144-127739442752354/source", "state": "file", "uid": 0} 2021-11-18T10:16:55.689 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:55 +0000 (0:00:00.521) 0:02:41.773 ***** 2021-11-18T10:16:55.946 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-18T10:16:55.949 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-11-18T10:16:56.117 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'key': 'CentOS-AppStream', 'value': {'name': 'CentOS-$releasever - AppStream', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "9b147c879e95cd23f3bbde027da102febcaad1a8", "dest": "/etc/yum.repos.d/CentOS-AppStream.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-AppStream", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-AppStream-mirrorlist", "name": "CentOS-$releasever - AppStream"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-AppStream.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 289, "state": "file", "uid": 0} 2021-11-18T10:16:56.310 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-11-18T10:16:56.469 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'key': 'CentOS-Base', 'value': {'name': 'CentOS-$releasever - Base', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Base-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "77e4590ed0ecec056fa44f4e65af60e110822b85", "dest": "/etc/yum.repos.d/CentOS-Base.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Base", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Base-mirrorlist", "name": "CentOS-$releasever - Base"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Base.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 274, "state": "file", "uid": 0} 2021-11-18T10:16:56.671 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'key': 'CentOS-PowerTools', 'value': {'name': 'CentOS-$releasever - PowerTools', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "76441d1028936932e965a46c12ad393f767201d3", "dest": "/etc/yum.repos.d/CentOS-PowerTools.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-PowerTools", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 292, "state": "file", "uid": 0} 2021-11-18T10:16:56.700 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:56 +0000 (0:00:01.010) 0:02:42.784 ***** 2021-11-18T10:16:56.845 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'key': 'CentOS-Extras', 'value': {'name': 'CentOS-$releasever - Extras', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-Extras-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2856826614c7f1cb9409228f6c41319a023ca754", "dest": "/etc/yum.repos.d/CentOS-Extras.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-Extras", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-Extras-mirrorlist", "name": "CentOS-$releasever - Extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-Extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 280, "state": "file", "uid": 0} 2021-11-18T10:16:57.077 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-18T10:16:57.079 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.198425", "end": "2021-11-18 10:16:57.057914", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-11-18 10:16:56.859489", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'comman 2021-11-18T10:16:57.080 INFO:teuthology.task.ansible.out:d_warnings=False' in ansible.cfg to get rid of this message. 2021-11-18T10:16:57.102 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:57 +0000 (0:00:00.402) 0:02:43.186 ***** 2021-11-18T10:16:57.206 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-11-18T10:16:57.208 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'key': 'CentOS-PowerTools', 'value': {'name': 'CentOS-$releasever - PowerTools', 'mirrorlist': 'file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist', 'gpgcheck': 1, 'enabled': 1, 'gpgkey': 'file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial'}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "76441d1028936932e965a46c12ad393f767201d3", "dest": "/etc/yum.repos.d/CentOS-PowerTools.repo", "gid": 0, "group": "root", "item": {"key": "CentOS-PowerTools", "value": {"enabled": 1, "gpgcheck": 1, "gpgkey": "file:///etc/pki/rpm-gpg/RPM-GPG-KEY-centosofficial", "mirrorlist": "file:///etc/yum.repos.d/CentOS-PowerTools-mirrorlist", "name": "CentOS-$releasever - PowerTools"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/CentOS-PowerTools.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 292, "state": "file", "uid": 0} 2021-11-18T10:16:57.234 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:57 +0000 (0:00:00.132) 0:02:43.318 ***** 2021-11-18T10:16:57.625 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-11-18T10:16:57.638 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item=ceph/python3-asyncssh) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ceph/python3-asyncssh"], "delta": "0:00:00.213652", "end": "2021-11-18 10:16:57.604617", "item": "ceph/python3-asyncssh", "rc": 0, "start": "2021-11-18 10:16:57.390965", "stderr": "Enabling a Copr repository. Please note that this repository is not part\nof the main distribution, and quality may vary.\n\nThe Fedora Project does not exercise any power over the contents of\nthis repository beyond the rules outlined in the Copr FAQ at\n,\nand packages are not held to any quality or security level.\n\nPlease do not file bug reports about these packages in Fedora\nBugzilla. In case of problems, contact the owner of this repository.", "stderr_lines": ["Enabling a Copr repository. Please note that this repository is not part", "of the main distribution, and quality may vary.", "", "The Fedora Project does not exercise any power over the contents of", "this repository beyond the rules outlined in the Copr FAQ at", ",", "and packages are not held to any quality or security level.", "", "Please do not file bug reports about these packages in Fedora", "Bugzilla. In case of problems, contact the owner of this repository."], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2021-11-18T10:16:57.649 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:57 +0000 (0:00:00.414) 0:02:43.733 ***** 2021-11-18T10:16:59.779 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:16:59.801 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:16:59 +0000 (0:00:02.152) 0:02:45.885 ***** 2021-11-18T10:17:00.197 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:17:00.219 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:00 +0000 (0:00:00.418) 0:02:46.303 ***** 2021-11-18T10:17:00.637 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-18T10:17:00.639 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/release.asc"} 2021-11-18T10:17:00.752 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/release.asc"} 2021-11-18T10:17:01.185 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/autobuild.asc"} 2021-11-18T10:17:01.386 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": true, "item": "https://download.ceph.com/keys/autobuild.asc"} 2021-11-18T10:17:02.441 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": true, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS"} 2021-11-18T10:17:02.467 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:02 +0000 (0:00:02.247) 0:02:48.550 ***** 2021-11-18T10:17:02.758 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-11-18T10:17:02.760 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the yum module rather than running 'yum'. If you need to use command because yum is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.131931", "end": "2021-11-18 10:17:02.741821", "rc": 0, "start": "2021-11-18 10:17:02.609890", "stderr": "", "stderr_lines": [], "stdout": "78 files removed", "stdout_lines": ["78 files removed"]} 2021-11-18T10:17:02.781 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:02 +0000 (0:00:00.314) 0:02:48.865 ***** 2021-11-18T10:17:02.800 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-11-18T10:17:02.801 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item=https://dist.apache.org/repos/dist/dev/arrow/KEYS) => {"ansible_loop_var": "item", "changed": true, "item": "https://dist.apache.org/repos/dist/dev/arrow/KEYS"} 2021-11-18T10:17:02.825 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:02 +0000 (0:00:00.043) 0:02:48.909 ***** 2021-11-18T10:17:02.833 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:02.835 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-11-18T10:17:02.859 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:02 +0000 (0:00:00.033) 0:02:48.943 ***** 2021-11-18T10:17:02.898 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:02.920 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:02 +0000 (0:00:00.061) 0:02:49.004 ***** 2021-11-18T10:17:02.959 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-18T10:17:02.961 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:02.982 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:02 +0000 (0:00:00.061) 0:02:49.065 ***** 2021-11-18T10:17:03.115 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-11-18T10:17:03.116 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": "yum clean all", "delta": "0:00:00.131475", "end": "2021-11-18 10:17:03.102126", "rc": 0, "start": "2021-11-18 10:17:02.970651", "stderr": "", "stderr_lines": [], "stdout": "78 files removed", "stdout_lines": ["78 files removed"]} 2021-11-18T10:17:03.139 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:03 +0000 (0:00:00.157) 0:02:49.223 ***** 2021-11-18T10:17:03.146 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-18T10:17:03.147 INFO:teuthology.task.ansible.out:fatal: [gibba005.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.005245", "end": "2021-11-18 10:17:03.128563", "msg": "non-zero return code", "rc": 1, "start": "2021-11-18 10:17:03.123318", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-11-18T10:17:03.172 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:03 +0000 (0:00:00.032) 0:02:49.256 ***** 2021-11-18T10:17:03.178 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:03.180 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2021-11-18T10:17:03.205 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:03 +0000 (0:00:00.032) 0:02:49.288 ***** 2021-11-18T10:17:03.212 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-11-18T10:17:03.214 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:03.237 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:03 +0000 (0:00:00.031) 0:02:49.320 ***** 2021-11-18T10:17:03.244 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-11-18T10:17:03.246 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:03.270 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:03 +0000 (0:00:00.033) 0:02:49.354 ***** 2021-11-18T10:17:03.309 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-11-18T10:17:03.311 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:03.331 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:03 +0000 (0:00:00.061) 0:02:49.415 ***** 2021-11-18T10:17:03.497 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-11-18T10:17:03.499 INFO:teuthology.task.ansible.out:fatal: [gibba019.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.005365", "end": "2021-11-18 10:17:03.482614", "msg": "non-zero return code", "rc": 1, "start": "2021-11-18 10:17:03.477249", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2021-11-18T10:17:03.521 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:03 +0000 (0:00:00.189) 0:02:49.604 ***** 2021-11-18T10:17:03.549 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:03.570 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:03 +0000 (0:00:00.049) 0:02:49.654 ***** 2021-11-18T10:17:18.792 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-11-18T10:17:18.794 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-11-18T10:17:18.816 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:18 +0000 (0:00:15.246) 0:03:04.900 ***** 2021-11-18T10:17:19.453 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-11-18T10:17:19.478 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:19 +0000 (0:00:00.661) 0:03:05.561 ***** 2021-11-18T10:17:20.865 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-18T10:17:20.867 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-11-18T10:17:20.896 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:20 +0000 (0:00:01.418) 0:03:06.980 ***** 2021-11-18T10:17:21.557 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2021-11-18T10:17:21.580 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:21 +0000 (0:00:00.683) 0:03:07.664 ***** 2021-11-18T10:17:28.980 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-18T10:17:28.982 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: qemu-kvm-core-15:4.2.0-59.module_el8.5.0+1002+36725df2.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: python3-dnf-plugins-core-4.0.21-3.el8.noarch", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: dnf-plugins-core-4.0.21-3.el8.noarch", "Installed: yum-utils-4.0.21-3.el8.noarch", "Installed: qemu-img-15:4.2.0-59.module_el8.5.0+1002+36725df2.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-59.module_el8.5.0+1002+36725df2.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-common-15:4.2.0-59.module_el8.5.0+1002+36725df2.x86_64", "Removed: yum-utils-4.0.18-4.el8.noarch", "Removed: python3-dnf-plugins-core-4.0.18-4.el8.noarch", "Removed: dnf-plugins-core-4.0.18-4.el8.noarch", "Removed: qemu-img-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-11-18T10:17:29.005 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:28 +0000 (0:00:07.424) 0:03:15.089 ***** 2021-11-18T10:17:29.045 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-18T10:17:29.046 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:29.068 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:29 +0000 (0:00:00.063) 0:03:15.152 ***** 2021-11-18T10:17:29.874 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-18T10:17:29.876 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: qemu-kvm-core-15:4.2.0-59.module_el8.5.0+1002+36725df2.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: python3-dnf-plugins-core-4.0.21-3.el8.noarch", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: dnf-plugins-core-4.0.21-3.el8.noarch", "Installed: yum-utils-4.0.21-3.el8.noarch", "Installed: qemu-img-15:4.2.0-59.module_el8.5.0+1002+36725df2.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-59.module_el8.5.0+1002+36725df2.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-common-15:4.2.0-59.module_el8.5.0+1002+36725df2.x86_64", "Removed: yum-utils-4.0.18-4.el8.noarch", "Removed: python3-dnf-plugins-core-4.0.18-4.el8.noarch", "Removed: dnf-plugins-core-4.0.18-4.el8.noarch", "Removed: qemu-img-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-common-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64", "Removed: qemu-kvm-core-15:4.2.0-48.module_el8.4.0+783+f8734d30.x86_64"]} 2021-11-18T10:17:29.900 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:29 +0000 (0:00:00.831) 0:03:15.984 ***** 2021-11-18T10:17:29.940 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-11-18T10:17:29.942 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:29.967 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:29 +0000 (0:00:00.066) 0:03:16.050 ***** 2021-11-18T10:17:30.233 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-18T10:17:30.234 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:17:30.262 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:30 +0000 (0:00:00.294) 0:03:16.345 ***** 2021-11-18T10:17:31.139 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:17:31.162 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:31 +0000 (0:00:00.900) 0:03:17.246 ***** 2021-11-18T10:17:32.706 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-18T10:17:32.708 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: libgcrypt-1.8.5-6.el8.x86_64", "Removed: libgcrypt-1.8.5-4.el8.x86_64"]} 2021-11-18T10:17:32.730 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:32 +0000 (0:00:01.567) 0:03:18.814 ***** 2021-11-18T10:17:33.001 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", 2021-11-18T10:17:33.003 INFO:teuthology.task.ansible.out:"LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127293", "LimitNPROCSoft": "127293", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127293", "LimitSIGPENDINGSoft": "127293", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203668", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-18T10:17:33.025 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:33 +0000 (0:00:00.294) 0:03:19.108 ***** 2021-11-18T10:17:33.264 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [gibba005.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-11-18T10:17:33.286 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:33 +0000 (0:00:00.261) 0:03:19.370 ***** 2021-11-18T10:17:33.566 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-18T10:17:33.569 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: libgcrypt-1.8.5-6.el8.x86_64", "Removed: libgcrypt-1.8.5-4.el8.x86_64"]} 2021-11-18T10:17:33.591 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:33 +0000 (0:00:00.304) 0:03:19.674 ***** 2021-11-18T10:17:33.830 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-11-18T10:17:33.832 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-11-18T10:17:33.854 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:33 +0000 (0:00:00.263) 0:03:19.938 ***** 2021-11-18T10:17:33.861 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-11-18T10:17:33.863 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveState": "inactive", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity" 2021-11-18T10:17:33.864 INFO:teuthology.task.ansible.out:, "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127293", "LimitNPROCSoft": "127293", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127293", "LimitSIGPENDINGSoft": "127293", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203668", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-11-18T10:17:33.888 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:33 +0000 (0:00:00.033) 0:03:19.972 ***** 2021-11-18T10:17:33.894 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-11-18T10:17:33.896 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:33.919 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:33 +0000 (0:00:00.030) 0:03:20.002 ***** 2021-11-18T10:17:33.946 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-18T10:17:33.948 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:33.973 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:33 +0000 (0:00:00.054) 0:03:20.056 ***** 2021-11-18T10:17:34.012 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-11-18T10:17:34.014 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.035 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.061) 0:03:20.118 ***** 2021-11-18T10:17:34.062 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-18T10:17:34.064 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.086 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.051) 0:03:20.170 ***** 2021-11-18T10:17:34.115 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.138 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.052) 0:03:20.222 ***** 2021-11-18T10:17:34.145 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-11-18T10:17:34.147 INFO:teuthology.task.ansible.out:fatal: [gibba019.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2021-11-18T10:17:34.171 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.032) 0:03:20.254 ***** 2021-11-18T10:17:34.177 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-18T10:17:34.179 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.211 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.040) 0:03:20.295 ***** 2021-11-18T10:17:34.240 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-18T10:17:34.263 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.051) 0:03:20.347 ***** 2021-11-18T10:17:34.293 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.315 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.051) 0:03:20.399 ***** 2021-11-18T10:17:34.344 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-18T10:17:34.346 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.382 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.067) 0:03:20.466 ***** 2021-11-18T10:17:34.405 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-11-18T10:17:34.407 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2021-11-18T10:17:34.432 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.049) 0:03:20.515 ***** 2021-11-18T10:17:34.439 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-18T10:17:34.441 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.464 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.032) 0:03:20.548 ***** 2021-11-18T10:17:34.471 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-11-18T10:17:34.473 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.497 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.032) 0:03:20.581 ***** 2021-11-18T10:17:34.505 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-18T10:17:34.507 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.530 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.033) 0:03:20.614 ***** 2021-11-18T10:17:34.539 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-11-18T10:17:34.541 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.563 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.032) 0:03:20.647 ***** 2021-11-18T10:17:34.571 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-18T10:17:34.595 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.031) 0:03:20.678 ***** 2021-11-18T10:17:34.603 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-11-18T10:17:34.605 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.628 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.032) 0:03:20.711 ***** 2021-11-18T10:17:34.635 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-18T10:17:34.637 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.660 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.031) 0:03:20.743 ***** 2021-11-18T10:17:34.667 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-11-18T10:17:34.669 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.691 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.031) 0:03:20.775 ***** 2021-11-18T10:17:34.699 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-18T10:17:34.701 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.724 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.032) 0:03:20.807 ***** 2021-11-18T10:17:34.731 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-11-18T10:17:34.733 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.756 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.031) 0:03:20.839 ***** 2021-11-18T10:17:34.763 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-11-18T10:17:34.765 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.787 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.031) 0:03:20.871 ***** 2021-11-18T10:17:34.795 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-11-18T10:17:34.797 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.821 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.033) 0:03:20.904 ***** 2021-11-18T10:17:34.828 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-18T10:17:34.830 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.853 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.032) 0:03:20.936 ***** 2021-11-18T10:17:34.861 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-11-18T10:17:34.887 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.034) 0:03:20.971 ***** 2021-11-18T10:17:34.898 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-18T10:17:34.900 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.932 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.044) 0:03:21.016 ***** 2021-11-18T10:17:34.941 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-11-18T10:17:34.943 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.965 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.033) 0:03:21.049 ***** 2021-11-18T10:17:34.972 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-18T10:17:34.974 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:34.996 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:34 +0000 (0:00:00.030) 0:03:21.080 ***** 2021-11-18T10:17:35.003 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-11-18T10:17:35.005 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.028 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.031) 0:03:21.111 ***** 2021-11-18T10:17:35.035 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-18T10:17:35.037 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.060 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.032) 0:03:21.143 ***** 2021-11-18T10:17:35.067 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2021-11-18T10:17:35.069 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.079 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.102 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.042) 0:03:21.186 ***** 2021-11-18T10:17:35.109 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-11-18T10:17:35.111 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.134 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.031) 0:03:21.218 ***** 2021-11-18T10:17:35.141 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-11-18T10:17:35.143 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.170 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.035) 0:03:21.254 ***** 2021-11-18T10:17:35.177 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-18T10:17:35.178 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.202 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.032) 0:03:21.286 ***** 2021-11-18T10:17:35.211 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-11-18T10:17:35.235 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.032) 0:03:21.319 ***** 2021-11-18T10:17:35.244 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-18T10:17:35.245 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.268 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.033) 0:03:21.352 ***** 2021-11-18T10:17:35.275 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-11-18T10:17:35.277 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.299 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.031) 0:03:21.383 ***** 2021-11-18T10:17:35.306 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-11-18T10:17:35.308 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.330 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.030) 0:03:21.413 ***** 2021-11-18T10:17:35.337 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-11-18T10:17:35.338 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.361 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.031) 0:03:21.445 ***** 2021-11-18T10:17:35.369 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-18T10:17:35.371 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.397 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.035) 0:03:21.481 ***** 2021-11-18T10:17:35.405 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.428 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.031) 0:03:21.512 ***** 2021-11-18T10:17:35.435 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-18T10:17:35.437 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.459 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.030) 0:03:21.542 ***** 2021-11-18T10:17:35.466 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-18T10:17:35.467 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.490 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.031) 0:03:21.574 ***** 2021-11-18T10:17:35.496 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-18T10:17:35.498 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.520 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.029) 0:03:21.603 ***** 2021-11-18T10:17:35.526 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-11-18T10:17:35.528 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.551 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.030) 0:03:21.634 ***** 2021-11-18T10:17:35.563 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.585 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.034) 0:03:21.669 ***** 2021-11-18T10:17:35.592 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-18T10:17:35.594 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.616 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.031) 0:03:21.700 ***** 2021-11-18T10:17:35.622 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-18T10:17:35.624 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.646 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.029) 0:03:21.730 ***** 2021-11-18T10:17:35.653 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2021-11-18T10:17:35.655 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.677 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.030) 0:03:21.761 ***** 2021-11-18T10:17:35.683 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-18T10:17:35.684 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.707 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.030) 0:03:21.791 ***** 2021-11-18T10:17:35.714 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages with --no-install-recommends] **************** 2021-11-18T10:17:35.715 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.737 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.030) 0:03:21.821 ***** 2021-11-18T10:17:35.744 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-18T10:17:35.746 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.767 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.029) 0:03:21.851 ***** 2021-11-18T10:17:35.774 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-11-18T10:17:35.776 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.798 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.030) 0:03:21.881 ***** 2021-11-18T10:17:35.804 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-18T10:17:35.806 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.828 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.029) 0:03:21.911 ***** 2021-11-18T10:17:35.834 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-11-18T10:17:35.836 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.858 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.030) 0:03:21.942 ***** 2021-11-18T10:17:35.865 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-18T10:17:35.866 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.889 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.030) 0:03:21.972 ***** 2021-11-18T10:17:35.896 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.922 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.033) 0:03:22.006 ***** 2021-11-18T10:17:35.929 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-18T10:17:35.930 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.952 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.030) 0:03:22.036 ***** 2021-11-18T10:17:35.960 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-11-18T10:17:35.961 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:35.987 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:35 +0000 (0:00:00.034) 0:03:22.070 ***** 2021-11-18T10:17:35.994 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.027 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.040) 0:03:22.110 ***** 2021-11-18T10:17:36.035 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-11-18T10:17:36.037 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.061 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.034) 0:03:22.144 ***** 2021-11-18T10:17:36.068 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-18T10:17:36.070 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.093 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.031) 0:03:22.176 ***** 2021-11-18T10:17:36.099 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-11-18T10:17:36.101 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.123 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.030) 0:03:22.207 ***** 2021-11-18T10:17:36.130 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:36.131 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.154 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.031) 0:03:22.238 ***** 2021-11-18T10:17:36.161 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-11-18T10:17:36.163 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.186 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.031) 0:03:22.270 ***** 2021-11-18T10:17:36.195 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-11-18T10:17:36.196 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.219 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.032) 0:03:22.302 ***** 2021-11-18T10:17:36.226 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-11-18T10:17:36.227 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.250 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.031) 0:03:22.334 ***** 2021-11-18T10:17:36.257 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-18T10:17:36.259 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.281 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.030) 0:03:22.365 ***** 2021-11-18T10:17:36.287 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-11-18T10:17:36.288 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.312 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.030) 0:03:22.395 ***** 2021-11-18T10:17:36.318 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-18T10:17:36.320 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.342 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.030) 0:03:22.426 ***** 2021-11-18T10:17:36.349 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-11-18T10:17:36.351 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.374 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.031) 0:03:22.458 ***** 2021-11-18T10:17:36.382 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-18T10:17:36.384 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.409 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.034) 0:03:22.492 ***** 2021-11-18T10:17:36.417 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-11-18T10:17:36.418 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.443 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.034) 0:03:22.527 ***** 2021-11-18T10:17:36.471 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-11-18T10:17:36.473 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.493 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.049) 0:03:22.577 ***** 2021-11-18T10:17:36.520 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-11-18T10:17:36.522 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.544 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.050) 0:03:22.627 ***** 2021-11-18T10:17:36.573 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-18T10:17:36.574 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-11-18T10:17:36.595 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.051) 0:03:22.679 ***** 2021-11-18T10:17:36.615 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.019) 0:03:22.699 ***** 2021-11-18T10:17:36.643 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-11-18T10:17:36.644 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.667 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.051) 0:03:22.750 ***** 2021-11-18T10:17:36.696 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:36.698 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.718 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.051) 0:03:22.802 ***** 2021-11-18T10:17:36.756 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.782 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.063) 0:03:22.865 ***** 2021-11-18T10:17:36.789 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-18T10:17:36.791 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-18T10:17:36.815 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.033) 0:03:22.899 ***** 2021-11-18T10:17:36.822 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-11-18T10:17:36.823 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.847 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.031) 0:03:22.930 ***** 2021-11-18T10:17:36.874 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-11-18T10:17:36.876 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.897 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.049) 0:03:22.980 ***** 2021-11-18T10:17:36.925 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-18T10:17:36.927 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:36.948 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.051) 0:03:23.031 ***** 2021-11-18T10:17:36.976 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-18T10:17:36.978 INFO:teuthology.task.ansible.out:[WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-11-18T10:17:37.001 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:36 +0000 (0:00:00.053) 0:03:23.085 ***** 2021-11-18T10:17:37.030 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-18T10:17:37.031 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.052 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.050) 0:03:23.136 ***** 2021-11-18T10:17:37.080 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-18T10:17:37.082 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.102 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.050) 0:03:23.186 ***** 2021-11-18T10:17:37.120 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-18T10:17:37.122 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2021-11-18T10:17:37.143 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.040) 0:03:23.227 ***** 2021-11-18T10:17:37.150 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-11-18T10:17:37.152 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.175 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.031) 0:03:23.258 ***** 2021-11-18T10:17:37.202 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-18T10:17:37.204 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.225 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.050) 0:03:23.309 ***** 2021-11-18T10:17:37.253 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-18T10:17:37.255 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.276 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.050) 0:03:23.359 ***** 2021-11-18T10:17:37.304 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-18T10:17:37.305 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.326 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.050) 0:03:23.410 ***** 2021-11-18T10:17:37.334 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-18T10:17:37.335 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-18T10:17:37.359 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.032) 0:03:23.442 ***** 2021-11-18T10:17:37.367 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-18T10:17:37.369 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.394 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.035) 0:03:23.478 ***** 2021-11-18T10:17:37.423 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-18T10:17:37.425 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.445 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.050) 0:03:23.529 ***** 2021-11-18T10:17:37.474 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-18T10:17:37.476 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.503 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.057) 0:03:23.586 ***** 2021-11-18T10:17:37.522 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-18T10:17:37.523 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2021-11-18T10:17:37.546 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.043) 0:03:23.629 ***** 2021-11-18T10:17:37.554 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-18T10:17:37.555 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.578 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.032) 0:03:23.662 ***** 2021-11-18T10:17:37.585 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-18T10:17:37.587 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.613 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.034) 0:03:23.696 ***** 2021-11-18T10:17:37.620 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-18T10:17:37.622 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.645 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.031) 0:03:23.728 ***** 2021-11-18T10:17:37.653 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-18T10:17:37.655 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.679 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.034) 0:03:23.763 ***** 2021-11-18T10:17:37.688 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-18T10:17:37.690 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.712 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.033) 0:03:23.796 ***** 2021-11-18T10:17:37.721 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.746 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.033) 0:03:23.830 ***** 2021-11-18T10:17:37.754 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-18T10:17:37.756 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.778 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.031) 0:03:23.862 ***** 2021-11-18T10:17:37.785 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-18T10:17:37.787 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.810 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.031) 0:03:23.893 ***** 2021-11-18T10:17:37.817 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-18T10:17:37.819 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.842 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.031) 0:03:23.925 ***** 2021-11-18T10:17:37.849 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-18T10:17:37.851 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.874 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.032) 0:03:23.958 ***** 2021-11-18T10:17:37.881 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-18T10:17:37.883 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.905 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.031) 0:03:23.989 ***** 2021-11-18T10:17:37.913 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-18T10:17:37.914 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.939 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.033) 0:03:24.023 ***** 2021-11-18T10:17:37.949 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-18T10:17:37.951 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:37.975 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:37 +0000 (0:00:00.036) 0:03:24.059 ***** 2021-11-18T10:17:37.984 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-11-18T10:17:37.985 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.010 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.034) 0:03:24.094 ***** 2021-11-18T10:17:38.018 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-18T10:17:38.020 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.051 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.040) 0:03:24.134 ***** 2021-11-18T10:17:38.060 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-11-18T10:17:38.062 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.087 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.035) 0:03:24.170 ***** 2021-11-18T10:17:38.095 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-18T10:17:38.097 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.120 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.033) 0:03:24.204 ***** 2021-11-18T10:17:38.128 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-11-18T10:17:38.130 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.153 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.032) 0:03:24.236 ***** 2021-11-18T10:17:38.160 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-18T10:17:38.161 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.184 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.031) 0:03:24.268 ***** 2021-11-18T10:17:38.191 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-11-18T10:17:38.192 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.215 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.030) 0:03:24.299 ***** 2021-11-18T10:17:38.222 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-11-18T10:17:38.224 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.246 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.030) 0:03:24.329 ***** 2021-11-18T10:17:38.253 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-11-18T10:17:38.254 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.277 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.031) 0:03:24.360 ***** 2021-11-18T10:17:38.284 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-18T10:17:38.285 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.308 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.030) 0:03:24.391 ***** 2021-11-18T10:17:38.314 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-11-18T10:17:38.316 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.339 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.031) 0:03:24.422 ***** 2021-11-18T10:17:38.346 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-18T10:17:38.348 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.369 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.030) 0:03:24.453 ***** 2021-11-18T10:17:38.377 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-11-18T10:17:38.379 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.403 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.033) 0:03:24.487 ***** 2021-11-18T10:17:38.411 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:38.412 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-18T10:17:38.435 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.031) 0:03:24.519 ***** 2021-11-18T10:17:38.443 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-11-18T10:17:38.445 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.468 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.033) 0:03:24.552 ***** 2021-11-18T10:17:38.487 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-18T10:17:38.488 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} ok: [gibba005.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-18T10:17:38.498 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-11-18T10:17:38.500 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [gibba005.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.521 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.052) 0:03:24.605 ***** 2021-11-18T10:17:38.528 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.530 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.556 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.035) 0:03:24.640 ***** 2021-11-18T10:17:38.563 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-11-18T10:17:38.565 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.587 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.030) 0:03:24.671 ***** 2021-11-18T10:17:38.614 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-11-18T10:17:38.616 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.636 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.048) 0:03:24.719 ***** 2021-11-18T10:17:38.663 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-11-18T10:17:38.665 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.687 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.051) 0:03:24.771 ***** 2021-11-18T10:17:38.715 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-11-18T10:17:38.716 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.736 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.049) 0:03:24.820 ***** 2021-11-18T10:17:38.764 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-18T10:17:38.766 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003406", "end": "2021-11-18 10:17:38.735731", "rc": 0, "start": "2021-11-18 10:17:38.732325", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock"]} TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.789 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.052) 0:03:24.873 ***** 2021-11-18T10:17:38.809 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.019) 0:03:24.892 ***** 2021-11-18T10:17:38.827 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-18T10:17:38.829 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.852 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.042) 0:03:24.935 ***** 2021-11-18T10:17:38.859 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-11-18T10:17:38.862 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.883 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.031) 0:03:24.967 ***** 2021-11-18T10:17:38.889 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-11-18T10:17:38.891 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.914 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.030) 0:03:24.997 ***** 2021-11-18T10:17:38.921 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-11-18T10:17:38.923 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.946 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.032) 0:03:25.029 ***** 2021-11-18T10:17:38.952 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-18T10:17:38.954 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:38.976 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:38 +0000 (0:00:00.030) 0:03:25.060 ***** 2021-11-18T10:17:38.983 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:38.985 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-11-18T10:17:39.007 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:39 +0000 (0:00:00.031) 0:03:25.091 ***** 2021-11-18T10:17:39.015 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-18T10:17:39.017 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:39.040 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:39 +0000 (0:00:00.032) 0:03:25.124 ***** 2021-11-18T10:17:39.059 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-11-18T10:17:39.061 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:39.081 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-11-18T10:17:39.092 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:39.103 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:39.114 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:39.115 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:39.125 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-11-18T10:17:39.164 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:39 +0000 (0:00:00.123) 0:03:25.247 ***** 2021-11-18T10:17:39.359 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-11-18T10:17:39.361 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003499", "end": "2021-11-18 10:17:39.337906", "rc": 0, "start": "2021-11-18 10:17:39.334407", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/virtualenv/bin/teuthology-lock"]} 2021-11-18T10:17:39.390 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:39 +0000 (0:00:00.226) 0:03:25.473 ***** 2021-11-18T10:17:39.418 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-11-18T10:17:39.420 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:39.442 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:39 +0000 (0:00:00.052) 0:03:25.526 ***** 2021-11-18T10:17:39.469 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-11-18T10:17:39.471 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:39.493 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:39 +0000 (0:00:00.050) 0:03:25.576 ***** 2021-11-18T10:17:39.520 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-11-18T10:17:39.522 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:39.542 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:39 +0000 (0:00:00.049) 0:03:25.626 ***** 2021-11-18T10:17:39.579 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-11-18T10:17:39.581 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:39.602 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:39 +0000 (0:00:00.059) 0:03:25.686 ***** 2021-11-18T10:17:40.170 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-18T10:17:40.172 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:17:40.194 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:40 +0000 (0:00:00.592) 0:03:26.278 ***** 2021-11-18T10:17:40.233 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-18T10:17:40.235 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930261184512, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227114547, 'block_used': 12980561, 'inode_total': 61054976, 'inode_available': 60985806, 'inode_used': 69170, 'uuid': '07628eed-a557-464f-85de-804be6e662c1'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114547, "block_size": 4096, "block_total": 240095108, "block_used": 12980561, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985806, "inode_total": 61054976, "inode_used": 69170, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930261184512, "size_total": 983429562368, "uuid": "07628eed-a557-464f-85de-804be6e662c1"}} 2021-11-18T10:17:40.257 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:40 +0000 (0:00:00.062) 0:03:26.341 ***** 2021-11-18T10:17:40.423 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-18T10:17:40.425 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.003494", "end": "2021-11-18 10:17:40.405284", "rc": 0, "start": "2021-11-18 10:17:40.401790", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:40.448 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:40 +0000 (0:00:00.190) 0:03:26.531 ***** 2021-11-18T10:17:40.500 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [gibba005.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930261184512, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227114547, 'block_used': 12980561, 'inode_total': 61054976, 'inode_available': 60985806, 'inode_used': 69170, 'uuid': '07628eed-a557-464f-85de-804be6e662c1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114547, "block_size": 4096, "block_total": 240095108, "block_used": 12980561, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985806, "inode_total": 61054976, "inode_used": 69170, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930261184512, "size_total": 983429562368, "uuid": "07628eed-a557-464f-85de-804be6e662c1"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:40.524 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:40 +0000 (0:00:00.076) 0:03:26.607 ***** 2021-11-18T10:17:40.553 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-18T10:17:40.576 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:40 +0000 (0:00:00.052) 0:03:26.660 ***** 2021-11-18T10:17:40.709 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-11-18T10:17:40.711 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:17:40.735 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:40 +0000 (0:00:00.158) 0:03:26.819 ***** 2021-11-18T10:17:40.788 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-18T10:17:40.790 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930261180416, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227114546, 'block_used': 12980562, 'inode_total': 61054976, 'inode_available': 60985806, 'inode_used': 69170, 'uuid': '07628eed-a557-464f-85de-804be6e662c1'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114546, "block_size": 4096, "block_total": 240095108, "block_used": 12980562, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985806, "inode_total": 61054976, "inode_used": 69170, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930261180416, "size_total": 983429562368, "uuid": "07628eed-a557-464f-85de-804be6e662c1"}} 2021-11-18T10:17:40.814 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:40 +0000 (0:00:00.078) 0:03:26.898 ***** 2021-11-18T10:17:40.967 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-11-18T10:17:40.969 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.003593", "end": "2021-11-18 10:17:40.956037", "rc": 0, "start": "2021-11-18 10:17:40.952444", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:41.000 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:40 +0000 (0:00:00.186) 0:03:27.084 ***** 2021-11-18T10:17:41.049 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-11-18T10:17:41.051 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930261180416, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227114546, 'block_used': 12980562, 'inode_total': 61054976, 'inode_available': 60985806, 'inode_used': 69170, 'uuid': '07628eed-a557-464f-85de-804be6e662c1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114546, "block_size": 4096, "block_total": 240095108, "block_used": 12980562, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985806, "inode_total": 61054976, "inode_used": 69170, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930261180416, "size_total": 983429562368, "uuid": "07628eed-a557-464f-85de-804be6e662c1"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:41.073 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:41 +0000 (0:00:00.073) 0:03:27.157 ***** 2021-11-18T10:17:41.100 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-11-18T10:17:41.122 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:41 +0000 (0:00:00.049) 0:03:27.206 ***** 2021-11-18T10:17:42.392 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-18T10:17:42.394 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2hAzT91MUxWdPkfdgkSTQ2nuTpcbeak2Y'], 'uuids': ['b0dfcb24-97aa-4c44-8305-345c4946cfbf'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.632007", "end": "2021-11-18 10:17:42.365995", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2hAzT91MUxWdPkfdgkSTQ2nuTpcbeak2Y"], "labels": [], "masters": [], "uuids": ["b0dfcb24-97aa-4c44-8305-345c4946cfbf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:40.733988", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:42.936 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMraEfYvPqACtkdiM8Mv1QKCymdhc2F4CZ'], 'uuids': ['dd72c76a-6faf-46c6-88d5-0c2c806d5992'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.626485", "end": "2021-11-18 10:17:42.908840", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMraEfYvPqACtkdiM8Mv1QKCymdhc2F4CZ"], "labels": [], "masters": [], "uuids": ["dd72c76a-6faf-46c6-88d5-0c2c806d5992"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:41.282355", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:43.579 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-edi1ZK-zibB-OIe8-mZ80-18MO-aAyX-cWOUGy', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200003U375A', 'nvme-nvme.8086-50484b4d393230303030335533373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.043531", "end": "2021-11-18 10:17:43.555499", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-edi1ZK-zibB-OIe8-mZ80-18MO-aAyX-cWOUGy", "nvme-INTEL_SSDPEL1K375GA_PHKM9200003U375A", "nvme-nvme.8086-50484b4d393230303030335533373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:42.511968", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now par 2021-11-18T10:17:43.581 INFO:teuthology.task.ansible.out:tition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:44.120 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-oXbG4H-iRIF-3vp3-KSbZ-FTEK-N0rB-UhRmFB', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400BD375A', 'nvme-nvme.8086-50484b4d393133343030424433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.044170", "end": "2021-11-18 10:17:44.100647", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-oXbG4H-iRIF-3vp3-KSbZ-FTEK-N0rB-UhRmFB", "nvme-INTEL_SSDPEL1K375GA_PHKM913400BD375A", "nvme-nvme.8086-50484b4d393133343030424433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:43.056477", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now par 2021-11-18T10:17:44.122 INFO:teuthology.task.ansible.out:tition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:44.792 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2GlbtvOCTT8U18M8M7HCUHcoR85EaoOpt'], 'uuids': ['26be1736-a2ff-40a9-bbf1-d37304d74db6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.074787", "end": "2021-11-18 10:17:44.775229", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2GlbtvOCTT8U18M8M7HCUHcoR85EaoOpt"], "labels": [], "masters": [], "uuids": ["26be1736-a2ff-40a9-bbf1-d37304d74db6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:43.700442", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:45.323 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEM5ux5PPmqLHxEuzCVadVue4lAsD35MSf4'], 'uuids': ['e93446ba-cef8-4254-8142-8d335b0af403'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.059631", "end": "2021-11-18 10:17:45.300422", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEM5ux5PPmqLHxEuzCVadVue4lAsD35MSf4"], "labels": [], "masters": [], "uuids": ["e93446ba-cef8-4254-8142-8d335b0af403"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:44.240791", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:45.987 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2lNnD0ZLP3P0M1MlB4roGse3oYa8avaBC'], 'uuids': ['c496b4f8-21ea-44ad-a7d4-cd107c8290d1'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.047583", "end": "2021-11-18 10:17:45.964473", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2lNnD0ZLP3P0M1MlB4roGse3oYa8avaBC"], "labels": [], "masters": [], "uuids": ["c496b4f8-21ea-44ad-a7d4-cd107c8290d1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:44.916890", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:46.512 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMnwq818sFeyHkGvk3Kug1aHovfsNvaVgV'], 'uuids': ['d758332a-58c3-4919-b355-78ddb77b4cf7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.043989", "end": "2021-11-18 10:17:46.485441", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMnwq818sFeyHkGvk3Kug1aHovfsNvaVgV"], "labels": [], "masters": [], "uuids": ["d758332a-58c3-4919-b355-78ddb77b4cf7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:45.441452", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:47.189 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2B0s7om1LcCL0mGW8W7Yae256n2I5E3yc'], 'uuids': ['0db39e81-a4fb-416b-a9a6-60208381fc43'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.063631", "end": "2021-11-18 10:17:47.165651", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2B0s7om1LcCL0mGW8W7Yae256n2I5E3yc"], "labels": [], "masters": [], "uuids": ["0db39e81-a4fb-416b-a9a6-60208381fc43"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:46.102020", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:47.190 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38MF6XF', 'scsi-350000399aba8166c', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF', 'wwn-0x50000399aba8166c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I8K38MF6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399aba8166c', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38MF6XF-part1', 'scsi-350000399aba8166c-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF-part1', 'wwn-0x50000399aba8166c-part1'], 'uuids': ['07628eed-a557-464f-85de-804be6e662c1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '07628eed-a557-464f-85de-804be6e662c1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38MF6XF", "scsi-350000399aba8166c", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF", "wwn-0x50000399aba8166c"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF-part1", "scsi-1ATA_TOSHI 2021-11-18T10:17:47.192 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I8K38MF6XF-part1", "scsi-350000399aba8166c-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF-part1", "wwn-0x50000399aba8166c-part1"], "labels": [], "masters": [], "uuids": ["07628eed-a557-464f-85de-804be6e662c1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "07628eed-a557-464f-85de-804be6e662c1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38MF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba8166c"}}, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:47.715 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMFQEOLiELXvWxofGPFLBEl1PTv4TyZ2Ra'], 'uuids': ['33048ac3-f044-4697-883c-6ffb8e038670'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.063899", "end": "2021-11-18 10:17:47.694594", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMFQEOLiELXvWxofGPFLBEl1PTv4TyZ2Ra"], "labels": [], "masters": [], "uuids": ["33048ac3-f044-4697-883c-6ffb8e038670"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:46.630695", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:47.727 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF', 'scsi-350000399ab9813cb', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF', 'wwn-0x50000399ab9813cb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I6K2JXF6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399ab9813cb', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF-part1', 'scsi-350000399ab9813cb-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF-part1', 'wwn-0x50000399ab9813cb-part1'], 'uuids': ['07628eed-a557-464f-85de-804be6e662c1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '07628eed-a557-464f-85de-804be6e662c1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF", "scsi-350000399ab9813cb", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF", "wwn-0x50000399ab9813cb"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF-part1", "scsi-1ATA_TOSHI 2021-11-18T10:17:47.729 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I6K2JXF6XF-part1", "scsi-350000399ab9813cb-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF-part1", "wwn-0x50000399ab9813cb-part1"], "labels": [], "masters": [], "uuids": ["07628eed-a557-464f-85de-804be6e662c1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "07628eed-a557-464f-85de-804be6e662c1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2JXF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813cb"}}, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:48.391 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2X70YZO6JdjYNpOkBYxwPrcYaF5IukgoX'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.055203", "end": "2021-11-18 10:17:48.366670", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2X70YZO6JdjYNpOkBYxwPrcYaF5IukgoX"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:47.311467", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:48.421 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:48 +0000 (0:00:07.298) 0:03:34.504 ***** 2021-11-18T10:17:48.678 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-18T10:17:48.680 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2hAzT91MUxWdPkfdgkSTQ2nuTpcbeak2Y'], 'uuids': ['b0dfcb24-97aa-4c44-8305-345c4946cfbf'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.079751", "end": "2021-11-18 10:17:48.656314", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2hAzT91MUxWdPkfdgkSTQ2nuTpcbeak2Y"], "labels": [], "masters": [], "uuids": ["b0dfcb24-97aa-4c44-8305-345c4946cfbf"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:48.576563", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0780351 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0780351 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:48.845 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-edi1ZK-zibB-OIe8-mZ80-18MO-aAyX-cWOUGy', 'nvme-INTEL_SSDPEL1K375GA_PHKM9200003U375A', 'nvme-nvme.8086-50484b4d393230303030335533373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.026350", "end": "2021-11-18 10:17:48.821432", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-edi1ZK-zibB-OIe8-mZ80-18MO-aAyX-cWOUGy", "nvme-INTEL_SSDPEL1K375GA_PHKM9200003U375A", "nvme-nvme.8086-50484b4d393230303030335533373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:48.795082", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0245838 s, 4.7 GB/s", "stderr_lines": ["1 2021-11-18T10:17:48.847 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0245838 s, 4.7 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:48.919 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-11-18T10:17:48.921 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMIfh6QENPmP5RbsXxnX8rz99HRhR4GL9H'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.047358", "end": "2021-11-18 10:17:48.893724", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMIfh6QENPmP5RbsXxnX8rz99HRhR4GL9H"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:47.846366", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-11-18T10:17:48.949 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:48 +0000 (0:00:00.528) 0:03:35.033 ***** 2021-11-18T10:17:49.060 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-18T10:17:49.061 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2GlbtvOCTT8U18M8M7HCUHcoR85EaoOpt'], 'uuids': ['26be1736-a2ff-40a9-bbf1-d37304d74db6'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.080703", "end": "2021-11-18 10:17:49.040327", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2GlbtvOCTT8U18M8M7HCUHcoR85EaoOpt"], "labels": [], "masters": [], "uuids": ["26be1736-a2ff-40a9-bbf1-d37304d74db6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:48.959624", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0790067 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0790067 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:49.208 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMraEfYvPqACtkdiM8Mv1QKCymdhc2F4CZ'], 'uuids': ['dd72c76a-6faf-46c6-88d5-0c2c806d5992'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.080838", "end": "2021-11-18 10:17:49.186331", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMraEfYvPqACtkdiM8Mv1QKCymdhc2F4CZ"], "labels": [], "masters": [], "uuids": ["dd72c76a-6faf-46c6-88d5-0c2c806d5992"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:49.105493", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0791076 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0791076 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:49.294 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2lNnD0ZLP3P0M1MlB4roGse3oYa8avaBC'], 'uuids': ['c496b4f8-21ea-44ad-a7d4-cd107c8290d1'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.080946", "end": "2021-11-18 10:17:49.265247", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2lNnD0ZLP3P0M1MlB4roGse3oYa8avaBC"], "labels": [], "masters": [], "uuids": ["c496b4f8-21ea-44ad-a7d4-cd107c8290d1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:49.184301", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0792434 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0792434 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:49.378 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-oXbG4H-iRIF-3vp3-KSbZ-FTEK-N0rB-UhRmFB', 'nvme-INTEL_SSDPEL1K375GA_PHKM913400BD375A', 'nvme-nvme.8086-50484b4d393133343030424433373541-494e54454c2053534450454c314b3337354741-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEL1K375GA', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '732585168', 'sectorsize': '512', 'size': '349.32 GB', 'host': 'Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.026402", "end": "2021-11-18 10:17:49.354147", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation NVMe Datacenter SSD [Optane]", "links": {"ids": ["lvm-pv-uuid-oXbG4H-iRIF-3vp3-KSbZ-FTEK-N0rB-UhRmFB", "nvme-INTEL_SSDPEL1K375GA_PHKM913400BD375A", "nvme-nvme.8086-50484b4d393133343030424433373541-494e54454c2053534450454c314b3337354741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEL1K375GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "732585168", "sectorsize": "512", "size": "349.32 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:49.327745", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0246597 s, 4.7 GB/s", "stderr_lines": ["1 2021-11-18T10:17:49.380 INFO:teuthology.task.ansible.out:10+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0246597 s, 4.7 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:49.505 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2B0s7om1LcCL0mGW8W7Yae256n2I5E3yc'], 'uuids': ['0db39e81-a4fb-416b-a9a6-60208381fc43'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.080119", "end": "2021-11-18 10:17:49.487367", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2B0s7om1LcCL0mGW8W7Yae256n2I5E3yc"], "labels": [], "masters": [], "uuids": ["0db39e81-a4fb-416b-a9a6-60208381fc43"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:49.407248", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0783391 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0783391 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:49.516 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38MF6XF', 'scsi-350000399aba8166c', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF', 'wwn-0x50000399aba8166c'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I8K38MF6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399aba8166c', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38MF6XF-part1', 'scsi-350000399aba8166c-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF-part1', 'wwn-0x50000399aba8166c-part1'], 'uuids': ['07628eed-a557-464f-85de-804be6e662c1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '07628eed-a557-464f-85de-804be6e662c1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I8K38MF6XF", "scsi-350000399aba8166c", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF", "wwn-0x50000399aba8166c"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I8K38MF6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF-part1", "scsi-1ATA_TOSHI 2021-11-18T10:17:49.518 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I8K38MF6XF-part1", "scsi-350000399aba8166c-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I8K38MF6XF-part1", "wwn-0x50000399aba8166c-part1"], "labels": [], "masters": [], "uuids": ["07628eed-a557-464f-85de-804be6e662c1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "07628eed-a557-464f-85de-804be6e662c1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I8K38MF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399aba8166c"}}, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:49.737 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2X70YZO6JdjYNpOkBYxwPrcYaF5IukgoX'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.081195", "end": "2021-11-18 10:17:49.714811", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-mkGRG3jcvCtq7F3xGcS6Cq7MLPCxbNP2X70YZO6JdjYNpOkBYxwPrcYaF5IukgoX"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:49.633616", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0794353 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0794353 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:49.766 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:49 +0000 (0:00:00.817) 0:03:35.850 ***** 2021-11-18T10:17:50.012 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-18T10:17:50.014 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.086358", "end": "2021-11-18 10:17:49.986245", "rc": 0, "start": "2021-11-18 10:17:49.899887", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:50.034 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.267) 0:03:36.118 ***** 2021-11-18T10:17:50.231 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-18T10:17:50.233 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.049513", "end": "2021-11-18 10:17:50.217404", "rc": 0, "start": "2021-11-18 10:17:50.167891", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:50.253 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.219) 0:03:36.337 ***** 2021-11-18T10:17:50.281 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-18T10:17:50.306 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.052) 0:03:36.389 ***** 2021-11-18T10:17:50.333 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-18T10:17:50.335 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:50.358 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.052) 0:03:36.442 ***** 2021-11-18T10:17:50.386 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-18T10:17:50.388 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:50.408 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.049) 0:03:36.492 ***** 2021-11-18T10:17:50.436 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-18T10:17:50.438 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:50.463 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.054) 0:03:36.547 ***** 2021-11-18T10:17:50.491 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:50.513 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.050) 0:03:36.597 ***** 2021-11-18T10:17:50.594 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-18T10:17:50.596 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEM5ux5PPmqLHxEuzCVadVue4lAsD35MSf4'], 'uuids': ['e93446ba-cef8-4254-8142-8d335b0af403'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '27262976', 'sectorsize': '512', 'size': '13.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:01.081778", "end": "2021-11-18 10:17:50.575153", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEM5ux5PPmqLHxEuzCVadVue4lAsD35MSf4"], "labels": [], "masters": [], "uuids": ["e93446ba-cef8-4254-8142-8d335b0af403"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "27262976", "sectorsize": "512", "size": "13.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:49.493375", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0785438 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0785438 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:50.671 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-18T10:17:50.673 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-18T10:17:50.695 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.181) 0:03:36.778 ***** 2021-11-18T10:17:50.733 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-18T10:17:50.734 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930261184512, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227114547, 'block_used': 12980561, 'inode_total': 61054976, 'inode_available': 60985806, 'inode_used': 69170, 'uuid': '07628eed-a557-464f-85de-804be6e662c1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114547, "block_size": 4096, "block_total": 240095108, "block_used": 12980561, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985806, "inode_total": 61054976, "inode_used": 69170, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930261184512, "size_total": 983429562368, "uuid": "07628eed-a557-464f-85de-804be6e662c1"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:50.766 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.070) 0:03:36.849 ***** 2021-11-18T10:17:50.797 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-11-18T10:17:50.799 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:50.821 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.054) 0:03:36.904 ***** 2021-11-18T10:17:50.829 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-18T10:17:50.830 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMnwq818sFeyHkGvk3Kug1aHovfsNvaVgV'], 'uuids': ['d758332a-58c3-4919-b355-78ddb77b4cf7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.081001", "end": "2021-11-18 10:17:50.803167", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMnwq818sFeyHkGvk3Kug1aHovfsNvaVgV"], "labels": [], "masters": [], "uuids": ["d758332a-58c3-4919-b355-78ddb77b4cf7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:50.722166", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0793104 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0793104 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:50.853 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:50.876 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.055) 0:03:36.960 ***** 2021-11-18T10:17:50.904 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:50.905 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:50.926 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.049) 0:03:37.009 ***** 2021-11-18T10:17:50.953 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-18T10:17:50.954 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:50.976 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:50 +0000 (0:00:00.050) 0:03:37.060 ***** 2021-11-18T10:17:51.004 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-18T10:17:51.005 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:51.026 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:51 +0000 (0:00:00.049) 0:03:37.109 ***** 2021-11-18T10:17:51.043 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-18T10:17:51.043 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMFQEOLiELXvWxofGPFLBEl1PTv4TyZ2Ra'], 'uuids': ['33048ac3-f044-4697-883c-6ffb8e038670'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.080032", "end": "2021-11-18 10:17:51.025882", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMFQEOLiELXvWxofGPFLBEl1PTv4TyZ2Ra"], "labels": [], "masters": [], "uuids": ["33048ac3-f044-4697-883c-6ffb8e038670"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:50.945850", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0783225 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0783225 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:51.056 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF', 'scsi-350000399ab9813cb', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF', 'wwn-0x50000399ab9813cb'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'TOSHIBA MG04ACA1', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Y9I6K2JXF6XF', 'removable': '0', 'support_discard': '0', 'wwn': '0x50000399ab9813cb', 'partitions': {'sda1': {'links': {'ids': ['ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF-part1', 'scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF-part1', 'scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF-part1', 'scsi-350000399ab9813cb-part1', 'scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF-part1', 'wwn-0x50000399ab9813cb-part1'], 'uuids': ['07628eed-a557-464f-85de-804be6e662c1'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '07628eed-a557-464f-85de-804be6e662c1', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation Cannon Lake PCH SATA AHCI Controller (rev 10)", "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF", "scsi-1ATA_TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF", "scsi-350000399ab9813cb", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF", "wwn-0x50000399ab9813cb"], "labels": [], "masters": [], "uuids": []}, "model": "TOSHIBA MG04ACA1", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-TOSHIBA_MG04ACA100N_Y9I6K2JXF6XF-part1", "scsi-0ATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF-part1", "scsi-1ATA_TOSHI 2021-11-18T10:17:51.058 INFO:teuthology.task.ansible.out:BA_MG04ACA100N_Y9I6K2JXF6XF-part1", "scsi-350000399ab9813cb-part1", "scsi-SATA_TOSHIBA_MG04ACA1_Y9I6K2JXF6XF-part1", "wwn-0x50000399ab9813cb-part1"], "labels": [], "masters": [], "uuids": ["07628eed-a557-464f-85de-804be6e662c1"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "07628eed-a557-464f-85de-804be6e662c1"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Y9I6K2JXF6XF", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x50000399ab9813cb"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical_volumes dict] ********************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:51.078 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:51 +0000 (0:00:00.052) 0:03:37.162 ***** 2021-11-18T10:17:51.272 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-11-18T10:17:51.274 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMIfh6QENPmP5RbsXxnX8rz99HRhR4GL9H'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '176160768', 'sectorsize': '512', 'size': '84.00 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.080726", "end": "2021-11-18 10:17:51.248368", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-ySyQGyulA0wRgbLSlS83LlYIr5NXJgEMIfh6QENPmP5RbsXxnX8rz99HRhR4GL9H"], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "176160768", "sectorsize": "512", "size": "84.00 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-11-18 10:17:51.167642", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.079004 s, 1.5 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.079004 s, 1.5 GB/s"], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:51.303 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:51 +0000 (0:00:00.224) 0:03:37.386 ***** 2021-11-18T10:17:51.549 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-11-18T10:17:51.551 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.085428", "end": "2021-11-18 10:17:51.526719", "rc": 0, "start": "2021-11-18 10:17:51.441291", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:51.572 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:51 +0000 (0:00:00.269) 0:03:37.656 ***** 2021-11-18T10:17:51.769 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-11-18T10:17:51.771 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-18T10:17:51.819 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:51 +0000 (0:00:00.244) 0:03:37.901 ***** 2021-11-18T10:17:51.835 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-11-18T10:17:51.837 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.045014", "end": "2021-11-18 10:17:51.784406", "rc": 0, "start": "2021-11-18 10:17:51.739392", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:17:51.861 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:51 +0000 (0:00:00.044) 0:03:37.945 ***** 2021-11-18T10:17:51.895 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-11-18T10:17:51.921 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:51 +0000 (0:00:00.059) 0:03:38.005 ***** 2021-11-18T10:17:51.961 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-11-18T10:17:51.963 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:51.989 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:51 +0000 (0:00:00.067) 0:03:38.073 ***** 2021-11-18T10:17:52.028 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-11-18T10:17:52.030 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:52.052 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:52 +0000 (0:00:00.062) 0:03:38.135 ***** 2021-11-18T10:17:52.080 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:52.107 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:52 +0000 (0:00:00.055) 0:03:38.191 ***** 2021-11-18T10:17:52.151 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:52.183 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:52 +0000 (0:00:00.075) 0:03:38.266 ***** 2021-11-18T10:17:52.360 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-11-18T10:17:52.362 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-11-18T10:17:52.390 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:52 +0000 (0:00:00.207) 0:03:38.474 ***** 2021-11-18T10:17:52.438 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-11-18T10:17:52.440 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930261180416, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227114546, 'block_used': 12980562, 'inode_total': 61054976, 'inode_available': 60985806, 'inode_used': 69170, 'uuid': '07628eed-a557-464f-85de-804be6e662c1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227114546, "block_size": 4096, "block_total": 240095108, "block_used": 12980562, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60985806, "inode_total": 61054976, "inode_used": 69170, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930261180416, "size_total": 983429562368, "uuid": "07628eed-a557-464f-85de-804be6e662c1"}, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:52.462 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:52 +0000 (0:00:00.071) 0:03:38.545 ***** 2021-11-18T10:17:52.468 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-18T10:17:52.471 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-18T10:17:52.491 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:52.521 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:52 +0000 (0:00:00.059) 0:03:38.604 ***** 2021-11-18T10:17:52.559 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:52.561 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:52.582 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:52 +0000 (0:00:00.060) 0:03:38.665 ***** 2021-11-18T10:17:52.609 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:52.610 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:52.632 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:52 +0000 (0:00:00.050) 0:03:38.715 ***** 2021-11-18T10:17:52.659 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-11-18T10:17:52.661 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:52.683 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:52 +0000 (0:00:00.051) 0:03:38.767 ***** 2021-11-18T10:17:52.721 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-11-18T10:17:52.723 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:52.744 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:52 +0000 (0:00:00.060) 0:03:38.828 ***** 2021-11-18T10:17:52.772 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-18T10:17:52.773 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} TASK [testnode : Create logical_volumes dict] ********************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:52.801 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:52 +0000 (0:00:00.056) 0:03:38.885 ***** 2021-11-18T10:17:53.069 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-18T10:17:53.071 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-18T10:17:53.371 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-18T10:17:53.465 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-11-18T10:17:53.486 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:53 +0000 (0:00:00.685) 0:03:39.570 ***** 2021-11-18T10:17:53.661 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-18T10:17:53.663 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-18T10:17:53.687 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:53 +0000 (0:00:00.200) 0:03:39.770 ***** 2021-11-18T10:17:53.851 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-18T10:17:53.852 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-18T10:17:53.875 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:53 +0000 (0:00:00.187) 0:03:39.958 ***** 2021-11-18T10:17:54.050 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-18T10:17:54.051 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-18T10:17:54.146 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-18T10:17:54.148 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-18T10:17:54.194 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-18T10:17:54.195 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-18T10:17:54.331 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-18T10:17:54.448 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-18T10:17:54.450 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-18T10:17:54.492 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-18T10:17:54.494 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-18T10:17:54.504 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:54.529 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:54 +0000 (0:00:00.654) 0:03:40.613 ***** 2021-11-18T10:17:54.558 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:54.581 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:54 +0000 (0:00:00.052) 0:03:40.665 ***** 2021-11-18T10:17:54.583 INFO:teuthology.task.ansible.out: 2021-11-18T10:17:54.610 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-18T10:17:54.612 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:54.634 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:54 +0000 (0:00:00.052) 0:03:40.718 ***** 2021-11-18T10:17:54.789 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-11-18T10:17:54.790 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-18T10:17:54.801 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-18T10:17:54.803 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-18T10:17:54.825 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:54 +0000 (0:00:00.191) 0:03:40.909 ***** 2021-11-18T10:17:54.865 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-18T10:17:54.889 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:54 +0000 (0:00:00.064) 0:03:40.973 ***** 2021-11-18T10:17:55.115 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "msg": ""} 2021-11-18T10:17:55.140 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.250) 0:03:41.224 ***** 2021-11-18T10:17:55.157 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-18T10:17:55.159 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true} 2021-11-18T10:17:55.184 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.043) 0:03:41.267 ***** 2021-11-18T10:17:55.306 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-11-18T10:17:55.307 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-11-18T10:17:55.329 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.144) 0:03:41.412 ***** 2021-11-18T10:17:55.503 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-18T10:17:55.505 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-18T10:17:55.547 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-11-18T10:17:55.548 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-18T10:17:55.571 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.242) 0:03:41.655 ***** 2021-11-18T10:17:55.599 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:55.622 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.050) 0:03:41.705 ***** 2021-11-18T10:17:55.649 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-18T10:17:55.651 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-18T10:17:55.673 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.051) 0:03:41.756 ***** 2021-11-18T10:17:55.700 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-18T10:17:55.702 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:55.723 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.050) 0:03:41.806 ***** 2021-11-18T10:17:55.761 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-18T10:17:55.763 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:55.785 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.062) 0:03:41.869 ***** 2021-11-18T10:17:55.793 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-18T10:17:55.794 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-11-18T10:17:55.816 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-18T10:17:55.818 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:55.839 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.053) 0:03:41.923 ***** 2021-11-18T10:17:55.869 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-18T10:17:55.870 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:55.893 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.053) 0:03:41.977 ***** 2021-11-18T10:17:55.924 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-18T10:17:55.926 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '84G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "84G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:55.952 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.058) 0:03:42.035 ***** 2021-11-18T10:17:55.961 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-11-18T10:17:55.963 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '13G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "13G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:55.990 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:55 +0000 (0:00:00.038) 0:03:42.074 ***** 2021-11-18T10:17:55.997 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-18T10:17:55.999 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:56.023 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.032) 0:03:42.106 ***** 2021-11-18T10:17:56.029 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-11-18T10:17:56.032 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:56.054 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.030) 0:03:42.137 ***** 2021-11-18T10:17:56.061 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-18T10:17:56.062 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:56.086 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.032) 0:03:42.169 ***** 2021-11-18T10:17:56.093 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-11-18T10:17:56.095 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:56.119 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.033) 0:03:42.203 ***** 2021-11-18T10:17:56.126 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-18T10:17:56.128 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:56.151 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.032) 0:03:42.235 ***** 2021-11-18T10:17:56.191 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-18T10:17:56.193 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:56.215 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.064) 0:03:42.299 ***** 2021-11-18T10:17:56.245 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-11-18T10:17:56.247 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:56.276 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.060) 0:03:42.360 ***** 2021-11-18T10:17:56.297 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-11-18T10:17:56.299 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-18T10:17:56.322 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.045) 0:03:42.405 ***** 2021-11-18T10:17:56.329 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-11-18T10:17:56.331 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:56.355 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.032) 0:03:42.438 ***** 2021-11-18T10:17:56.362 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-11-18T10:17:56.363 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-11-18T10:17:56.387 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.032) 0:03:42.471 ***** 2021-11-18T10:17:56.395 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-18T10:17:56.397 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:56.421 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.033) 0:03:42.504 ***** 2021-11-18T10:17:56.449 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-18T10:17:56.451 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:56.473 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.052) 0:03:42.557 ***** 2021-11-18T10:17:56.565 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2021-11-18T10:17:56.567 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true} 2021-11-18T10:17:56.594 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.120) 0:03:42.677 ***** 2021-11-18T10:17:56.859 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-18T10:17:56.861 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-11-18T10:17:56.861 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-11-18T10:17:56.884 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.290) 0:03:42.968 ***** 2021-11-18T10:17:56.907 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.022) 0:03:42.991 ***** 2021-11-18T10:17:56.935 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-11-18T10:17:56.937 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:56.960 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:56 +0000 (0:00:00.052) 0:03:43.043 ***** 2021-11-18T10:17:56.987 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-11-18T10:17:56.988 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.021 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.060) 0:03:43.104 ***** 2021-11-18T10:17:57.052 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-11-18T10:17:57.054 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.080 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.059) 0:03:43.164 ***** 2021-11-18T10:17:57.111 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.135 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.054) 0:03:43.218 ***** 2021-11-18T10:17:57.143 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-18T10:17:57.145 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1015", "ExecMainStartTimestamp": "Thu 2021-11-18 10:13:44 UTC", "ExecMainStartTimestampMonotonic": "11379101", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSI 2021-11-18T10:17:57.146 INFO:teuthology.task.ansible.out:ZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127293", "LimitNPROCSoft": "127293", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127293", "LimitSIGPENDINGSoft": "127293", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1015", "MemoryAccounting": "yes", "MemoryCurrent": "1839104", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203668", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Thu 2021-11-18 2021-11-18T10:17:57.148 INFO:teuthology.task.ansible.out:10:13:44 UTC", "WatchdogTimestampMonotonic": "11379108", "WatchdogUSec": "0"}} 2021-11-18T10:17:57.180 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.044) 0:03:43.263 ***** 2021-11-18T10:17:57.194 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2021-11-18T10:17:57.195 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.229 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.048) 0:03:43.312 ***** 2021-11-18T10:17:57.237 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:57.239 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-18T10:17:57.268 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.039) 0:03:43.352 ***** 2021-11-18T10:17:57.279 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-11-18T10:17:57.281 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.305 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.036) 0:03:43.388 ***** 2021-11-18T10:17:57.311 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:57.312 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-18T10:17:57.340 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.034) 0:03:43.423 ***** 2021-11-18T10:17:57.347 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-11-18T10:17:57.349 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.373 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.032) 0:03:43.455 ***** 2021-11-18T10:17:57.378 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-18T10:17:57.380 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.403 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.030) 0:03:43.486 ***** 2021-11-18T10:17:57.410 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-11-18T10:17:57.412 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.433 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.030) 0:03:43.517 ***** 2021-11-18T10:17:57.440 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-18T10:17:57.442 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.465 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.031) 0:03:43.548 ***** 2021-11-18T10:17:57.472 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-11-18T10:17:57.474 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.495 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.030) 0:03:43.579 ***** 2021-11-18T10:17:57.501 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-18T10:17:57.503 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.531 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.035) 0:03:43.614 ***** 2021-11-18T10:17:57.538 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-11-18T10:17:57.540 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.563 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.031) 0:03:43.646 ***** 2021-11-18T10:17:57.589 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-11-18T10:17:57.591 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.613 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.049) 0:03:43.696 ***** 2021-11-18T10:17:57.642 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.664 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.051) 0:03:43.748 ***** 2021-11-18T10:17:57.693 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-18T10:17:57.695 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.716 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.052) 0:03:43.800 ***** 2021-11-18T10:17:57.741 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.022) 0:03:43.822 ***** 2021-11-18T10:17:57.767 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-11-18T10:17:57.769 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.791 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.052) 0:03:43.875 ***** 2021-11-18T10:17:57.819 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-11-18T10:17:57.821 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:57.842 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:57 +0000 (0:00:00.051) 0:03:43.926 ***** 2021-11-18T10:17:58.112 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-18T10:17:58.114 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-11-18T10:17:58.137 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:58 +0000 (0:00:00.295) 0:03:44.221 ***** 2021-11-18T10:17:58.230 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-11-18T10:17:58.232 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2021-11-18T10:17:58.261 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:58 +0000 (0:00:00.123) 0:03:44.345 ***** 2021-11-18T10:17:58.512 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-11-18T10:17:58.514 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveState": "active", "AllowedCPUs": "", "AllowedMemoryNodes": "", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "DevicePolicy": "auto", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1007", "ExecMainStartTimestamp": "Thu 2021-11-18 10:13:44 UTC", "ExecMainStartTimestampMonotonic": "11146562", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FileDescriptorStoreMax": "0", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSI 2021-11-18T10:17:58.516 INFO:teuthology.task.ansible.out:ZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127293", "LimitNPROCSoft": "127293", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127293", "LimitSIGPENDINGSoft": "127293", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "MainPID": "1007", "MemoryAccounting": "yes", "MemoryCurrent": "1949696", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Nice": "0", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "RemainAfterExit": "no", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeMaxUSec": "infinity", "SecureBits": "0", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StatusErrno": "0", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203668", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Type": "forking", "UID": "[not set]", "UMask": "0022", "WatchdogTimestamp": "Thu 2021-11-18 2021-11-18T10:17:58.517 INFO:teuthology.task.ansible.out:10:13:44 UTC", "WatchdogTimestampMonotonic": "11146570", "WatchdogUSec": "0"}} 2021-11-18T10:17:58.535 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:58 +0000 (0:00:00.274) 0:03:44.619 ***** 2021-11-18T10:17:58.563 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:58.565 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-11-18T10:17:58.590 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:58 +0000 (0:00:00.054) 0:03:44.674 ***** 2021-11-18T10:17:58.628 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:17:58.630 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-11-18T10:17:58.650 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:58 +0000 (0:00:00.060) 0:03:44.734 ***** 2021-11-18T10:17:58.687 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-11-18T10:17:58.689 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:58.710 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:58 +0000 (0:00:00.059) 0:03:44.793 ***** 2021-11-18T10:17:58.739 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-11-18T10:17:58.741 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:58.763 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:58 +0000 (0:00:00.053) 0:03:44.847 ***** 2021-11-18T10:17:58.793 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-11-18T10:17:58.795 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:58.818 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:58 +0000 (0:00:00.055) 0:03:44.902 ***** 2021-11-18T10:17:58.983 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-11-18T10:17:58.985 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2021-11-18T10:17:59.006 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:58 +0000 (0:00:00.187) 0:03:45.090 ***** 2021-11-18T10:17:59.171 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-18T10:17:59.173 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)"], "version": null, "virtualenv": null} 2021-11-18T10:17:59.196 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:59 +0000 (0:00:00.189) 0:03:45.280 ***** 2021-11-18T10:17:59.225 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:59.248 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:59 +0000 (0:00:00.052) 0:03:45.332 ***** 2021-11-18T10:17:59.275 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-18T10:17:59.276 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-18T10:17:59.298 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:59 +0000 (0:00:00.049) 0:03:45.381 ***** 2021-11-18T10:17:59.399 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-11-18T10:17:59.401 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1254, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2021-11-18T10:17:59.435 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:59 +0000 (0:00:00.137) 0:03:45.519 ***** 2021-11-18T10:17:59.453 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-18T10:17:59.454 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-11-18T10:17:59.479 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:59 +0000 (0:00:00.043) 0:03:45.562 ***** 2021-11-18T10:17:59.507 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-18T10:17:59.509 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:59.532 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:59 +0000 (0:00:00.053) 0:03:45.616 ***** 2021-11-18T10:17:59.571 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-18T10:17:59.573 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-18T10:17:59.595 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:59 +0000 (0:00:00.063) 0:03:45.679 ***** 2021-11-18T10:17:59.624 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-18T10:17:59.626 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:17:59.647 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:59 +0000 (0:00:00.051) 0:03:45.731 ***** 2021-11-18T10:17:59.800 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-18T10:17:59.802 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-18T10:17:59.824 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:17:59 +0000 (0:00:00.176) 0:03:45.907 ***** 2021-11-18T10:17:59.978 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-18T10:17:59.980 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-18T10:18:00.007 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.183) 0:03:46.090 ***** 2021-11-18T10:18:00.034 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-18T10:18:00.036 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.056 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.049) 0:03:46.140 ***** 2021-11-18T10:18:00.095 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-18T10:18:00.097 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.107 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.108 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.118 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.120 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.142 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.085) 0:03:46.226 ***** 2021-11-18T10:18:00.181 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-18T10:18:00.183 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba005.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.193 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.195 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.215 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.238 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.096) 0:03:46.322 ***** 2021-11-18T10:18:00.266 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:18:00.268 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.293 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.054) 0:03:46.377 ***** 2021-11-18T10:18:00.322 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-18T10:18:00.324 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.348 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.054) 0:03:46.431 ***** 2021-11-18T10:18:00.377 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-11-18T10:18:00.379 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)"], "version": null, "virtualenv": null} TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.410 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.062) 0:03:46.494 ***** 2021-11-18T10:18:00.432 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.021) 0:03:46.515 ***** 2021-11-18T10:18:00.449 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-11-18T10:18:00.451 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.472 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.040) 0:03:46.556 ***** 2021-11-18T10:18:00.480 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-11-18T10:18:00.482 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.504 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.031) 0:03:46.587 ***** 2021-11-18T10:18:00.511 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-18T10:18:00.512 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.537 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.033) 0:03:46.621 ***** 2021-11-18T10:18:00.545 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-11-18T10:18:00.547 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp1s0f0"}, "changed": false} 2021-11-18T10:18:00.570 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.032) 0:03:46.654 ***** 2021-11-18T10:18:00.576 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-18T10:18:00.578 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.605 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.034) 0:03:46.688 ***** 2021-11-18T10:18:00.643 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-18T10:18:00.645 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.669 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.064) 0:03:46.753 ***** 2021-11-18T10:18:00.697 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-18T10:18:00.699 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.721 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.050) 0:03:46.804 ***** 2021-11-18T10:18:00.729 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-11-18T10:18:00.730 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-11-18T10:18:00.754 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.033) 0:03:46.837 ***** 2021-11-18T10:18:00.791 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-11-18T10:18:00.793 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.814 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.060) 0:03:46.898 ***** 2021-11-18T10:18:00.854 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-11-18T10:18:00.855 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-11-18T10:18:00.877 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.063) 0:03:46.961 ***** 2021-11-18T10:18:00.895 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-18T10:18:00.896 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.003535", "end": "2021-11-18 10:18:00.870779", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-18 10:18:00.867244", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:18:00.906 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-11-18T10:18:00.908 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:00.936 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:00 +0000 (0:00:00.058) 0:03:47.019 ***** 2021-11-18T10:18:01.036 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-18T10:18:01.038 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001993", "end": "2021-11-18 10:18:01.009989", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-18 10:18:01.007996", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:18:01.089 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-11-18T10:18:01.091 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-11-18T10:18:01.112 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.176) 0:03:47.196 ***** 2021-11-18T10:18:01.172 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-18T10:18:01.174 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001824", "end": "2021-11-18 10:18:01.145238", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-18 10:18:01.143414", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-18T10:18:01.267 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-11-18T10:18:01.269 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-11-18T10:18:01.290 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.178) 0:03:47.374 ***** 2021-11-18T10:18:01.308 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-18T10:18:01.310 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.002134", "end": "2021-11-18 10:18:01.282416", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-18 10:18:01.280282", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:18:01.332 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.041) 0:03:47.416 ***** 2021-11-18T10:18:01.340 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-11-18T10:18:01.340 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.363 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.031) 0:03:47.447 ***** 2021-11-18T10:18:01.369 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-18T10:18:01.395 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.031) 0:03:47.479 ***** 2021-11-18T10:18:01.414 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-11-18T10:18:01.415 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item=enp1s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item=enp1s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.438 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.043) 0:03:47.522 ***** 2021-11-18T10:18:01.445 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-18T10:18:01.446 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.491 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-11-18T10:18:01.493 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [gibba019.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp1s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp1s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.493 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.493 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional res 2021-11-18T10:18:01.495 INFO:teuthology.task.ansible.out:ult was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.527 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.087) 0:03:47.610 ***** 2021-11-18T10:18:01.554 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-11-18T10:18:01.556 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.579 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.053) 0:03:47.663 ***** 2021-11-18T10:18:01.606 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-11-18T10:18:01.608 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.629 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.049) 0:03:47.712 ***** 2021-11-18T10:18:01.656 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.680 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.051) 0:03:47.764 ***** 2021-11-18T10:18:01.707 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.729 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.048) 0:03:47.813 ***** 2021-11-18T10:18:01.756 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-11-18T10:18:01.758 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.779 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.050) 0:03:47.863 ***** 2021-11-18T10:18:01.806 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-18T10:18:01.808 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.831 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.051) 0:03:47.914 ***** 2021-11-18T10:18:01.858 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-11-18T10:18:01.860 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.885 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.053) 0:03:47.968 ***** 2021-11-18T10:18:01.911 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-11-18T10:18:01.913 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:01.933 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:01 +0000 (0:00:00.048) 0:03:48.016 ***** 2021-11-18T10:18:02.106 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-11-18T10:18:02.108 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.003425", "end": "2021-11-18 10:18:02.081466", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-11-18 10:18:02.078041", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:18:02.248 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.001991", "end": "2021-11-18 10:18:02.222017", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-11-18 10:18:02.220026", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:18:02.383 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.001893", "end": "2021-11-18 10:18:02.356463", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-11-18 10:18:02.354570", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2021-11-18T10:18:02.520 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.002135", "end": "2021-11-18 10:18:02.492762", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-11-18 10:18:02.490627", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:18:02.554 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:02 +0000 (0:00:00.620) 0:03:48.637 ***** 2021-11-18T10:18:02.594 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-11-18T10:18:02.616 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:02 +0000 (0:00:00.062) 0:03:48.699 ***** 2021-11-18T10:18:02.653 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-11-18T10:18:02.655 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:02.721 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-11-18T10:18:02.738 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:02 +0000 (0:00:00.122) 0:03:48.822 ***** 2021-11-18T10:18:02.760 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:02 +0000 (0:00:00.021) 0:03:48.844 ***** 2021-11-18T10:18:03.330 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [gibba005.front.sepia.ceph.com] 2021-11-18T10:18:03.339 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] 2021-11-18T10:18:03.395 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:03 +0000 (0:00:00.635) 0:03:49.479 ***** 2021-11-18T10:18:03.416 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:03 +0000 (0:00:00.020) 0:03:49.500 ***** 2021-11-18T10:18:03.424 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-18T10:18:03.425 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:03.448 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:03 +0000 (0:00:00.031) 0:03:49.532 ***** 2021-11-18T10:18:03.455 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:03.479 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:03 +0000 (0:00:00.030) 0:03:49.563 ***** 2021-11-18T10:18:03.485 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-18T10:18:03.487 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-11-18T10:18:03.510 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:03 +0000 (0:00:00.030) 0:03:49.593 ***** 2021-11-18T10:18:03.516 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "yum"}, "changed": false} 2021-11-18T10:18:03.540 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:03 +0000 (0:00:00.030) 0:03:49.624 ***** 2021-11-18T10:18:03.558 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-11-18T10:18:03.559 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-11-18T10:18:03.582 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:03 +0000 (0:00:00.041) 0:03:49.666 ***** 2021-11-18T10:18:03.589 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml) => {"ansible_facts": {"container_packages": ["podman", "podman-docker"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/yum_systems.yml"} 2021-11-18T10:18:03.613 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:03 +0000 (0:00:00.031) 0:03:49.697 ***** 2021-11-18T10:18:19.710 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-11-18T10:18:19.712 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: container-selinux-2:2.167.0-1.module_el8.5.0+911+f19012f9.noarch", "Installed: podman-3.3.1-9.module_el8.5.0+988+b1f0b741.x86_64", "Installed: podman-catatonit-3.3.1-9.module_el8.5.0+988+b1f0b741.x86_64", "Installed: containers-common-2:1-2.module_el8.5.0+890+6b136101.noarch", "Installed: podman-docker-3.3.1-9.module_el8.5.0+988+b1f0b741.noarch", "Removed: container-selinux-2:2.162.0-1.module_el8.4.0+830+8027e1c4.noarch", "Removed: containers-common-1:1.2.2-10.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-catatonit-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-docker-3.0.1-7.module_el8.4.0+830+8027e1c4.noarch"]} 2021-11-18T10:18:19.733 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:19 +0000 (0:00:16.119) 0:04:05.817 ***** 2021-11-18T10:18:19.752 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: container-selinux-2:2.167.0-1.module_el8.5.0+911+f19012f9.noarch", "Installed: podman-3.3.1-9.module_el8.5.0+988+b1f0b741.x86_64", "Installed: podman-catatonit-3.3.1-9.module_el8.5.0+988+b1f0b741.x86_64", "Installed: containers-common-2:1-2.module_el8.5.0+890+6b136101.noarch", "Installed: podman-docker-3.3.1-9.module_el8.5.0+988+b1f0b741.noarch", "Removed: container-selinux-2:2.162.0-1.module_el8.4.0+830+8027e1c4.noarch", "Removed: containers-common-1:1.2.2-10.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-catatonit-3.0.1-7.module_el8.4.0+830+8027e1c4.x86_64", "Removed: podman-docker-3.0.1-7.module_el8.4.0+830+8027e1c4.noarch"]} 2021-11-18T10:18:19.775 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:19 +0000 (0:00:00.041) 0:04:05.858 ***** 2021-11-18T10:18:19.782 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-18T10:18:19.782 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-11-18T10:18:19.807 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:19 +0000 (0:00:00.031) 0:04:05.890 ***** 2021-11-18T10:18:19.814 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/containers/registries.conf"}, "changed": false} 2021-11-18T10:18:19.838 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:19 +0000 (0:00:00.031) 0:04:05.922 ***** 2021-11-18T10:18:19.845 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-11-18T10:18:19.847 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:19.870 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:19 +0000 (0:00:00.031) 0:04:05.954 ***** 2021-11-18T10:18:19.878 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:19.902 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:19 +0000 (0:00:00.032) 0:04:05.986 ***** 2021-11-18T10:18:20.066 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-11-18T10:18:20.068 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-18T10:18:20.099 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-18T10:18:20.216 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-18T10:18:20.243 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:20 +0000 (0:00:00.340) 0:04:06.326 ***** 2021-11-18T10:18:20.264 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2021-11-18T10:18:20.292 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:20 +0000 (0:00:00.049) 0:04:06.376 ***** 2021-11-18T10:18:20.645 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-11-18T10:18:20.651 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-18T10:18:20.701 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:cert_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-18T10:18:20.991 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-18T10:18:21.016 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:21 +0000 (0:00:00.723) 0:04:07.100 ***** 2021-11-18T10:18:21.036 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": false, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0644", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "secontext": "system_u:object_r:etc_t:s0", "size": 2334, "state": "file", "uid": 0} 2021-11-18T10:18:21.077 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:21 +0000 (0:00:00.061) 0:04:07.161 ***** 2021-11-18T10:18:22.136 INFO:teuthology.task.ansible.out: TASK [container-host : Ensure git is installed] ******************************** 2021-11-18T10:18:22.138 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:18:22.160 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:22 +0000 (0:00:01.082) 0:04:08.244 ***** 2021-11-18T10:18:22.179 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2021-11-18T10:18:22.204 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:22 +0000 (0:00:00.043) 0:04:08.288 ***** 2021-11-18T10:18:24.178 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-11-18T10:18:24.179 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-xq6gv4l8-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-xq6gv4l8-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py ins 2021-11-18T10:18:24.181 INFO:teuthology.task.ansible.out:tall for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-18T10:18:24.204 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:24 +0000 (0:00:01.999) 0:04:10.287 ***** 2021-11-18T10:18:24.222 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-4tijsgeu-build\nRequirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nRequirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)\nInstalling collected packages: registries-conf-ctl\n Found existing installation: registries-conf-ctl 1.0\n Uninstalling registries-conf-ctl-1.0:\n Successfully uninstalled registries-conf-ctl-1.0\n Running setup.py install for registries-conf-ctl: started\n Running setup.py install for registries-conf-ctl: finished with status 'done'\nSuccessfully installed registries-conf-ctl-1.0\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-4tijsgeu-build", "Requirement already up-to-date: toml in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Requirement already up-to-date: docopt in /usr/local/lib/python3.6/site-packages (from registries-conf-ctl==1.0)", "Installing collected packages: registries-conf-ctl", " Found existing installation: registries-conf-ctl 1.0", " Uninstalling registries-conf-ctl-1.0:", " Successfully uninstalled registries-conf-ctl-1.0", " Running setup.py ins 2021-11-18T10:18:24.224 INFO:teuthology.task.ansible.out:tall for registries-conf-ctl: started", " Running setup.py install for registries-conf-ctl: finished with status 'done'", "Successfully installed registries-conf-ctl-1.0"], "version": null, "virtualenv": null} 2021-11-18T10:18:24.244 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:24 +0000 (0:00:00.040) 0:04:10.328 ***** 2021-11-18T10:18:24.251 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-11-18T10:18:24.252 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:24.279 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:24 +0000 (0:00:00.034) 0:04:10.363 ***** 2021-11-18T10:18:24.287 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:24.311 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:24 +0000 (0:00:00.032) 0:04:10.395 ***** 2021-11-18T10:18:24.318 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/containers/registries.conf if necessary] **** 2021-11-18T10:18:24.320 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:24.344 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:24 +0000 (0:00:00.032) 0:04:10.427 ***** 2021-11-18T10:18:24.351 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:24.376 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:24 +0000 (0:00:00.032) 0:04:10.460 ***** 2021-11-18T10:18:24.613 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-11-18T10:18:24.614 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.113266", "end": "2021-11-18 10:18:24.600815", "rc": 0, "start": "2021-11-18 10:18:24.487549", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:18:24.639 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:24 +0000 (0:00:00.262) 0:04:10.723 ***** 2021-11-18T10:18:24.660 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.110764", "end": "2021-11-18 10:18:24.646542", "rc": 0, "start": "2021-11-18 10:18:24.535778", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-11-18T10:18:24.682 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:24 +0000 (0:00:00.043) 0:04:10.766 ***** 2021-11-18T10:18:24.690 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-11-18T10:18:24.692 INFO:teuthology.task.ansible.out:skipping: [gibba005.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:24.717 INFO:teuthology.task.ansible.out:skipping: [gibba019.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-11-18T10:18:24.795 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-11-18T10:18:24.797 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-11-18T10:18:24.797 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2021-11-18T10:18:24.798 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2021-11-18T10:18:24.799 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-11-18T10:18:24.812 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2021-11-18T10:18:24.814 INFO:teuthology.task.ansible.out:Thursday 18 November 2021 10:18:24 +0000 (0:00:00.130) 0:04:10.896 ***** 2021-11-18T10:18:25.400 INFO:teuthology.task.ansible.out:ok: [gibba005.front.sepia.ceph.com] 2021-11-18T10:18:25.411 INFO:teuthology.task.ansible.out:ok: [gibba019.front.sepia.ceph.com] 2021-11-18T10:18:25.427 INFO:teuthology.task.ansible.out: TASK [Touch /ceph-qa-ready] **************************************************** Thursday 18 November 2021 10:18:25 +0000 (0:00:00.615) 0:04:11.511 ***** 2021-11-18T10:18:25.590 INFO:teuthology.task.ansible.out:changed: [gibba005.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-18T10:18:25.611 INFO:teuthology.task.ansible.out:changed: [gibba019.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2021-11-18T10:18:25.614 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* gibba005.front.sepia.ceph.com : ok=135 changed=44 unreachable=0 failed=0 skipped=184 rescued=0 ignored=3 2021-11-18T10:18:25.615 INFO:teuthology.task.ansible.out:gibba019.front.sepia.ceph.com : ok=135 changed=44 unreachable=0 failed=0 skipped=184 rescued=0 ignored=3 Thursday 18 November 2021 10:18:25 +0000 (0:00:00.186) 0:04:11.698 ***** =============================================================================== Create all admin users with sudo access. ------------------------------- 30.84s common : nrpe - Ensure SELinux policy is up to date -------------------- 25.97s users : Update authorized_keys using the keys repo --------------------- 25.82s container-host : Install container packages ---------------------------- 16.12s Remove revoked users --------------------------------------------------- 15.97s testnode : Ensure ceph packages are not present. ----------------------- 15.25s common : nrpe - Remove SELinux policy package --------------------------- 9.08s common : nrpe - Load SELinux policy package ----------------------------- 9.01s testnode : Install packages --------------------------------------------- 7.42s testnode : Zap all non-root disks --------------------------------------- 7.30s common : Install Kerberos Packages (RedHat) ----------------------------- 3.51s testnode : Install GPG keys --------------------------------------------- 2.25s testnode : Install GPG -------------------------------------------------- 2.15s container-host : Install registries-conf-ctl ---------------------------- 2.00s testnode : Rebuild rpmdb ------------------------------------------------ 1.74s users : Update authorized_keys for each user with literal keys ---------- 1.70s testnode : Upgrade packages --------------------------------------------- 1.57s testnode : Ensure ceph dependency packages are not present. ------------- 1.42s Gathering Facts --------------------------------------------------------- 1.32s container-host : Ensure git is installed -------------------------------- 1.08s 2021-11-18T10:18:26.037 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@gibba005.front.sepia.ceph.com'), Remote(name='ubuntu@gibba019.front.sepia.ceph.com')] 2021-11-18T10:18:26.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba005.front.sepia.ceph.com' 2021-11-18T10:18:26.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba005.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-18T10:18:26.108 DEBUG:teuthology.orchestra.run.gibba005:> true 2021-11-18T10:18:26.179 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@gibba019.front.sepia.ceph.com' 2021-11-18T10:18:26.180 DEBUG:teuthology.orchestra.connection:{'hostname': 'gibba019.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-11-18T10:18:26.247 DEBUG:teuthology.orchestra.run.gibba019:> true 2021-11-18T10:18:26.319 INFO:teuthology.run_tasks:Running task clock... 2021-11-18T10:18:26.338 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-11-18T10:18:26.338 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-18T10:18:26.340 DEBUG:teuthology.orchestra.run.gibba005:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-18T10:18:26.365 INFO:teuthology.orchestra.run.gibba005.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-11-18T10:18:26.376 INFO:teuthology.orchestra.run.gibba005.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-11-18T10:18:26.403 INFO:teuthology.orchestra.run.gibba005.stderr:sudo: ntpd: command not found 2021-11-18T10:18:26.410 INFO:teuthology.orchestra.run.gibba005.stdout:506 Cannot talk to daemon 2021-11-18T10:18:26.424 INFO:teuthology.orchestra.run.gibba005.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-11-18T10:18:26.430 INFO:teuthology.orchestra.run.gibba005.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-11-18T10:18:26.487 INFO:teuthology.orchestra.run.gibba005.stderr:bash: ntpq: command not found 2021-11-18T10:18:26.490 INFO:teuthology.orchestra.run.gibba005.stdout:210 Number of sources = 4 2021-11-18T10:18:26.491 INFO:teuthology.orchestra.run.gibba005.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-11-18T10:18:26.491 INFO:teuthology.orchestra.run.gibba005.stdout:=============================================================================== 2021-11-18T10:18:26.491 INFO:teuthology.orchestra.run.gibba005.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-18T10:18:26.491 INFO:teuthology.orchestra.run.gibba005.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-18T10:18:26.491 INFO:teuthology.orchestra.run.gibba005.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-18T10:18:26.492 INFO:teuthology.orchestra.run.gibba005.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-18T10:18:26.492 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-11-18T10:18:26.492 DEBUG:teuthology.orchestra.run.gibba019:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-11-18T10:18:26.518 INFO:teuthology.orchestra.run.gibba019.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2021-11-18T10:18:26.529 INFO:teuthology.orchestra.run.gibba019.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2021-11-18T10:18:26.557 INFO:teuthology.orchestra.run.gibba019.stderr:sudo: ntpd: command not found 2021-11-18T10:18:26.565 INFO:teuthology.orchestra.run.gibba019.stdout:506 Cannot talk to daemon 2021-11-18T10:18:26.575 INFO:teuthology.orchestra.run.gibba019.stderr:Failed to start ntp.service: Unit ntp.service not found. 2021-11-18T10:18:26.586 INFO:teuthology.orchestra.run.gibba019.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2021-11-18T10:18:26.649 INFO:teuthology.orchestra.run.gibba019.stderr:bash: ntpq: command not found 2021-11-18T10:18:26.652 INFO:teuthology.orchestra.run.gibba019.stdout:210 Number of sources = 4 2021-11-18T10:18:26.652 INFO:teuthology.orchestra.run.gibba019.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2021-11-18T10:18:26.652 INFO:teuthology.orchestra.run.gibba019.stdout:=============================================================================== 2021-11-18T10:18:26.652 INFO:teuthology.orchestra.run.gibba019.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-18T10:18:26.653 INFO:teuthology.orchestra.run.gibba019.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-18T10:18:26.653 INFO:teuthology.orchestra.run.gibba019.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-18T10:18:26.653 INFO:teuthology.orchestra.run.gibba019.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2021-11-18T10:18:26.653 INFO:teuthology.run_tasks:Running task install... 2021-11-18T10:18:26.665 DEBUG:teuthology.task.install:project ceph 2021-11-18T10:18:26.666 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}} 2021-11-18T10:18:26.666 DEBUG:teuthology.task.install:config {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'} 2021-11-18T10:18:26.667 INFO:teuthology.task.install:Using flavor: default 2021-11-18T10:18:26.674 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-11-18T10:18:26.674 INFO:teuthology.task.install:extra packages: ['rbd-mirror'] 2021-11-18T10:18:26.675 DEBUG:teuthology.orchestra.run.gibba005:> sudo lsb_release -is 2021-11-18T10:18:26.702 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS 2021-11-18T10:18:26.703 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-18T10:18:26.703 DEBUG:teuthology.orchestra.run.gibba019:> sudo lsb_release -is 2021-11-18T10:18:26.704 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-mirror'], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f', 'tag': None, 'wait_for_package': False} 2021-11-18T10:18:26.705 DEBUG:teuthology.orchestra.run.gibba005:> sudo lsb_release -is 2021-11-18T10:18:26.731 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS 2021-11-18T10:18:26.734 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-18T10:18:26.735 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': ['rbd-mirror'], 'extra_system_packages': [], 'extras': None, 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f', 'tag': None, 'wait_for_package': False} 2021-11-18T10:18:26.735 DEBUG:teuthology.orchestra.run.gibba019:> sudo lsb_release -is 2021-11-18T10:18:26.770 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS 2021-11-18T10:18:26.772 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-18T10:18:26.773 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44cd7c7650ed2227d3597352b00bd2ef65f4388f 2021-11-18T10:18:26.804 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS 2021-11-18T10:18:26.806 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-18T10:18:26.807 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44cd7c7650ed2227d3597352b00bd2ef65f4388f 2021-11-18T10:18:27.021 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/master/44cd7c7650ed2227d3597352b00bd2ef65f4388f/centos/8/flavors/default/ 2021-11-18T10:18:27.021 INFO:teuthology.task.install.rpm:Package version is 17.0.0-9003.g44cd7c76 2021-11-18T10:18:27.026 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/master/44cd7c7650ed2227d3597352b00bd2ef65f4388f/centos/8/flavors/default/ 2021-11-18T10:18:27.027 INFO:teuthology.task.install.rpm:Package version is 17.0.0-9003.g44cd7c76 2021-11-18T10:18:27.301 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/master/44cd7c7650ed2227d3597352b00bd2ef65f4388f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/master/44cd7c7650ed2227d3597352b00bd2ef65f4388f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/master/44cd7c7650ed2227d3597352b00bd2ef65f4388f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-11-18T10:18:27.302 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:18:27.303 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-11-18T10:18:27.307 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/master/44cd7c7650ed2227d3597352b00bd2ef65f4388f/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/master/44cd7c7650ed2227d3597352b00bd2ef65f4388f/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/master/44cd7c7650ed2227d3597352b00bd2ef65f4388f/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2021-11-18T10:18:27.307 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:18:27.308 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/etc/yum.repos.d/ceph.repo 2021-11-18T10:18:27.329 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-mirror on remote rpm x86_64 2021-11-18T10:18:27.330 DEBUG:teuthology.orchestra.run.gibba019:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/44cd7c7650ed2227d3597352b00bd2ef65f4388f/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-11-18T10:18:27.331 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, rbd-mirror on remote rpm x86_64 2021-11-18T10:18:27.332 DEBUG:teuthology.orchestra.run.gibba005:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/44cd7c7650ed2227d3597352b00bd2ef65f4388f/;g' /etc/yum.repos.d/ceph.repo ; fi 2021-11-18T10:18:27.390 DEBUG:teuthology.orchestra.run.gibba019:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-11-18T10:18:27.391 DEBUG:teuthology.orchestra.run.gibba005:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2021-11-18T10:18:27.458 DEBUG:teuthology.orchestra.run.gibba019:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-11-18T10:18:27.460 DEBUG:teuthology.orchestra.run.gibba005:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2021-11-18T10:18:27.517 INFO:teuthology.orchestra.run.gibba019.stdout:check_obsoletes = 1 2021-11-18T10:18:27.518 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum clean all 2021-11-18T10:18:27.521 INFO:teuthology.orchestra.run.gibba005.stdout:check_obsoletes = 1 2021-11-18T10:18:27.522 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum clean all 2021-11-18T10:18:27.711 INFO:teuthology.orchestra.run.gibba019.stdout:93 files removed 2021-11-18T10:18:27.712 INFO:teuthology.orchestra.run.gibba005.stdout:93 files removed 2021-11-18T10:18:27.724 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph-radosgw 2021-11-18T10:18:27.725 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph-radosgw 2021-11-18T10:18:28.548 INFO:teuthology.orchestra.run.gibba019.stdout:ceph packages for x86_64 127 kB/s | 75 kB 00:00 2021-11-18T10:18:28.566 INFO:teuthology.orchestra.run.gibba005.stdout:ceph packages for x86_64 124 kB/s | 75 kB 00:00 2021-11-18T10:18:28.905 INFO:teuthology.orchestra.run.gibba019.stdout:ceph noarch packages 28 kB/s | 9.1 kB 00:00 2021-11-18T10:18:28.925 INFO:teuthology.orchestra.run.gibba005.stdout:ceph noarch packages 27 kB/s | 9.1 kB 00:00 2021-11-18T10:18:29.237 INFO:teuthology.orchestra.run.gibba019.stdout:ceph source packages 4.6 kB/s | 1.4 kB 00:00 2021-11-18T10:18:29.259 INFO:teuthology.orchestra.run.gibba005.stdout:ceph source packages 4.5 kB/s | 1.4 kB 00:00 2021-11-18T10:18:29.674 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS-8 - AppStream 19 MB/s | 8.1 MB 00:00 2021-11-18T10:18:29.722 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS-8 - AppStream 18 MB/s | 8.1 MB 00:00 2021-11-18T10:18:30.703 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS-8 - Base 37 MB/s | 3.5 MB 00:00 2021-11-18T10:18:30.752 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS-8 - Base 35 MB/s | 3.5 MB 00:00 2021-11-18T10:18:31.148 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS-8 - Extras 163 kB/s | 10 kB 00:00 2021-11-18T10:18:31.186 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS-8 - Extras 175 kB/s | 10 kB 00:00 2021-11-18T10:18:32.135 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS Linux 8 - AppStream 8.6 MB/s | 8.1 MB 00:00 2021-11-18T10:18:32.217 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS Linux 8 - AppStream 8.2 MB/s | 8.1 MB 00:00 2021-11-18T10:18:33.755 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS Linux 8 - BaseOS 5.1 MB/s | 3.5 MB 00:00 2021-11-18T10:18:34.006 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS Linux 8 - BaseOS 4.1 MB/s | 3.5 MB 00:00 2021-11-18T10:18:34.347 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS Linux 8 - Extras 49 kB/s | 10 kB 00:00 2021-11-18T10:18:34.496 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS-8 - PowerTools 22 MB/s | 2.3 MB 00:00 2021-11-18T10:18:34.600 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS Linux 8 - Extras 48 kB/s | 10 kB 00:00 2021-11-18T10:18:34.727 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS-8 - PowerTools 28 MB/s | 2.3 MB 00:00 2021-11-18T10:18:34.864 INFO:teuthology.orchestra.run.gibba019.stdout:Copr repo for python3-asyncssh owned by ceph 50 kB/s | 3.5 kB 00:00 2021-11-18T10:18:35.092 INFO:teuthology.orchestra.run.gibba005.stdout:Copr repo for python3-asyncssh owned by ceph 50 kB/s | 3.5 kB 00:00 2021-11-18T10:18:36.415 INFO:teuthology.orchestra.run.gibba019.stdout:Apache Arrow 122 kB/s | 184 kB 00:01 2021-11-18T10:18:36.627 INFO:teuthology.orchestra.run.gibba005.stdout:Apache Arrow 124 kB/s | 184 kB 00:01 2021-11-18T10:18:38.543 INFO:teuthology.orchestra.run.gibba019.stdout:Extra Packages for Enterprise Linux 5.3 MB/s | 11 MB 00:02 2021-11-18T10:18:38.924 INFO:teuthology.orchestra.run.gibba005.stdout:Extra Packages for Enterprise Linux 4.9 MB/s | 11 MB 00:02 2021-11-18T10:18:40.222 INFO:teuthology.orchestra.run.gibba019.stdout:lab-extras 3.9 MB/s | 24 kB 00:00 2021-11-18T10:18:40.614 INFO:teuthology.orchestra.run.gibba005.stdout:lab-extras 4.4 MB/s | 24 kB 00:00 2021-11-18T10:18:41.887 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:18:41.889 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:18:41.889 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repository Size 2021-11-18T10:18:41.890 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:18:41.890 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:18:41.890 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-radosgw x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 9.0 M 2021-11-18T10:18:41.891 INFO:teuthology.orchestra.run.gibba019.stdout:Upgrading: 2021-11-18T10:18:41.891 INFO:teuthology.orchestra.run.gibba019.stdout: librados2 x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 3.4 M 2021-11-18T10:18:41.891 INFO:teuthology.orchestra.run.gibba019.stdout: librbd1 x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 3.9 M 2021-11-18T10:18:41.891 INFO:teuthology.orchestra.run.gibba019.stdout:Installing dependencies: 2021-11-18T10:18:41.891 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-base x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 5.2 M 2021-11-18T10:18:41.892 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-common x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 20 M 2021-11-18T10:18:41.892 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-selinux x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 24 k 2021-11-18T10:18:41.892 INFO:teuthology.orchestra.run.gibba019.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-11-18T10:18:41.892 INFO:teuthology.orchestra.run.gibba019.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-11-18T10:18:41.893 INFO:teuthology.orchestra.run.gibba019.stdout: libcephfs2 x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 786 k 2021-11-18T10:18:41.893 INFO:teuthology.orchestra.run.gibba019.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-11-18T10:18:41.893 INFO:teuthology.orchestra.run.gibba019.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2021-11-18T10:18:41.893 INFO:teuthology.orchestra.run.gibba019.stdout: libradosstriper1 x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 483 k 2021-11-18T10:18:41.894 INFO:teuthology.orchestra.run.gibba019.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-11-18T10:18:41.894 INFO:teuthology.orchestra.run.gibba019.stdout: librgw2 x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 3.8 M 2021-11-18T10:18:41.894 INFO:teuthology.orchestra.run.gibba019.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-11-18T10:18:41.895 INFO:teuthology.orchestra.run.gibba019.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-11-18T10:18:41.895 INFO:teuthology.orchestra.run.gibba019.stdout: python3-ceph-argparse 2021-11-18T10:18:41.895 INFO:teuthology.orchestra.run.gibba019.stdout: x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 45 k 2021-11-18T10:18:41.896 INFO:teuthology.orchestra.run.gibba019.stdout: python3-ceph-common x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 79 k 2021-11-18T10:18:41.896 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cephfs x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 178 k 2021-11-18T10:18:41.896 INFO:teuthology.orchestra.run.gibba019.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-11-18T10:18:41.897 INFO:teuthology.orchestra.run.gibba019.stdout: python3-rados x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 367 k 2021-11-18T10:18:41.897 INFO:teuthology.orchestra.run.gibba019.stdout: python3-rbd x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 346 k 2021-11-18T10:18:41.898 INFO:teuthology.orchestra.run.gibba019.stdout: python3-rgw x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 110 k 2021-11-18T10:18:41.898 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:18:41.898 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:18:41.899 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:18:41.899 INFO:teuthology.orchestra.run.gibba019.stdout:Install 21 Packages 2021-11-18T10:18:41.900 INFO:teuthology.orchestra.run.gibba019.stdout:Upgrade 2 Packages 2021-11-18T10:18:41.900 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:18:41.901 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 49 M 2021-11-18T10:18:41.902 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:18:42.268 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:18:42.274 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:18:42.274 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repository Size 2021-11-18T10:18:42.275 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:18:42.275 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:18:42.275 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-radosgw x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 9.0 M 2021-11-18T10:18:42.276 INFO:teuthology.orchestra.run.gibba005.stdout:Upgrading: 2021-11-18T10:18:42.276 INFO:teuthology.orchestra.run.gibba005.stdout: librados2 x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 3.4 M 2021-11-18T10:18:42.277 INFO:teuthology.orchestra.run.gibba005.stdout: librbd1 x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 3.9 M 2021-11-18T10:18:42.277 INFO:teuthology.orchestra.run.gibba005.stdout:Installing dependencies: 2021-11-18T10:18:42.277 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-base x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 5.2 M 2021-11-18T10:18:42.278 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-common x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 20 M 2021-11-18T10:18:42.278 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-selinux x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 24 k 2021-11-18T10:18:42.278 INFO:teuthology.orchestra.run.gibba005.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2021-11-18T10:18:42.279 INFO:teuthology.orchestra.run.gibba005.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2021-11-18T10:18:42.279 INFO:teuthology.orchestra.run.gibba005.stdout: libcephfs2 x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 786 k 2021-11-18T10:18:42.280 INFO:teuthology.orchestra.run.gibba005.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2021-11-18T10:18:42.281 INFO:teuthology.orchestra.run.gibba005.stdout: librabbitmq x86_64 0.9.0-3.el8 CentOS-Base 47 k 2021-11-18T10:18:42.281 INFO:teuthology.orchestra.run.gibba005.stdout: libradosstriper1 x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 483 k 2021-11-18T10:18:42.281 INFO:teuthology.orchestra.run.gibba005.stdout: librdkafka x86_64 0.11.4-1.el8 CentOS-AppStream 353 k 2021-11-18T10:18:42.282 INFO:teuthology.orchestra.run.gibba005.stdout: librgw2 x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 3.8 M 2021-11-18T10:18:42.282 INFO:teuthology.orchestra.run.gibba005.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2021-11-18T10:18:42.283 INFO:teuthology.orchestra.run.gibba005.stdout: lttng-ust x86_64 2.8.1-11.el8 CentOS-AppStream 259 k 2021-11-18T10:18:42.283 INFO:teuthology.orchestra.run.gibba005.stdout: python3-ceph-argparse 2021-11-18T10:18:42.283 INFO:teuthology.orchestra.run.gibba005.stdout: x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 45 k 2021-11-18T10:18:42.284 INFO:teuthology.orchestra.run.gibba005.stdout: python3-ceph-common x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 79 k 2021-11-18T10:18:42.284 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cephfs x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 178 k 2021-11-18T10:18:42.284 INFO:teuthology.orchestra.run.gibba005.stdout: python3-prettytable noarch 0.7.2-14.el8 CentOS-AppStream 44 k 2021-11-18T10:18:42.285 INFO:teuthology.orchestra.run.gibba005.stdout: python3-rados x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 367 k 2021-11-18T10:18:42.285 INFO:teuthology.orchestra.run.gibba005.stdout: python3-rbd x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 346 k 2021-11-18T10:18:42.286 INFO:teuthology.orchestra.run.gibba005.stdout: python3-rgw x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 110 k 2021-11-18T10:18:42.286 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:18:42.286 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:18:42.287 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:18:42.287 INFO:teuthology.orchestra.run.gibba005.stdout:Install 21 Packages 2021-11-18T10:18:42.287 INFO:teuthology.orchestra.run.gibba005.stdout:Upgrade 2 Packages 2021-11-18T10:18:42.288 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:18:42.288 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 49 M 2021-11-18T10:18:42.289 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:18:42.667 INFO:teuthology.orchestra.run.gibba019.stdout:(1/23): ceph-base-17.0.0-9003.g44cd7c76.el8.x86 6.7 MB/s | 5.2 MB 00:00 2021-11-18T10:18:42.702 INFO:teuthology.orchestra.run.gibba019.stdout:(2/23): ceph-selinux-17.0.0-9003.g44cd7c76.el8. 664 kB/s | 24 kB 00:00 2021-11-18T10:18:42.806 INFO:teuthology.orchestra.run.gibba019.stdout:(3/23): libcephfs2-17.0.0-9003.g44cd7c76.el8.x8 7.4 MB/s | 786 kB 00:00 2021-11-18T10:18:42.866 INFO:teuthology.orchestra.run.gibba019.stdout:(4/23): libradosstriper1-17.0.0-9003.g44cd7c76. 8.0 MB/s | 483 kB 00:00 2021-11-18T10:18:43.297 INFO:teuthology.orchestra.run.gibba019.stdout:(5/23): librgw2-17.0.0-9003.g44cd7c76.el8.x86_6 8.9 MB/s | 3.8 MB 00:00 2021-11-18T10:18:43.371 INFO:teuthology.orchestra.run.gibba019.stdout:(6/23): ceph-radosgw-17.0.0-9003.g44cd7c76.el8. 6.1 MB/s | 9.0 MB 00:01 2021-11-18T10:18:43.372 INFO:teuthology.orchestra.run.gibba019.stdout:(7/23): python3-ceph-argparse-17.0.0-9003.g44cd 598 kB/s | 45 kB 00:00 2021-11-18T10:18:43.415 INFO:teuthology.orchestra.run.gibba019.stdout:(8/23): python3-ceph-common-17.0.0-9003.g44cd7c 1.8 MB/s | 79 kB 00:00 2021-11-18T10:18:43.421 INFO:teuthology.orchestra.run.gibba019.stdout:(9/23): python3-cephfs-17.0.0-9003.g44cd7c76.el 3.5 MB/s | 178 kB 00:00 2021-11-18T10:18:43.475 INFO:teuthology.orchestra.run.gibba019.stdout:(10/23): python3-rados-17.0.0-9003.g44cd7c76.el 5.9 MB/s | 367 kB 00:00 2021-11-18T10:18:43.488 INFO:teuthology.orchestra.run.gibba019.stdout:(11/23): python3-rbd-17.0.0-9003.g44cd7c76.el8. 5.1 MB/s | 346 kB 00:00 2021-11-18T10:18:43.520 INFO:teuthology.orchestra.run.gibba019.stdout:(12/23): librdkafka-0.11.4-1.el8.x86_64.rpm 11 MB/s | 353 kB 00:00 2021-11-18T10:18:43.524 INFO:teuthology.orchestra.run.gibba019.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 71 MB/s | 259 kB 00:00 2021-11-18T10:18:43.525 INFO:teuthology.orchestra.run.gibba019.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 35 MB/s | 44 kB 00:00 2021-11-18T10:18:43.527 INFO:teuthology.orchestra.run.gibba019.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 36 MB/s | 47 kB 00:00 2021-11-18T10:18:43.534 INFO:teuthology.orchestra.run.gibba019.stdout:(16/23): python3-rgw-17.0.0-9003.g44cd7c76.el8. 1.8 MB/s | 110 kB 00:00 2021-11-18T10:18:43.752 INFO:teuthology.orchestra.run.gibba019.stdout:(17/23): leveldb-1.22-1.el8.x86_64.rpm 831 kB/s | 181 kB 00:00 2021-11-18T10:18:43.781 INFO:teuthology.orchestra.run.gibba019.stdout:(18/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2021-11-18T10:18:43.796 INFO:teuthology.orchestra.run.gibba019.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 1.3 MB/s | 59 kB 00:00 2021-11-18T10:18:43.826 INFO:teuthology.orchestra.run.gibba019.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.7 MB/s | 75 kB 00:00 2021-11-18T10:18:44.171 INFO:teuthology.orchestra.run.gibba005.stdout:(1/23): ceph-base-17.0.0-9003.g44cd7c76.el8.x86 2.7 MB/s | 5.2 MB 00:01 2021-11-18T10:18:44.238 INFO:teuthology.orchestra.run.gibba005.stdout:(2/23): ceph-selinux-17.0.0-9003.g44cd7c76.el8. 358 kB/s | 24 kB 00:00 2021-11-18T10:18:44.391 INFO:teuthology.orchestra.run.gibba019.stdout:(21/23): librados2-17.0.0-9003.g44cd7c76.el8.x8 5.8 MB/s | 3.4 MB 00:00 2021-11-18T10:18:44.485 INFO:teuthology.orchestra.run.gibba005.stdout:(3/23): libcephfs2-17.0.0-9003.g44cd7c76.el8.x8 3.1 MB/s | 786 kB 00:00 2021-11-18T10:18:44.536 INFO:teuthology.orchestra.run.gibba019.stdout:(22/23): ceph-common-17.0.0-9003.g44cd7c76.el8. 7.6 MB/s | 20 MB 00:02 2021-11-18T10:18:44.576 INFO:teuthology.orchestra.run.gibba005.stdout:(4/23): libradosstriper1-17.0.0-9003.g44cd7c76. 5.2 MB/s | 483 kB 00:00 2021-11-18T10:18:44.674 INFO:teuthology.orchestra.run.gibba005.stdout:(5/23): ceph-radosgw-17.0.0-9003.g44cd7c76.el8. 3.7 MB/s | 9.0 MB 00:02 2021-11-18T10:18:44.686 INFO:teuthology.orchestra.run.gibba019.stdout:(23/23): librbd1-17.0.0-9003.g44cd7c76.el8.x86_ 4.5 MB/s | 3.9 MB 00:00 2021-11-18T10:18:44.688 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:18:44.688 INFO:teuthology.orchestra.run.gibba019.stdout:Total 17 MB/s | 49 MB 00:02 2021-11-18T10:18:44.693 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:18:44.722 INFO:teuthology.orchestra.run.gibba005.stdout:(6/23): python3-ceph-argparse-17.0.0-9003.g44cd 947 kB/s | 45 kB 00:00 2021-11-18T10:18:44.725 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:18:44.725 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:18:44.764 INFO:teuthology.orchestra.run.gibba005.stdout:(7/23): python3-ceph-common-17.0.0-9003.g44cd7c 1.9 MB/s | 79 kB 00:00 2021-11-18T10:18:44.807 INFO:teuthology.orchestra.run.gibba005.stdout:(8/23): python3-cephfs-17.0.0-9003.g44cd7c76.el 4.1 MB/s | 178 kB 00:00 2021-11-18T10:18:44.857 INFO:teuthology.orchestra.run.gibba005.stdout:(9/23): python3-rados-17.0.0-9003.g44cd7c76.el8 7.0 MB/s | 367 kB 00:00 2021-11-18T10:18:44.909 INFO:teuthology.orchestra.run.gibba005.stdout:(10/23): python3-rbd-17.0.0-9003.g44cd7c76.el8. 6.5 MB/s | 346 kB 00:00 2021-11-18T10:18:44.955 INFO:teuthology.orchestra.run.gibba005.stdout:(11/23): python3-rgw-17.0.0-9003.g44cd7c76.el8. 2.4 MB/s | 110 kB 00:00 2021-11-18T10:18:44.992 INFO:teuthology.orchestra.run.gibba005.stdout:(12/23): librdkafka-0.11.4-1.el8.x86_64.rpm 9.3 MB/s | 353 kB 00:00 2021-11-18T10:18:44.996 INFO:teuthology.orchestra.run.gibba005.stdout:(13/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 56 MB/s | 259 kB 00:00 2021-11-18T10:18:44.998 INFO:teuthology.orchestra.run.gibba005.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 31 MB/s | 44 kB 00:00 2021-11-18T10:18:45.000 INFO:teuthology.orchestra.run.gibba005.stdout:(15/23): librabbitmq-0.9.0-3.el8.x86_64.rpm 26 MB/s | 47 kB 00:00 2021-11-18T10:18:45.027 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:18:45.029 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:18:45.373 INFO:teuthology.orchestra.run.gibba005.stdout:(16/23): librgw2-17.0.0-9003.g44cd7c76.el8.x86_ 4.8 MB/s | 3.8 MB 00:00 2021-11-18T10:18:45.411 INFO:teuthology.orchestra.run.gibba005.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 746 kB/s | 306 kB 00:00 2021-11-18T10:18:45.471 INFO:teuthology.orchestra.run.gibba005.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 984 kB/s | 59 kB 00:00 2021-11-18T10:18:45.530 INFO:teuthology.orchestra.run.gibba005.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2021-11-18T10:18:45.676 INFO:teuthology.orchestra.run.gibba005.stdout:(20/23): leveldb-1.22-1.el8.x86_64.rpm 597 kB/s | 181 kB 00:00 2021-11-18T10:18:45.997 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:18:46.239 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2021-11-18T10:18:46.441 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-11-18T10:18:46.629 INFO:teuthology.orchestra.run.gibba005.stdout:(21/23): librbd1-17.0.0-9003.g44cd7c76.el8.x86_ 4.1 MB/s | 3.9 MB 00:00 2021-11-18T10:18:46.761 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-11-18T10:18:46.916 INFO:teuthology.orchestra.run.gibba005.stdout:(22/23): librados2-17.0.0-9003.g44cd7c76.el8.x8 2.5 MB/s | 3.4 MB 00:01 2021-11-18T10:18:46.982 INFO:teuthology.orchestra.run.gibba019.stdout: Upgrading : librados2-2:17.0.0-9003.g44cd7c76.el8.x86_64 3/25 2021-11-18T10:18:47.066 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: librados2-2:17.0.0-9003.g44cd7c76.el8.x86_64 3/25 2021-11-18T10:18:47.317 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-rados-2:17.0.0-9003.g44cd7c76.el8.x86_64 4/25 2021-11-18T10:18:47.499 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : libcephfs2-2:17.0.0-9003.g44cd7c76.el8.x86_64 5/25 2021-11-18T10:18:47.838 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: libcephfs2-2:17.0.0-9003.g44cd7c76.el8.x86_64 5/25 2021-11-18T10:18:48.050 INFO:teuthology.orchestra.run.gibba019.stdout: Upgrading : librbd1-2:17.0.0-9003.g44cd7c76.el8.x86_64 6/25 2021-11-18T10:18:48.100 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: librbd1-2:17.0.0-9003.g44cd7c76.el8.x86_64 6/25 2021-11-18T10:18:48.293 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2021-11-18T10:18:48.466 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2021-11-18T10:18:48.804 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2021-11-18T10:18:48.966 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : librgw2-2:17.0.0-9003.g44cd7c76.el8.x86_64 9/25 2021-11-18T10:18:49.070 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: librgw2-2:17.0.0-9003.g44cd7c76.el8.x86_64 9/25 2021-11-18T10:18:49.221 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2021-11-18T10:18:49.405 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-ceph-argparse-2:17.0.0-9003.g44cd7c76.el8. 11/25 2021-11-18T10:18:49.526 INFO:teuthology.orchestra.run.gibba005.stdout:(23/23): ceph-common-17.0.0-9003.g44cd7c76.el8. 2.8 MB/s | 20 MB 00:07 2021-11-18T10:18:49.528 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:18:49.528 INFO:teuthology.orchestra.run.gibba005.stdout:Total 6.7 MB/s | 49 MB 00:07 2021-11-18T10:18:49.533 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:18:49.566 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:18:49.566 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:18:49.753 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-cephfs-2:17.0.0-9003.g44cd7c76.el8.x86_64 12/25 2021-11-18T10:18:49.875 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:18:49.878 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:18:50.201 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-rgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 13/25 2021-11-18T10:18:50.400 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-rbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 14/25 2021-11-18T10:18:50.591 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : libradosstriper1-2:17.0.0-9003.g44cd7c76.el8.x86_6 15/25 2021-11-18T10:18:50.654 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: libradosstriper1-2:17.0.0-9003.g44cd7c76.el8.x86_6 15/25 2021-11-18T10:18:50.809 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:18:50.849 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2021-11-18T10:18:51.035 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2021-11-18T10:18:51.047 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2021-11-18T10:18:51.193 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-11-18T10:18:51.199 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2021-11-18T10:18:51.366 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-ceph-common-2:17.0.0-9003.g44cd7c76.el8.x8 19/25 2021-11-18T10:18:51.510 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2021-11-18T10:18:51.718 INFO:teuthology.orchestra.run.gibba005.stdout: Upgrading : librados2-2:17.0.0-9003.g44cd7c76.el8.x86_64 3/25 2021-11-18T10:18:51.800 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: librados2-2:17.0.0-9003.g44cd7c76.el8.x86_64 3/25 2021-11-18T10:18:51.995 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-rados-2:17.0.0-9003.g44cd7c76.el8.x86_64 4/25 2021-11-18T10:18:52.168 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : libcephfs2-2:17.0.0-9003.g44cd7c76.el8.x86_64 5/25 2021-11-18T10:18:52.493 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: libcephfs2-2:17.0.0-9003.g44cd7c76.el8.x86_64 5/25 2021-11-18T10:18:52.651 INFO:teuthology.orchestra.run.gibba005.stdout: Upgrading : librbd1-2:17.0.0-9003.g44cd7c76.el8.x86_64 6/25 2021-11-18T10:18:52.696 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: librbd1-2:17.0.0-9003.g44cd7c76.el8.x86_64 6/25 2021-11-18T10:18:52.895 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 7/25 2021-11-18T10:18:53.076 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/25 2021-11-18T10:18:53.390 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/25 2021-11-18T10:18:53.601 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : librgw2-2:17.0.0-9003.g44cd7c76.el8.x86_64 9/25 2021-11-18T10:18:53.658 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: librgw2-2:17.0.0-9003.g44cd7c76.el8.x86_64 9/25 2021-11-18T10:18:53.815 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2021-11-18T10:18:53.999 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-ceph-argparse-2:17.0.0-9003.g44cd7c76.el8. 11/25 2021-11-18T10:18:54.211 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-cephfs-2:17.0.0-9003.g44cd7c76.el8.x86_64 12/25 2021-11-18T10:18:54.436 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-rgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 13/25 2021-11-18T10:18:54.619 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-rbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 14/25 2021-11-18T10:18:54.665 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 20/25 2021-11-18T10:18:54.818 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : libradosstriper1-2:17.0.0-9003.g44cd7c76.el8.x86_6 15/25 2021-11-18T10:18:54.875 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 20/25 2021-11-18T10:18:54.884 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: libradosstriper1-2:17.0.0-9003.g44cd7c76.el8.x86_6 15/25 2021-11-18T10:18:55.069 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2021-11-18T10:18:55.274 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2021-11-18T10:18:55.342 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 20/25 2021-11-18T10:18:55.418 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2021-11-18T10:18:55.580 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-base-2:17.0.0-9003.g44cd7c76.el8.x86_64 21/25 2021-11-18T10:18:55.601 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-ceph-common-2:17.0.0-9003.g44cd7c76.el8.x8 19/25 2021-11-18T10:18:55.689 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-base-2:17.0.0-9003.g44cd7c76.el8.x86_64 21/25 2021-11-18T10:18:55.799 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-selinux-2:17.0.0-9003.g44cd7c76.el8.x86_64 22/25 2021-11-18T10:18:58.862 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 20/25 2021-11-18T10:18:59.077 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 20/25 2021-11-18T10:18:59.565 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 20/25 2021-11-18T10:18:59.811 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-base-2:17.0.0-9003.g44cd7c76.el8.x86_64 21/25 2021-11-18T10:18:59.884 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-base-2:17.0.0-9003.g44cd7c76.el8.x86_64 21/25 2021-11-18T10:19:00.009 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-selinux-2:17.0.0-9003.g44cd7c76.el8.x86_64 22/25 2021-11-18T10:19:05.700 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-selinux-2:17.0.0-9003.g44cd7c76.el8.x86_64 22/25 2021-11-18T10:19:05.700 INFO:teuthology.orchestra.run.gibba019.stdout:skipping the directory /sys 2021-11-18T10:19:05.700 INFO:teuthology.orchestra.run.gibba019.stdout:skipping the directory /proc 2021-11-18T10:19:05.700 INFO:teuthology.orchestra.run.gibba019.stdout:skipping the directory /dev 2021-11-18T10:19:05.701 INFO:teuthology.orchestra.run.gibba019.stdout:skipping the directory /run 2021-11-18T10:19:05.701 INFO:teuthology.orchestra.run.gibba019.stdout:skipping the directory /mnt 2021-11-18T10:19:05.701 INFO:teuthology.orchestra.run.gibba019.stdout:skipping the directory /var/tmp 2021-11-18T10:19:05.701 INFO:teuthology.orchestra.run.gibba019.stdout:skipping the directory /home 2021-11-18T10:19:05.702 INFO:teuthology.orchestra.run.gibba019.stdout:skipping the directory /tmp 2021-11-18T10:19:05.702 INFO:teuthology.orchestra.run.gibba019.stdout:skipping the directory /dev 2021-11-18T10:19:05.702 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:06.647 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-radosgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 23/25 2021-11-18T10:19:06.716 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 23/25 2021-11-18T10:19:06.717 INFO:teuthology.orchestra.run.gibba019.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-11-18T10:19:06.934 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-11-18T10:19:06.935 INFO:teuthology.orchestra.run.gibba019.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2021-11-18T10:19:07.593 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2021-11-18T10:19:07.594 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-base-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/25 2021-11-18T10:19:07.594 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 2/25 2021-11-18T10:19:07.594 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-radosgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 3/25 2021-11-18T10:19:07.595 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-selinux-2:17.0.0-9003.g44cd7c76.el8.x86_64 4/25 2021-11-18T10:19:07.595 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : libcephfs2-2:17.0.0-9003.g44cd7c76.el8.x86_64 5/25 2021-11-18T10:19:07.595 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : libradosstriper1-2:17.0.0-9003.g44cd7c76.el8.x86_6 6/25 2021-11-18T10:19:07.595 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : librgw2-2:17.0.0-9003.g44cd7c76.el8.x86_64 7/25 2021-11-18T10:19:07.596 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-ceph-argparse-2:17.0.0-9003.g44cd7c76.el8. 8/25 2021-11-18T10:19:07.596 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-ceph-common-2:17.0.0-9003.g44cd7c76.el8.x8 9/25 2021-11-18T10:19:07.596 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-cephfs-2:17.0.0-9003.g44cd7c76.el8.x86_64 10/25 2021-11-18T10:19:07.596 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-rados-2:17.0.0-9003.g44cd7c76.el8.x86_64 11/25 2021-11-18T10:19:07.597 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-rbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 12/25 2021-11-18T10:19:07.597 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-rgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 13/25 2021-11-18T10:19:07.597 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2021-11-18T10:19:07.597 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2021-11-18T10:19:07.598 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2021-11-18T10:19:07.598 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2021-11-18T10:19:07.598 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2021-11-18T10:19:07.598 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2021-11-18T10:19:07.598 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2021-11-18T10:19:07.599 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2021-11-18T10:19:07.599 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : librados2-2:17.0.0-9003.g44cd7c76.el8.x86_64 22/25 2021-11-18T10:19:07.599 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2021-11-18T10:19:07.599 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : librbd1-2:17.0.0-9003.g44cd7c76.el8.x86_64 24/25 2021-11-18T10:19:08.290 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2021-11-18T10:19:08.290 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:08.291 INFO:teuthology.orchestra.run.gibba019.stdout:Upgraded: 2021-11-18T10:19:08.291 INFO:teuthology.orchestra.run.gibba019.stdout: librados2-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.291 INFO:teuthology.orchestra.run.gibba019.stdout: librbd1-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.291 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:08.291 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:19:08.292 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-base-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.292 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.292 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-radosgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.292 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-selinux-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.293 INFO:teuthology.orchestra.run.gibba019.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-11-18T10:19:08.293 INFO:teuthology.orchestra.run.gibba019.stdout: leveldb-1.22-1.el8.x86_64 2021-11-18T10:19:08.293 INFO:teuthology.orchestra.run.gibba019.stdout: libcephfs2-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.293 INFO:teuthology.orchestra.run.gibba019.stdout: liboath-2.6.2-3.el8.x86_64 2021-11-18T10:19:08.294 INFO:teuthology.orchestra.run.gibba019.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-11-18T10:19:08.294 INFO:teuthology.orchestra.run.gibba019.stdout: libradosstriper1-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.294 INFO:teuthology.orchestra.run.gibba019.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-11-18T10:19:08.294 INFO:teuthology.orchestra.run.gibba019.stdout: librgw2-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.294 INFO:teuthology.orchestra.run.gibba019.stdout: libunwind-1.3.1-3.el8.x86_64 2021-11-18T10:19:08.295 INFO:teuthology.orchestra.run.gibba019.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-11-18T10:19:08.295 INFO:teuthology.orchestra.run.gibba019.stdout: python3-ceph-argparse-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.295 INFO:teuthology.orchestra.run.gibba019.stdout: python3-ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.295 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cephfs-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.296 INFO:teuthology.orchestra.run.gibba019.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-11-18T10:19:08.296 INFO:teuthology.orchestra.run.gibba019.stdout: python3-rados-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.296 INFO:teuthology.orchestra.run.gibba019.stdout: python3-rbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.296 INFO:teuthology.orchestra.run.gibba019.stdout: python3-rgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:08.297 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:08.297 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:19:08.512 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph-test 2021-11-18T10:19:08.858 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:00:28 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:09.503 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:19:09.504 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:09.504 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repository Size 2021-11-18T10:19:09.504 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:09.504 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:19:09.505 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-test x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 45 M 2021-11-18T10:19:09.505 INFO:teuthology.orchestra.run.gibba019.stdout:Installing dependencies: 2021-11-18T10:19:09.505 INFO:teuthology.orchestra.run.gibba019.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-11-18T10:19:09.505 INFO:teuthology.orchestra.run.gibba019.stdout: libcephsqlite x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 170 k 2021-11-18T10:19:09.505 INFO:teuthology.orchestra.run.gibba019.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2021-11-18T10:19:09.506 INFO:teuthology.orchestra.run.gibba019.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-11-18T10:19:09.506 INFO:teuthology.orchestra.run.gibba019.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2021-11-18T10:19:09.506 INFO:teuthology.orchestra.run.gibba019.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-11-18T10:19:09.506 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:09.507 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:19:09.507 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:09.507 INFO:teuthology.orchestra.run.gibba019.stdout:Install 7 Packages 2021-11-18T10:19:09.507 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:09.508 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 46 M 2021-11-18T10:19:09.508 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 211 M 2021-11-18T10:19:09.509 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:19:09.536 INFO:teuthology.orchestra.run.gibba019.stdout:(1/7): jq-1.5-12.el8.x86_64.rpm 5.1 MB/s | 161 kB 00:00 2021-11-18T10:19:09.539 INFO:teuthology.orchestra.run.gibba019.stdout:(2/7): oniguruma-6.8.2-2.el8.x86_64.rpm 69 MB/s | 187 kB 00:00 2021-11-18T10:19:09.549 INFO:teuthology.orchestra.run.gibba019.stdout:(3/7): socat-1.7.4.1-1.el8.x86_64.rpm 32 MB/s | 323 kB 00:00 2021-11-18T10:19:09.553 INFO:teuthology.orchestra.run.gibba019.stdout:(4/7): libxslt-1.1.32-6.el8.x86_64.rpm 74 MB/s | 250 kB 00:00 2021-11-18T10:19:09.668 INFO:teuthology.orchestra.run.gibba019.stdout:(5/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 597 kB/s | 69 kB 00:00 2021-11-18T10:19:09.748 INFO:teuthology.orchestra.run.gibba019.stdout:(6/7): libcephsqlite-17.0.0-9003.g44cd7c76.el8. 701 kB/s | 170 kB 00:00 2021-11-18T10:19:09.862 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-selinux-2:17.0.0-9003.g44cd7c76.el8.x86_64 22/25 2021-11-18T10:19:09.863 INFO:teuthology.orchestra.run.gibba005.stdout:skipping the directory /sys 2021-11-18T10:19:09.863 INFO:teuthology.orchestra.run.gibba005.stdout:skipping the directory /proc 2021-11-18T10:19:09.863 INFO:teuthology.orchestra.run.gibba005.stdout:skipping the directory /dev 2021-11-18T10:19:09.863 INFO:teuthology.orchestra.run.gibba005.stdout:skipping the directory /run 2021-11-18T10:19:09.864 INFO:teuthology.orchestra.run.gibba005.stdout:skipping the directory /mnt 2021-11-18T10:19:09.864 INFO:teuthology.orchestra.run.gibba005.stdout:skipping the directory /var/tmp 2021-11-18T10:19:09.864 INFO:teuthology.orchestra.run.gibba005.stdout:skipping the directory /home 2021-11-18T10:19:09.864 INFO:teuthology.orchestra.run.gibba005.stdout:skipping the directory /tmp 2021-11-18T10:19:09.864 INFO:teuthology.orchestra.run.gibba005.stdout:skipping the directory /dev 2021-11-18T10:19:09.865 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:10.786 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-radosgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 23/25 2021-11-18T10:19:10.845 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-radosgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 23/25 2021-11-18T10:19:10.845 INFO:teuthology.orchestra.run.gibba005.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-11-18T10:19:11.053 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2021-11-18T10:19:11.053 INFO:teuthology.orchestra.run.gibba005.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2021-11-18T10:19:11.715 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2021-11-18T10:19:11.716 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-base-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/25 2021-11-18T10:19:11.716 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 2/25 2021-11-18T10:19:11.716 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-radosgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 3/25 2021-11-18T10:19:11.716 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-selinux-2:17.0.0-9003.g44cd7c76.el8.x86_64 4/25 2021-11-18T10:19:11.717 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : libcephfs2-2:17.0.0-9003.g44cd7c76.el8.x86_64 5/25 2021-11-18T10:19:11.717 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : libradosstriper1-2:17.0.0-9003.g44cd7c76.el8.x86_6 6/25 2021-11-18T10:19:11.717 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : librgw2-2:17.0.0-9003.g44cd7c76.el8.x86_64 7/25 2021-11-18T10:19:11.717 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-ceph-argparse-2:17.0.0-9003.g44cd7c76.el8. 8/25 2021-11-18T10:19:11.718 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-ceph-common-2:17.0.0-9003.g44cd7c76.el8.x8 9/25 2021-11-18T10:19:11.718 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-cephfs-2:17.0.0-9003.g44cd7c76.el8.x86_64 10/25 2021-11-18T10:19:11.718 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-rados-2:17.0.0-9003.g44cd7c76.el8.x86_64 11/25 2021-11-18T10:19:11.718 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-rbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 12/25 2021-11-18T10:19:11.718 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-rgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 13/25 2021-11-18T10:19:11.719 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 14/25 2021-11-18T10:19:11.719 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2021-11-18T10:19:11.719 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2021-11-18T10:19:11.719 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 17/25 2021-11-18T10:19:11.720 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2021-11-18T10:19:11.720 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2021-11-18T10:19:11.720 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2021-11-18T10:19:11.720 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2021-11-18T10:19:11.721 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : librados2-2:17.0.0-9003.g44cd7c76.el8.x86_64 22/25 2021-11-18T10:19:11.721 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2021-11-18T10:19:11.721 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : librbd1-2:17.0.0-9003.g44cd7c76.el8.x86_64 24/25 2021-11-18T10:19:12.091 INFO:teuthology.orchestra.run.gibba019.stdout:(7/7): ceph-test-17.0.0-9003.g44cd7c76.el8.x86_ 17 MB/s | 45 MB 00:02 2021-11-18T10:19:12.093 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:12.093 INFO:teuthology.orchestra.run.gibba019.stdout:Total 18 MB/s | 46 MB 00:02 2021-11-18T10:19:12.098 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:19:12.114 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:19:12.114 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:19:12.299 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:19:12.301 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:19:12.407 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2021-11-18T10:19:12.407 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:12.407 INFO:teuthology.orchestra.run.gibba005.stdout:Upgraded: 2021-11-18T10:19:12.408 INFO:teuthology.orchestra.run.gibba005.stdout: librados2-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.408 INFO:teuthology.orchestra.run.gibba005.stdout: librbd1-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.408 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:12.408 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:19:12.409 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-base-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.409 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.409 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-radosgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.409 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-selinux-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.410 INFO:teuthology.orchestra.run.gibba005.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2021-11-18T10:19:12.410 INFO:teuthology.orchestra.run.gibba005.stdout: leveldb-1.22-1.el8.x86_64 2021-11-18T10:19:12.410 INFO:teuthology.orchestra.run.gibba005.stdout: libcephfs2-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.410 INFO:teuthology.orchestra.run.gibba005.stdout: liboath-2.6.2-3.el8.x86_64 2021-11-18T10:19:12.411 INFO:teuthology.orchestra.run.gibba005.stdout: librabbitmq-0.9.0-3.el8.x86_64 2021-11-18T10:19:12.411 INFO:teuthology.orchestra.run.gibba005.stdout: libradosstriper1-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.411 INFO:teuthology.orchestra.run.gibba005.stdout: librdkafka-0.11.4-1.el8.x86_64 2021-11-18T10:19:12.411 INFO:teuthology.orchestra.run.gibba005.stdout: librgw2-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.412 INFO:teuthology.orchestra.run.gibba005.stdout: libunwind-1.3.1-3.el8.x86_64 2021-11-18T10:19:12.412 INFO:teuthology.orchestra.run.gibba005.stdout: lttng-ust-2.8.1-11.el8.x86_64 2021-11-18T10:19:12.412 INFO:teuthology.orchestra.run.gibba005.stdout: python3-ceph-argparse-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.412 INFO:teuthology.orchestra.run.gibba005.stdout: python3-ceph-common-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.413 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cephfs-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.413 INFO:teuthology.orchestra.run.gibba005.stdout: python3-prettytable-0.7.2-14.el8.noarch 2021-11-18T10:19:12.413 INFO:teuthology.orchestra.run.gibba005.stdout: python3-rados-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.413 INFO:teuthology.orchestra.run.gibba005.stdout: python3-rbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.414 INFO:teuthology.orchestra.run.gibba005.stdout: python3-rgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:12.414 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:12.414 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:19:12.622 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph-test 2021-11-18T10:19:12.716 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:19:12.899 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 1/7 2021-11-18T10:19:12.960 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:00:32 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:13.100 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-11-18T10:19:13.264 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 3/7 2021-11-18T10:19:13.458 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-18T10:19:13.511 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-18T10:19:13.644 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:19:13.646 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:13.647 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repository Size 2021-11-18T10:19:13.647 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:13.648 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:19:13.648 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-test x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 45 M 2021-11-18T10:19:13.648 INFO:teuthology.orchestra.run.gibba005.stdout:Installing dependencies: 2021-11-18T10:19:13.649 INFO:teuthology.orchestra.run.gibba005.stdout: jq x86_64 1.5-12.el8 CentOS-AppStream 161 k 2021-11-18T10:19:13.649 INFO:teuthology.orchestra.run.gibba005.stdout: libcephsqlite x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 170 k 2021-11-18T10:19:13.649 INFO:teuthology.orchestra.run.gibba005.stdout: libxslt x86_64 1.1.32-6.el8 CentOS-Base 250 k 2021-11-18T10:19:13.650 INFO:teuthology.orchestra.run.gibba005.stdout: oniguruma x86_64 6.8.2-2.el8 CentOS-AppStream 187 k 2021-11-18T10:19:13.650 INFO:teuthology.orchestra.run.gibba005.stdout: socat x86_64 1.7.4.1-1.el8 CentOS-AppStream 323 k 2021-11-18T10:19:13.650 INFO:teuthology.orchestra.run.gibba005.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2021-11-18T10:19:13.650 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:13.651 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:19:13.651 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:13.651 INFO:teuthology.orchestra.run.gibba005.stdout:Install 7 Packages 2021-11-18T10:19:13.651 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:13.651 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 46 M 2021-11-18T10:19:13.652 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 211 M 2021-11-18T10:19:13.652 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:19:13.686 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-11-18T10:19:13.691 INFO:teuthology.orchestra.run.gibba005.stdout:(1/7): jq-1.5-12.el8.x86_64.rpm 3.5 MB/s | 161 kB 00:00 2021-11-18T10:19:13.697 INFO:teuthology.orchestra.run.gibba005.stdout:(2/7): oniguruma-6.8.2-2.el8.x86_64.rpm 32 MB/s | 187 kB 00:00 2021-11-18T10:19:13.709 INFO:teuthology.orchestra.run.gibba005.stdout:(3/7): socat-1.7.4.1-1.el8.x86_64.rpm 26 MB/s | 323 kB 00:00 2021-11-18T10:19:13.721 INFO:teuthology.orchestra.run.gibba005.stdout:(4/7): libxslt-1.1.32-6.el8.x86_64.rpm 21 MB/s | 250 kB 00:00 2021-11-18T10:19:13.832 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : libcephsqlite-2:17.0.0-9003.g44cd7c76.el8.x86_64 6/7 2021-11-18T10:19:13.837 INFO:teuthology.orchestra.run.gibba005.stdout:(5/7): xmlstarlet-1.6.1-11.el8.x86_64.rpm 595 kB/s | 69 kB 00:00 2021-11-18T10:19:13.915 INFO:teuthology.orchestra.run.gibba005.stdout:(6/7): libcephsqlite-17.0.0-9003.g44cd7c76.el8. 632 kB/s | 170 kB 00:00 2021-11-18T10:19:16.007 INFO:teuthology.orchestra.run.gibba005.stdout:(7/7): ceph-test-17.0.0-9003.g44cd7c76.el8.x86_ 19 MB/s | 45 MB 00:02 2021-11-18T10:19:16.009 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:16.010 INFO:teuthology.orchestra.run.gibba005.stdout:Total 19 MB/s | 46 MB 00:02 2021-11-18T10:19:16.014 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:19:16.030 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:19:16.031 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:19:16.215 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:19:16.217 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:19:16.637 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:19:16.813 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : libxslt-1.1.32-6.el8.x86_64 1/7 2021-11-18T10:19:17.011 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 2/7 2021-11-18T10:19:17.166 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 3/7 2021-11-18T10:19:17.340 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: libcephsqlite-2:17.0.0-9003.g44cd7c76.el8.x86_64 6/7 2021-11-18T10:19:17.367 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-18T10:19:17.422 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-18T10:19:17.588 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-test-2:17.0.0-9003.g44cd7c76.el8.x86_64 7/7 2021-11-18T10:19:17.638 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : jq-1.5-12.el8.x86_64 5/7 2021-11-18T10:19:17.750 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-test-2:17.0.0-9003.g44cd7c76.el8.x86_64 7/7 2021-11-18T10:19:17.750 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-test-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/7 2021-11-18T10:19:17.750 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : libcephsqlite-2:17.0.0-9003.g44cd7c76.el8.x86_64 2/7 2021-11-18T10:19:17.750 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-11-18T10:19:17.751 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-18T10:19:17.751 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/7 2021-11-18T10:19:17.751 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 6/7 2021-11-18T10:19:17.801 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : libcephsqlite-2:17.0.0-9003.g44cd7c76.el8.x86_64 6/7 2021-11-18T10:19:18.093 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-11-18T10:19:18.093 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:18.093 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:19:18.094 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-test-2:17.0.0-9003.g44cd7c76.el8.x86_64 jq-1.5-12.el8.x86_64 2021-11-18T10:19:18.094 INFO:teuthology.orchestra.run.gibba019.stdout: libcephsqlite-2:17.0.0-9003.g44cd7c76.el8.x86_64 libxslt-1.1.32-6.el8.x86_64 2021-11-18T10:19:18.094 INFO:teuthology.orchestra.run.gibba019.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2021-11-18T10:19:18.094 INFO:teuthology.orchestra.run.gibba019.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-11-18T10:19:18.095 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:18.095 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:19:18.283 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph 2021-11-18T10:19:18.611 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:00:38 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:19.346 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:19:19.349 INFO:teuthology.orchestra.run.gibba019.stdout:======================================================================================= 2021-11-18T10:19:19.349 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repository Size 2021-11-18T10:19:19.349 INFO:teuthology.orchestra.run.gibba019.stdout:======================================================================================= 2021-11-18T10:19:19.349 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:19:19.350 INFO:teuthology.orchestra.run.gibba019.stdout: ceph x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 6.4 k 2021-11-18T10:19:19.350 INFO:teuthology.orchestra.run.gibba019.stdout:Installing dependencies: 2021-11-18T10:19:19.350 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mds x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 2.3 M 2021-11-18T10:19:19.350 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 1.5 M 2021-11-18T10:19:19.351 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-modules-core noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 216 k 2021-11-18T10:19:19.351 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mon x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 3.9 M 2021-11-18T10:19:19.351 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-osd x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 17 M 2021-11-18T10:19:19.351 INFO:teuthology.orchestra.run.gibba019.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-11-18T10:19:19.351 INFO:teuthology.orchestra.run.gibba019.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-11-18T10:19:19.352 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2021-11-18T10:19:19.352 INFO:teuthology.orchestra.run.gibba019.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-11-18T10:19:19.352 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-11-18T10:19:19.352 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-11-18T10:19:19.353 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2021-11-18T10:19:19.353 INFO:teuthology.orchestra.run.gibba019.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2021-11-18T10:19:19.353 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-11-18T10:19:19.354 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-11-18T10:19:19.354 INFO:teuthology.orchestra.run.gibba019.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-11-18T10:19:19.354 INFO:teuthology.orchestra.run.gibba019.stdout: python3-lxml x86_64 4.2.3-3.el8 CentOS-AppStream 1.5 M 2021-11-18T10:19:19.354 INFO:teuthology.orchestra.run.gibba019.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-11-18T10:19:19.354 INFO:teuthology.orchestra.run.gibba019.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-11-18T10:19:19.355 INFO:teuthology.orchestra.run.gibba019.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-11-18T10:19:19.355 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-11-18T10:19:19.355 INFO:teuthology.orchestra.run.gibba019.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-11-18T10:19:19.355 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2021-11-18T10:19:19.356 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2021-11-18T10:19:19.356 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-11-18T10:19:19.356 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-11-18T10:19:19.356 INFO:teuthology.orchestra.run.gibba019.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-11-18T10:19:19.356 INFO:teuthology.orchestra.run.gibba019.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-11-18T10:19:19.357 INFO:teuthology.orchestra.run.gibba019.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-11-18T10:19:19.357 INFO:teuthology.orchestra.run.gibba019.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-11-18T10:19:19.357 INFO:teuthology.orchestra.run.gibba019.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-11-18T10:19:19.357 INFO:teuthology.orchestra.run.gibba019.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2021-11-18T10:19:19.358 INFO:teuthology.orchestra.run.gibba019.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-11-18T10:19:19.358 INFO:teuthology.orchestra.run.gibba019.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-11-18T10:19:19.358 INFO:teuthology.orchestra.run.gibba019.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-11-18T10:19:19.358 INFO:teuthology.orchestra.run.gibba019.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-11-18T10:19:19.358 INFO:teuthology.orchestra.run.gibba019.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-11-18T10:19:19.359 INFO:teuthology.orchestra.run.gibba019.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-11-18T10:19:19.359 INFO:teuthology.orchestra.run.gibba019.stdout:Installing weak dependencies: 2021-11-18T10:19:19.359 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-11-18T10:19:19.359 INFO:teuthology.orchestra.run.gibba019.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-11-18T10:19:19.360 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:19.360 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:19:19.360 INFO:teuthology.orchestra.run.gibba019.stdout:======================================================================================= 2021-11-18T10:19:19.360 INFO:teuthology.orchestra.run.gibba019.stdout:Install 41 Packages 2021-11-18T10:19:19.360 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:19.361 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 30 M 2021-11-18T10:19:19.361 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 120 M 2021-11-18T10:19:19.362 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:19:19.599 INFO:teuthology.orchestra.run.gibba019.stdout:(1/41): ceph-17.0.0-9003.g44cd7c76.el8.x86_64.r 26 kB/s | 6.4 kB 00:00 2021-11-18T10:19:20.336 INFO:teuthology.orchestra.run.gibba019.stdout:(2/41): ceph-mgr-17.0.0-9003.g44cd7c76.el8.x86_ 1.5 MB/s | 1.5 MB 00:00 2021-11-18T10:19:20.439 INFO:teuthology.orchestra.run.gibba019.stdout:(3/41): ceph-mds-17.0.0-9003.g44cd7c76.el8.x86_ 2.1 MB/s | 2.3 MB 00:01 2021-11-18T10:19:20.514 INFO:teuthology.orchestra.run.gibba019.stdout:(4/41): ceph-mgr-modules-core-17.0.0-9003.g44cd 2.8 MB/s | 216 kB 00:00 2021-11-18T10:19:20.550 INFO:teuthology.orchestra.run.gibba019.stdout:(5/41): python3-html5lib-0.999999999-6.el8.noar 5.8 MB/s | 214 kB 00:00 2021-11-18T10:19:20.567 INFO:teuthology.orchestra.run.gibba019.stdout:(6/41): python3-lxml-4.2.3-3.el8.x86_64.rpm 87 MB/s | 1.5 MB 00:00 2021-11-18T10:19:20.570 INFO:teuthology.orchestra.run.gibba019.stdout:(7/41): python3-mako-1.0.6-13.el8.noarch.rpm 59 MB/s | 157 kB 00:00 2021-11-18T10:19:20.571 INFO:teuthology.orchestra.run.gibba019.stdout:(8/41): python3-markupsafe-0.23-19.el8.x86_64.r 29 MB/s | 39 kB 00:00 2021-11-18T10:19:20.574 INFO:teuthology.orchestra.run.gibba019.stdout:(9/41): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 49 MB/s | 103 kB 00:00 2021-11-18T10:19:20.575 INFO:teuthology.orchestra.run.gibba019.stdout:(10/41): python3-pytz-2017.2-9.el8.noarch.rpm 38 MB/s | 54 kB 00:00 2021-11-18T10:19:20.576 INFO:teuthology.orchestra.run.gibba019.stdout:(11/41): python3-webencodings-0.5.1-6.el8.noarc 22 MB/s | 27 kB 00:00 2021-11-18T10:19:20.582 INFO:teuthology.orchestra.run.gibba019.stdout:(12/41): python3-werkzeug-0.12.2-4.el8.noarch.r 78 MB/s | 457 kB 00:00 2021-11-18T10:19:20.585 INFO:teuthology.orchestra.run.gibba019.stdout:(13/41): python3-cffi-1.11.5-5.el8.x86_64.rpm 73 MB/s | 237 kB 00:00 2021-11-18T10:19:20.588 INFO:teuthology.orchestra.run.gibba019.stdout:(14/41): python3-chardet-3.0.4-7.el8.noarch.rpm 65 MB/s | 195 kB 00:00 2021-11-18T10:19:20.596 INFO:teuthology.orchestra.run.gibba019.stdout:(15/41): python3-cryptography-3.2.1-5.el8.x86_6 73 MB/s | 559 kB 00:00 2021-11-18T10:19:20.598 INFO:teuthology.orchestra.run.gibba019.stdout:(16/41): python3-idna-2.5-5.el8.noarch.rpm 51 MB/s | 97 kB 00:00 2021-11-18T10:19:20.600 INFO:teuthology.orchestra.run.gibba019.stdout:(17/41): python3-pycparser-2.14-14.el8.noarch.r 54 MB/s | 109 kB 00:00 2021-11-18T10:19:20.601 INFO:teuthology.orchestra.run.gibba019.stdout:(18/41): python3-pysocks-1.6.8-3.el8.noarch.rpm 31 MB/s | 34 kB 00:00 2021-11-18T10:19:20.603 INFO:teuthology.orchestra.run.gibba019.stdout:(19/41): python3-requests-2.20.0-2.1.el8_1.noar 58 MB/s | 123 kB 00:00 2021-11-18T10:19:20.606 INFO:teuthology.orchestra.run.gibba019.stdout:(20/41): python3-urllib3-1.24.2-5.el8.noarch.rp 66 MB/s | 177 kB 00:00 2021-11-18T10:19:20.731 INFO:teuthology.orchestra.run.gibba019.stdout:(21/41): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 349 kB/s | 44 kB 00:00 2021-11-18T10:19:20.780 INFO:teuthology.orchestra.run.gibba019.stdout:(22/41): ceph-mon-17.0.0-9003.g44cd7c76.el8.x86 3.3 MB/s | 3.9 MB 00:01 2021-11-18T10:19:20.822 INFO:teuthology.orchestra.run.gibba019.stdout:(23/41): python3-beautifulsoup4-4.6.3-2.el8.1.n 2.0 MB/s | 185 kB 00:00 2021-11-18T10:19:20.924 INFO:teuthology.orchestra.run.gibba019.stdout:(24/41): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.2 MB/s | 173 kB 00:00 2021-11-18T10:19:20.943 INFO:teuthology.orchestra.run.gibba019.stdout:(25/41): python3-cherrypy-18.4.0-1.el8.noarch.r 3.1 MB/s | 384 kB 00:00 2021-11-18T10:19:20.953 INFO:teuthology.orchestra.run.gibba019.stdout:(26/41): python3-cssselect-0.9.2-10.el8.noarch. 1.3 MB/s | 40 kB 00:00 2021-11-18T10:19:20.972 INFO:teuthology.orchestra.run.gibba019.stdout:(27/41): python3-jaraco-6.2-6.el8.noarch.rpm 383 kB/s | 11 kB 00:00 2021-11-18T10:19:20.983 INFO:teuthology.orchestra.run.gibba019.stdout:(28/41): python3-jaraco-functools-2.0-4.el8.noa 611 kB/s | 18 kB 00:00 2021-11-18T10:19:21.004 INFO:teuthology.orchestra.run.gibba019.stdout:(29/41): python3-logutils-0.3.5-11.el8.noarch.r 1.5 MB/s | 49 kB 00:00 2021-11-18T10:19:21.013 INFO:teuthology.orchestra.run.gibba019.stdout:(30/41): python3-more-itertools-7.2.0-3.el8.noa 1.9 MB/s | 59 kB 00:00 2021-11-18T10:19:21.060 INFO:teuthology.orchestra.run.gibba019.stdout:(31/41): python3-portend-2.6-1.el8.noarch.rpm 335 kB/s | 16 kB 00:00 2021-11-18T10:19:21.105 INFO:teuthology.orchestra.run.gibba019.stdout:(32/41): python3-simplegeneric-0.8.1-17.el8.noa 413 kB/s | 19 kB 00:00 2021-11-18T10:19:21.144 INFO:teuthology.orchestra.run.gibba019.stdout:(33/41): python3-pecan-1.3.2-9.el8.noarch.rpm 2.0 MB/s | 283 kB 00:00 2021-11-18T10:19:21.152 INFO:teuthology.orchestra.run.gibba019.stdout:(34/41): python3-singledispatch-3.4.0.3-18.el8. 505 kB/s | 24 kB 00:00 2021-11-18T10:19:21.193 INFO:teuthology.orchestra.run.gibba019.stdout:(35/41): python3-tempora-1.14.1-5.el8.noarch.rp 591 kB/s | 29 kB 00:00 2021-11-18T10:19:21.201 INFO:teuthology.orchestra.run.gibba019.stdout:(36/41): python3-trustme-0.6.0-4.el8.noarch.rpm 574 kB/s | 27 kB 00:00 2021-11-18T10:19:21.244 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: libcephsqlite-2:17.0.0-9003.g44cd7c76.el8.x86_64 6/7 2021-11-18T10:19:21.281 INFO:teuthology.orchestra.run.gibba019.stdout:(37/41): python3-waitress-1.2.1-2.el8.1.noarch. 2.7 MB/s | 241 kB 00:00 2021-11-18T10:19:21.329 INFO:teuthology.orchestra.run.gibba019.stdout:(38/41): python3-webtest-2.0.33-1.el8.noarch.rp 1.7 MB/s | 85 kB 00:00 2021-11-18T10:19:21.335 INFO:teuthology.orchestra.run.gibba019.stdout:(39/41): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.8 MB/s | 251 kB 00:00 2021-11-18T10:19:21.380 INFO:teuthology.orchestra.run.gibba019.stdout:(40/41): python3-zc-lockfile-2.0-2.el8.noarch.r 450 kB/s | 23 kB 00:00 2021-11-18T10:19:21.481 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-test-2:17.0.0-9003.g44cd7c76.el8.x86_64 7/7 2021-11-18T10:19:21.643 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-test-2:17.0.0-9003.g44cd7c76.el8.x86_64 7/7 2021-11-18T10:19:21.644 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-test-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/7 2021-11-18T10:19:21.644 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : libcephsqlite-2:17.0.0-9003.g44cd7c76.el8.x86_64 2/7 2021-11-18T10:19:21.644 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : jq-1.5-12.el8.x86_64 3/7 2021-11-18T10:19:21.645 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 4/7 2021-11-18T10:19:21.645 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/7 2021-11-18T10:19:21.645 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : libxslt-1.1.32-6.el8.x86_64 6/7 2021-11-18T10:19:22.050 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 7/7 2021-11-18T10:19:22.051 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:22.051 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:19:22.051 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-test-2:17.0.0-9003.g44cd7c76.el8.x86_64 jq-1.5-12.el8.x86_64 2021-11-18T10:19:22.052 INFO:teuthology.orchestra.run.gibba005.stdout: libcephsqlite-2:17.0.0-9003.g44cd7c76.el8.x86_64 libxslt-1.1.32-6.el8.x86_64 2021-11-18T10:19:22.052 INFO:teuthology.orchestra.run.gibba005.stdout: oniguruma-6.8.2-2.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2021-11-18T10:19:22.052 INFO:teuthology.orchestra.run.gibba005.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2021-11-18T10:19:22.052 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:22.052 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:19:22.183 INFO:teuthology.orchestra.run.gibba019.stdout:(41/41): ceph-osd-17.0.0-9003.g44cd7c76.el8.x86 9.0 MB/s | 17 MB 00:01 2021-11-18T10:19:22.186 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:22.186 INFO:teuthology.orchestra.run.gibba019.stdout:Total 11 MB/s | 30 MB 00:02 2021-11-18T10:19:22.206 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:19:22.208 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph 2021-11-18T10:19:22.450 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:19:22.450 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:19:22.542 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:00:42 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:22.713 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:19:22.715 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:19:23.201 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:19:23.204 INFO:teuthology.orchestra.run.gibba005.stdout:======================================================================================= 2021-11-18T10:19:23.204 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repository Size 2021-11-18T10:19:23.204 INFO:teuthology.orchestra.run.gibba005.stdout:======================================================================================= 2021-11-18T10:19:23.204 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:19:23.205 INFO:teuthology.orchestra.run.gibba005.stdout: ceph x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 6.4 k 2021-11-18T10:19:23.205 INFO:teuthology.orchestra.run.gibba005.stdout:Installing dependencies: 2021-11-18T10:19:23.205 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mds x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 2.3 M 2021-11-18T10:19:23.205 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 1.5 M 2021-11-18T10:19:23.205 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-modules-core noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 216 k 2021-11-18T10:19:23.206 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mon x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 3.9 M 2021-11-18T10:19:23.206 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-osd x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 17 M 2021-11-18T10:19:23.206 INFO:teuthology.orchestra.run.gibba005.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2021-11-18T10:19:23.206 INFO:teuthology.orchestra.run.gibba005.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2021-11-18T10:19:23.207 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cffi x86_64 1.11.5-5.el8 CentOS-Base 237 k 2021-11-18T10:19:23.207 INFO:teuthology.orchestra.run.gibba005.stdout: python3-chardet noarch 3.0.4-7.el8 CentOS-Base 195 k 2021-11-18T10:19:23.207 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2021-11-18T10:19:23.207 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2021-11-18T10:19:23.208 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cryptography x86_64 3.2.1-5.el8 CentOS-Base 559 k 2021-11-18T10:19:23.208 INFO:teuthology.orchestra.run.gibba005.stdout: python3-idna noarch 2.5-5.el8 CentOS-Base 97 k 2021-11-18T10:19:23.208 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2021-11-18T10:19:23.208 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2021-11-18T10:19:23.209 INFO:teuthology.orchestra.run.gibba005.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2021-11-18T10:19:23.209 INFO:teuthology.orchestra.run.gibba005.stdout: python3-lxml x86_64 4.2.3-3.el8 CentOS-AppStream 1.5 M 2021-11-18T10:19:23.209 INFO:teuthology.orchestra.run.gibba005.stdout: python3-mako noarch 1.0.6-13.el8 CentOS-AppStream 157 k 2021-11-18T10:19:23.209 INFO:teuthology.orchestra.run.gibba005.stdout: python3-markupsafe x86_64 0.23-19.el8 CentOS-AppStream 39 k 2021-11-18T10:19:23.209 INFO:teuthology.orchestra.run.gibba005.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2021-11-18T10:19:23.210 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2021-11-18T10:19:23.210 INFO:teuthology.orchestra.run.gibba005.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2021-11-18T10:19:23.210 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 CentOS-AppStream 103 k 2021-11-18T10:19:23.210 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pycparser noarch 2.14-14.el8 CentOS-Base 109 k 2021-11-18T10:19:23.211 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pysocks noarch 1.6.8-3.el8 CentOS-Base 34 k 2021-11-18T10:19:23.211 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pytz noarch 2017.2-9.el8 CentOS-AppStream 54 k 2021-11-18T10:19:23.211 INFO:teuthology.orchestra.run.gibba005.stdout: python3-requests noarch 2.20.0-2.1.el8_1 CentOS-Base 123 k 2021-11-18T10:19:23.211 INFO:teuthology.orchestra.run.gibba005.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2021-11-18T10:19:23.212 INFO:teuthology.orchestra.run.gibba005.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2021-11-18T10:19:23.212 INFO:teuthology.orchestra.run.gibba005.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2021-11-18T10:19:23.212 INFO:teuthology.orchestra.run.gibba005.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2021-11-18T10:19:23.212 INFO:teuthology.orchestra.run.gibba005.stdout: python3-urllib3 noarch 1.24.2-5.el8 CentOS-Base 177 k 2021-11-18T10:19:23.212 INFO:teuthology.orchestra.run.gibba005.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2021-11-18T10:19:23.213 INFO:teuthology.orchestra.run.gibba005.stdout: python3-webencodings noarch 0.5.1-6.el8 CentOS-AppStream 27 k 2021-11-18T10:19:23.213 INFO:teuthology.orchestra.run.gibba005.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2021-11-18T10:19:23.213 INFO:teuthology.orchestra.run.gibba005.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2021-11-18T10:19:23.213 INFO:teuthology.orchestra.run.gibba005.stdout: python3-werkzeug noarch 0.12.2-4.el8 CentOS-AppStream 457 k 2021-11-18T10:19:23.214 INFO:teuthology.orchestra.run.gibba005.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2021-11-18T10:19:23.214 INFO:teuthology.orchestra.run.gibba005.stdout:Installing weak dependencies: 2021-11-18T10:19:23.214 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2021-11-18T10:19:23.214 INFO:teuthology.orchestra.run.gibba005.stdout: python3-html5lib noarch 1:0.999999999-6.el8 CentOS-AppStream 214 k 2021-11-18T10:19:23.215 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:23.215 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:19:23.215 INFO:teuthology.orchestra.run.gibba005.stdout:======================================================================================= 2021-11-18T10:19:23.215 INFO:teuthology.orchestra.run.gibba005.stdout:Install 41 Packages 2021-11-18T10:19:23.215 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:23.216 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 30 M 2021-11-18T10:19:23.217 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 120 M 2021-11-18T10:19:23.217 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:19:23.417 INFO:teuthology.orchestra.run.gibba005.stdout:(1/41): ceph-17.0.0-9003.g44cd7c76.el8.x86_64.r 31 kB/s | 6.4 kB 00:00 2021-11-18T10:19:23.781 INFO:teuthology.orchestra.run.gibba005.stdout:(2/41): ceph-mgr-17.0.0-9003.g44cd7c76.el8.x86_ 2.7 MB/s | 1.5 MB 00:00 2021-11-18T10:19:23.786 INFO:teuthology.orchestra.run.gibba005.stdout:(3/41): ceph-mds-17.0.0-9003.g44cd7c76.el8.x86_ 3.9 MB/s | 2.3 MB 00:00 2021-11-18T10:19:23.858 INFO:teuthology.orchestra.run.gibba005.stdout:(4/41): ceph-mgr-modules-core-17.0.0-9003.g44cd 3.0 MB/s | 216 kB 00:00 2021-11-18T10:19:23.893 INFO:teuthology.orchestra.run.gibba005.stdout:(5/41): python3-html5lib-0.999999999-6.el8.noar 5.9 MB/s | 214 kB 00:00 2021-11-18T10:19:23.911 INFO:teuthology.orchestra.run.gibba005.stdout:(6/41): python3-lxml-4.2.3-3.el8.x86_64.rpm 84 MB/s | 1.5 MB 00:00 2021-11-18T10:19:23.914 INFO:teuthology.orchestra.run.gibba005.stdout:(7/41): python3-mako-1.0.6-13.el8.noarch.rpm 62 MB/s | 157 kB 00:00 2021-11-18T10:19:23.915 INFO:teuthology.orchestra.run.gibba005.stdout:(8/41): python3-markupsafe-0.23-19.el8.x86_64.r 33 MB/s | 39 kB 00:00 2021-11-18T10:19:23.917 INFO:teuthology.orchestra.run.gibba005.stdout:(9/41): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 55 MB/s | 103 kB 00:00 2021-11-18T10:19:23.919 INFO:teuthology.orchestra.run.gibba005.stdout:(10/41): python3-pytz-2017.2-9.el8.noarch.rpm 42 MB/s | 54 kB 00:00 2021-11-18T10:19:23.919 INFO:teuthology.orchestra.run.gibba005.stdout:(11/41): python3-webencodings-0.5.1-6.el8.noarc 26 MB/s | 27 kB 00:00 2021-11-18T10:19:23.925 INFO:teuthology.orchestra.run.gibba005.stdout:(12/41): python3-werkzeug-0.12.2-4.el8.noarch.r 82 MB/s | 457 kB 00:00 2021-11-18T10:19:23.935 INFO:teuthology.orchestra.run.gibba005.stdout:(13/41): ceph-mon-17.0.0-9003.g44cd7c76.el8.x86 7.5 MB/s | 3.9 MB 00:00 2021-11-18T10:19:23.936 INFO:teuthology.orchestra.run.gibba005.stdout:(14/41): python3-cffi-1.11.5-5.el8.x86_64.rpm 22 MB/s | 237 kB 00:00 2021-11-18T10:19:23.945 INFO:teuthology.orchestra.run.gibba005.stdout:(15/41): python3-cryptography-3.2.1-5.el8.x86_6 59 MB/s | 559 kB 00:00 2021-11-18T10:19:23.947 INFO:teuthology.orchestra.run.gibba005.stdout:(16/41): python3-idna-2.5-5.el8.noarch.rpm 54 MB/s | 97 kB 00:00 2021-11-18T10:19:23.949 INFO:teuthology.orchestra.run.gibba005.stdout:(17/41): python3-pycparser-2.14-14.el8.noarch.r 58 MB/s | 109 kB 00:00 2021-11-18T10:19:23.950 INFO:teuthology.orchestra.run.gibba005.stdout:(18/41): python3-pysocks-1.6.8-3.el8.noarch.rpm 30 MB/s | 34 kB 00:00 2021-11-18T10:19:23.952 INFO:teuthology.orchestra.run.gibba005.stdout:(19/41): python3-requests-2.20.0-2.1.el8_1.noar 59 MB/s | 123 kB 00:00 2021-11-18T10:19:23.955 INFO:teuthology.orchestra.run.gibba005.stdout:(20/41): python3-urllib3-1.24.2-5.el8.noarch.rp 66 MB/s | 177 kB 00:00 2021-11-18T10:19:23.966 INFO:teuthology.orchestra.run.gibba005.stdout:(21/41): python3-chardet-3.0.4-7.el8.noarch.rpm 6.1 MB/s | 195 kB 00:00 2021-11-18T10:19:24.082 INFO:teuthology.orchestra.run.gibba005.stdout:(22/41): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 342 kB/s | 44 kB 00:00 2021-11-18T10:19:24.113 INFO:teuthology.orchestra.run.gibba005.stdout:(23/41): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.2 MB/s | 185 kB 00:00 2021-11-18T10:19:24.150 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:19:24.167 INFO:teuthology.orchestra.run.gibba005.stdout:(24/41): python3-cheroot-8.5.2-1.el8.noarch.rpm 2.0 MB/s | 173 kB 00:00 2021-11-18T10:19:24.201 INFO:teuthology.orchestra.run.gibba005.stdout:(25/41): python3-cssselect-0.9.2-10.el8.noarch. 1.2 MB/s | 40 kB 00:00 2021-11-18T10:19:24.230 INFO:teuthology.orchestra.run.gibba005.stdout:(26/41): python3-cherrypy-18.4.0-1.el8.noarch.r 3.2 MB/s | 384 kB 00:00 2021-11-18T10:19:24.230 INFO:teuthology.orchestra.run.gibba005.stdout:(27/41): python3-jaraco-6.2-6.el8.noarch.rpm 391 kB/s | 11 kB 00:00 2021-11-18T10:19:24.257 INFO:teuthology.orchestra.run.gibba005.stdout:(28/41): python3-jaraco-functools-2.0-4.el8.noa 631 kB/s | 18 kB 00:00 2021-11-18T10:19:24.258 INFO:teuthology.orchestra.run.gibba005.stdout:(29/41): python3-logutils-0.3.5-11.el8.noarch.r 1.7 MB/s | 49 kB 00:00 2021-11-18T10:19:24.286 INFO:teuthology.orchestra.run.gibba005.stdout:(30/41): python3-more-itertools-7.2.0-3.el8.noa 2.0 MB/s | 59 kB 00:00 2021-11-18T10:19:24.314 INFO:teuthology.orchestra.run.gibba005.stdout:(31/41): python3-portend-2.6-1.el8.noarch.rpm 560 kB/s | 16 kB 00:00 2021-11-18T10:19:24.342 INFO:teuthology.orchestra.run.gibba005.stdout:(32/41): python3-pecan-1.3.2-9.el8.noarch.rpm 3.3 MB/s | 283 kB 00:00 2021-11-18T10:19:24.342 INFO:teuthology.orchestra.run.gibba005.stdout:(33/41): python3-simplegeneric-0.8.1-17.el8.noa 657 kB/s | 19 kB 00:00 2021-11-18T10:19:24.370 INFO:teuthology.orchestra.run.gibba005.stdout:(34/41): python3-singledispatch-3.4.0.3-18.el8. 858 kB/s | 24 kB 00:00 2021-11-18T10:19:24.371 INFO:teuthology.orchestra.run.gibba005.stdout:(35/41): python3-tempora-1.14.1-5.el8.noarch.rp 1.0 MB/s | 29 kB 00:00 2021-11-18T10:19:24.391 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/41 2021-11-18T10:19:24.398 INFO:teuthology.orchestra.run.gibba005.stdout:(36/41): python3-trustme-0.6.0-4.el8.noarch.rpm 975 kB/s | 27 kB 00:00 2021-11-18T10:19:24.453 INFO:teuthology.orchestra.run.gibba005.stdout:(37/41): python3-waitress-1.2.1-2.el8.1.noarch. 2.8 MB/s | 241 kB 00:00 2021-11-18T10:19:24.481 INFO:teuthology.orchestra.run.gibba005.stdout:(38/41): python3-webob-1.8.5-1.el8.1.noarch.rpm 3.0 MB/s | 251 kB 00:00 2021-11-18T10:19:24.482 INFO:teuthology.orchestra.run.gibba005.stdout:(39/41): python3-webtest-2.0.33-1.el8.noarch.rp 2.9 MB/s | 85 kB 00:00 2021-11-18T10:19:24.588 INFO:teuthology.orchestra.run.gibba005.stdout:(40/41): ceph-osd-17.0.0-9003.g44cd7c76.el8.x86 21 MB/s | 17 MB 00:00 2021-11-18T10:19:24.589 INFO:teuthology.orchestra.run.gibba005.stdout:(41/41): python3-zc-lockfile-2.0-2.el8.noarch.r 214 kB/s | 23 kB 00:00 2021-11-18T10:19:24.591 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:24.592 INFO:teuthology.orchestra.run.gibba005.stdout:Total 22 MB/s | 30 MB 00:01 2021-11-18T10:19:24.605 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/41 2021-11-18T10:19:24.609 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:19:24.638 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:19:24.638 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:19:24.755 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-idna-2.5-5.el8.noarch 3/41 2021-11-18T10:19:24.906 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:19:24.908 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:19:24.987 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 4/41 2021-11-18T10:19:25.196 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 5/41 2021-11-18T10:19:25.394 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/41 2021-11-18T10:19:25.538 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/41 2021-11-18T10:19:25.735 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/41 2021-11-18T10:19:25.904 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/41 2021-11-18T10:19:26.057 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/41 2021-11-18T10:19:26.271 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 11/41 2021-11-18T10:19:26.485 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 12/41 2021-11-18T10:19:26.729 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 13/41 2021-11-18T10:19:26.929 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:19:26.979 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 14/41 2021-11-18T10:19:27.109 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/41 2021-11-18T10:19:27.328 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-11-18T10:19:27.340 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/41 2021-11-18T10:19:27.490 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-idna-2.5-5.el8.noarch 3/41 2021-11-18T10:19:27.581 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 16/41 2021-11-18T10:19:27.697 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 4/41 2021-11-18T10:19:27.780 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 17/41 2021-11-18T10:19:27.872 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 5/41 2021-11-18T10:19:27.952 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 18/41 2021-11-18T10:19:28.054 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 6/41 2021-11-18T10:19:28.222 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 7/41 2021-11-18T10:19:28.428 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 8/41 2021-11-18T10:19:28.572 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 9/41 2021-11-18T10:19:28.775 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 10/41 2021-11-18T10:19:28.956 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 11/41 2021-11-18T10:19:29.186 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 12/41 2021-11-18T10:19:29.380 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-urllib3-1.24.2-5.el8.noarch 13/41 2021-11-18T10:19:29.381 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 19/41 2021-11-18T10:19:29.609 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 14/41 2021-11-18T10:19:29.632 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 20/41 2021-11-18T10:19:29.854 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 21/41 2021-11-18T10:19:29.903 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-11-18T10:19:30.114 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 22/41 2021-11-18T10:19:30.294 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 16/41 2021-11-18T10:19:30.324 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/41 2021-11-18T10:19:30.331 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 17/41 2021-11-18T10:19:30.517 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 24/41 2021-11-18T10:19:30.536 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 18/41 2021-11-18T10:19:30.718 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 25/41 2021-11-18T10:19:30.758 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 19/41 2021-11-18T10:19:30.975 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 20/41 2021-11-18T10:19:31.046 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 26/41 2021-11-18T10:19:31.189 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 21/41 2021-11-18T10:19:31.264 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-lxml-4.2.3-3.el8.x86_64 27/41 2021-11-18T10:19:31.405 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 22/41 2021-11-18T10:19:31.476 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 28/41 2021-11-18T10:19:31.592 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 23/41 2021-11-18T10:19:31.690 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 29/41 2021-11-18T10:19:31.786 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 24/41 2021-11-18T10:19:31.886 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 30/41 2021-11-18T10:19:31.970 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 25/41 2021-11-18T10:19:32.099 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-portend-2.6-1.el8.noarch 31/41 2021-11-18T10:19:32.300 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 32/41 2021-11-18T10:19:32.520 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/41 2021-11-18T10:19:32.822 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/41 2021-11-18T10:19:33.148 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 35/41 2021-11-18T10:19:33.402 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 26/41 2021-11-18T10:19:33.479 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-9003.g44cd7c76.el8. 36/41 2021-11-18T10:19:33.670 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-lxml-4.2.3-3.el8.x86_64 27/41 2021-11-18T10:19:33.688 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-mgr-2:17.0.0-9003.g44cd7c76.el8.x86_64 37/41 2021-11-18T10:19:33.853 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 28/41 2021-11-18T10:19:34.050 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 29/41 2021-11-18T10:19:34.221 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 30/41 2021-11-18T10:19:34.477 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-portend-2.6-1.el8.noarch 31/41 2021-11-18T10:19:34.676 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 32/41 2021-11-18T10:19:34.853 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-mgr-2:17.0.0-9003.g44cd7c76.el8.x86_64 37/41 2021-11-18T10:19:34.922 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 33/41 2021-11-18T10:19:35.072 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-osd-2:17.0.0-9003.g44cd7c76.el8.x86_64 38/41 2021-11-18T10:19:35.235 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 34/41 2021-11-18T10:19:35.386 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-osd-2:17.0.0-9003.g44cd7c76.el8.x86_64 38/41 2021-11-18T10:19:35.499 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 35/41 2021-11-18T10:19:35.607 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-mon-2:17.0.0-9003.g44cd7c76.el8.x86_64 39/41 2021-11-18T10:19:35.786 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-mon-2:17.0.0-9003.g44cd7c76.el8.x86_64 39/41 2021-11-18T10:19:35.817 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-mgr-modules-core-2:17.0.0-9003.g44cd7c76.el8. 36/41 2021-11-18T10:19:35.941 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-mds-2:17.0.0-9003.g44cd7c76.el8.x86_64 40/41 2021-11-18T10:19:35.952 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-mds-2:17.0.0-9003.g44cd7c76.el8.x86_64 40/41 2021-11-18T10:19:36.002 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-mgr-2:17.0.0-9003.g44cd7c76.el8.x86_64 37/41 2021-11-18T10:19:36.096 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-2:17.0.0-9003.g44cd7c76.el8.x86_64 41/41 2021-11-18T10:19:36.373 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-2:17.0.0-9003.g44cd7c76.el8.x86_64 41/41 2021-11-18T10:19:36.373 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/41 2021-11-18T10:19:36.373 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-mds-2:17.0.0-9003.g44cd7c76.el8.x86_64 2/41 2021-11-18T10:19:36.374 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-mgr-2:17.0.0-9003.g44cd7c76.el8.x86_64 3/41 2021-11-18T10:19:36.374 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-mon-2:17.0.0-9003.g44cd7c76.el8.x86_64 4/41 2021-11-18T10:19:36.374 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-osd-2:17.0.0-9003.g44cd7c76.el8.x86_64 5/41 2021-11-18T10:19:36.374 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-9003.g44cd7c76.el8. 6/41 2021-11-18T10:19:36.374 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/41 2021-11-18T10:19:36.375 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-lxml-4.2.3-3.el8.x86_64 8/41 2021-11-18T10:19:36.375 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/41 2021-11-18T10:19:36.375 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/41 2021-11-18T10:19:36.375 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 11/41 2021-11-18T10:19:36.376 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 12/41 2021-11-18T10:19:36.376 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 13/41 2021-11-18T10:19:36.376 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 14/41 2021-11-18T10:19:36.376 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-11-18T10:19:36.377 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 16/41 2021-11-18T10:19:36.377 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 17/41 2021-11-18T10:19:36.377 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-idna-2.5-5.el8.noarch 18/41 2021-11-18T10:19:36.377 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 19/41 2021-11-18T10:19:36.377 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 20/41 2021-11-18T10:19:36.378 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 21/41 2021-11-18T10:19:36.378 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 22/41 2021-11-18T10:19:36.378 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 23/41 2021-11-18T10:19:36.378 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/41 2021-11-18T10:19:36.379 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 25/41 2021-11-18T10:19:36.379 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 26/41 2021-11-18T10:19:36.379 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 27/41 2021-11-18T10:19:36.379 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 28/41 2021-11-18T10:19:36.379 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 29/41 2021-11-18T10:19:36.380 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 30/41 2021-11-18T10:19:36.380 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 31/41 2021-11-18T10:19:36.380 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 32/41 2021-11-18T10:19:36.380 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-portend-2.6-1.el8.noarch 33/41 2021-11-18T10:19:36.381 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 34/41 2021-11-18T10:19:36.381 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 35/41 2021-11-18T10:19:36.381 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 36/41 2021-11-18T10:19:36.381 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 37/41 2021-11-18T10:19:36.381 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 38/41 2021-11-18T10:19:36.382 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 39/41 2021-11-18T10:19:36.382 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 40/41 2021-11-18T10:19:37.138 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 41/41 2021-11-18T10:19:37.138 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:37.139 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:19:37.139 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:37.139 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mds-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:37.140 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:37.140 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-modules-core-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:19:37.140 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mon-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:37.140 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-osd-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:37.141 INFO:teuthology.orchestra.run.gibba019.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-11-18T10:19:37.141 INFO:teuthology.orchestra.run.gibba019.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-11-18T10:19:37.141 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-11-18T10:19:37.141 INFO:teuthology.orchestra.run.gibba019.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-11-18T10:19:37.142 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-11-18T10:19:37.142 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-11-18T10:19:37.142 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2021-11-18T10:19:37.142 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-11-18T10:19:37.142 INFO:teuthology.orchestra.run.gibba019.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-11-18T10:19:37.143 INFO:teuthology.orchestra.run.gibba019.stdout: python3-idna-2.5-5.el8.noarch 2021-11-18T10:19:37.143 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jaraco-6.2-6.el8.noarch 2021-11-18T10:19:37.143 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-11-18T10:19:37.143 INFO:teuthology.orchestra.run.gibba019.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-11-18T10:19:37.144 INFO:teuthology.orchestra.run.gibba019.stdout: python3-lxml-4.2.3-3.el8.x86_64 2021-11-18T10:19:37.144 INFO:teuthology.orchestra.run.gibba019.stdout: python3-mako-1.0.6-13.el8.noarch 2021-11-18T10:19:37.144 INFO:teuthology.orchestra.run.gibba019.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-11-18T10:19:37.144 INFO:teuthology.orchestra.run.gibba019.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-11-18T10:19:37.144 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-11-18T10:19:37.145 INFO:teuthology.orchestra.run.gibba019.stdout: python3-portend-2.6-1.el8.noarch 2021-11-18T10:19:37.145 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2021-11-18T10:19:37.145 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pycparser-2.14-14.el8.noarch 2021-11-18T10:19:37.145 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-11-18T10:19:37.145 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pytz-2017.2-9.el8.noarch 2021-11-18T10:19:37.146 INFO:teuthology.orchestra.run.gibba019.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-11-18T10:19:37.146 INFO:teuthology.orchestra.run.gibba019.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-11-18T10:19:37.146 INFO:teuthology.orchestra.run.gibba019.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-11-18T10:19:37.146 INFO:teuthology.orchestra.run.gibba019.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-11-18T10:19:37.147 INFO:teuthology.orchestra.run.gibba019.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-11-18T10:19:37.147 INFO:teuthology.orchestra.run.gibba019.stdout: python3-urllib3-1.24.2-5.el8.noarch 2021-11-18T10:19:37.147 INFO:teuthology.orchestra.run.gibba019.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-11-18T10:19:37.147 INFO:teuthology.orchestra.run.gibba019.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-11-18T10:19:37.148 INFO:teuthology.orchestra.run.gibba019.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-11-18T10:19:37.148 INFO:teuthology.orchestra.run.gibba019.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-11-18T10:19:37.148 INFO:teuthology.orchestra.run.gibba019.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-11-18T10:19:37.148 INFO:teuthology.orchestra.run.gibba019.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-11-18T10:19:37.149 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:37.149 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:19:37.165 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-mgr-2:17.0.0-9003.g44cd7c76.el8.x86_64 37/41 2021-11-18T10:19:37.351 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph-base 2021-11-18T10:19:37.352 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-osd-2:17.0.0-9003.g44cd7c76.el8.x86_64 38/41 2021-11-18T10:19:37.668 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-osd-2:17.0.0-9003.g44cd7c76.el8.x86_64 38/41 2021-11-18T10:19:37.695 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:00:57 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:37.884 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-mon-2:17.0.0-9003.g44cd7c76.el8.x86_64 39/41 2021-11-18T10:19:38.060 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-mon-2:17.0.0-9003.g44cd7c76.el8.x86_64 39/41 2021-11-18T10:19:38.173 INFO:teuthology.orchestra.run.gibba019.stdout:Package ceph-base-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:19:38.259 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-mds-2:17.0.0-9003.g44cd7c76.el8.x86_64 40/41 2021-11-18T10:19:38.271 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-mds-2:17.0.0-9003.g44cd7c76.el8.x86_64 40/41 2021-11-18T10:19:38.351 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:19:38.352 INFO:teuthology.orchestra.run.gibba019.stdout:Nothing to do. 2021-11-18T10:19:38.352 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:19:38.406 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-2:17.0.0-9003.g44cd7c76.el8.x86_64 41/41 2021-11-18T10:19:38.417 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install cephadm 2021-11-18T10:19:38.677 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-2:17.0.0-9003.g44cd7c76.el8.x86_64 41/41 2021-11-18T10:19:38.677 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/41 2021-11-18T10:19:38.677 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-mds-2:17.0.0-9003.g44cd7c76.el8.x86_64 2/41 2021-11-18T10:19:38.678 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-mgr-2:17.0.0-9003.g44cd7c76.el8.x86_64 3/41 2021-11-18T10:19:38.678 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-mon-2:17.0.0-9003.g44cd7c76.el8.x86_64 4/41 2021-11-18T10:19:38.678 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-osd-2:17.0.0-9003.g44cd7c76.el8.x86_64 5/41 2021-11-18T10:19:38.678 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-mgr-modules-core-2:17.0.0-9003.g44cd7c76.el8. 6/41 2021-11-18T10:19:38.679 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 7/41 2021-11-18T10:19:38.679 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-lxml-4.2.3-3.el8.x86_64 8/41 2021-11-18T10:19:38.679 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 9/41 2021-11-18T10:19:38.679 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 10/41 2021-11-18T10:19:38.679 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 11/41 2021-11-18T10:19:38.680 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 12/41 2021-11-18T10:19:38.680 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 13/41 2021-11-18T10:19:38.680 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 14/41 2021-11-18T10:19:38.680 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 15/41 2021-11-18T10:19:38.681 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 16/41 2021-11-18T10:19:38.681 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 17/41 2021-11-18T10:19:38.681 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-idna-2.5-5.el8.noarch 18/41 2021-11-18T10:19:38.681 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 19/41 2021-11-18T10:19:38.681 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 20/41 2021-11-18T10:19:38.682 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 21/41 2021-11-18T10:19:38.682 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-urllib3-1.24.2-5.el8.noarch 22/41 2021-11-18T10:19:38.682 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 23/41 2021-11-18T10:19:38.682 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 24/41 2021-11-18T10:19:38.683 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 25/41 2021-11-18T10:19:38.683 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 26/41 2021-11-18T10:19:38.683 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 27/41 2021-11-18T10:19:38.683 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 28/41 2021-11-18T10:19:38.685 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 29/41 2021-11-18T10:19:38.685 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 30/41 2021-11-18T10:19:38.685 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 31/41 2021-11-18T10:19:38.686 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 32/41 2021-11-18T10:19:38.686 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-portend-2.6-1.el8.noarch 33/41 2021-11-18T10:19:38.686 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 34/41 2021-11-18T10:19:38.686 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 35/41 2021-11-18T10:19:38.687 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 36/41 2021-11-18T10:19:38.687 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 37/41 2021-11-18T10:19:38.687 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 38/41 2021-11-18T10:19:38.687 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 39/41 2021-11-18T10:19:38.687 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 40/41 2021-11-18T10:19:38.754 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:00:58 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:39.410 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:19:39.411 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:39.411 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repository Size 2021-11-18T10:19:39.411 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:39.412 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:19:39.412 INFO:teuthology.orchestra.run.gibba019.stdout: cephadm noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 68 k 2021-11-18T10:19:39.412 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:39.412 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:19:39.413 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:39.413 INFO:teuthology.orchestra.run.gibba019.stdout:Install 1 Package 2021-11-18T10:19:39.413 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:39.413 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 68 k 2021-11-18T10:19:39.414 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 305 k 2021-11-18T10:19:39.414 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:19:39.563 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 41/41 2021-11-18T10:19:39.563 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:39.564 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:19:39.564 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:39.564 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mds-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:39.564 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:39.564 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-modules-core-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:19:39.565 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mon-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:39.565 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-osd-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:39.565 INFO:teuthology.orchestra.run.gibba005.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2021-11-18T10:19:39.565 INFO:teuthology.orchestra.run.gibba005.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2021-11-18T10:19:39.565 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cffi-1.11.5-5.el8.x86_64 2021-11-18T10:19:39.566 INFO:teuthology.orchestra.run.gibba005.stdout: python3-chardet-3.0.4-7.el8.noarch 2021-11-18T10:19:39.566 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cheroot-8.5.2-1.el8.noarch 2021-11-18T10:19:39.566 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2021-11-18T10:19:39.566 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2021-11-18T10:19:39.567 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cssselect-0.9.2-10.el8.noarch 2021-11-18T10:19:39.567 INFO:teuthology.orchestra.run.gibba005.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2021-11-18T10:19:39.567 INFO:teuthology.orchestra.run.gibba005.stdout: python3-idna-2.5-5.el8.noarch 2021-11-18T10:19:39.567 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jaraco-6.2-6.el8.noarch 2021-11-18T10:19:39.567 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2021-11-18T10:19:39.568 INFO:teuthology.orchestra.run.gibba005.stdout: python3-logutils-0.3.5-11.el8.noarch 2021-11-18T10:19:39.568 INFO:teuthology.orchestra.run.gibba005.stdout: python3-lxml-4.2.3-3.el8.x86_64 2021-11-18T10:19:39.568 INFO:teuthology.orchestra.run.gibba005.stdout: python3-mako-1.0.6-13.el8.noarch 2021-11-18T10:19:39.568 INFO:teuthology.orchestra.run.gibba005.stdout: python3-markupsafe-0.23-19.el8.x86_64 2021-11-18T10:19:39.569 INFO:teuthology.orchestra.run.gibba005.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2021-11-18T10:19:39.569 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pecan-1.3.2-9.el8.noarch 2021-11-18T10:19:39.569 INFO:teuthology.orchestra.run.gibba005.stdout: python3-portend-2.6-1.el8.noarch 2021-11-18T10:19:39.569 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2021-11-18T10:19:39.569 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pycparser-2.14-14.el8.noarch 2021-11-18T10:19:39.570 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pysocks-1.6.8-3.el8.noarch 2021-11-18T10:19:39.570 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pytz-2017.2-9.el8.noarch 2021-11-18T10:19:39.570 INFO:teuthology.orchestra.run.gibba005.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2021-11-18T10:19:39.570 INFO:teuthology.orchestra.run.gibba005.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2021-11-18T10:19:39.571 INFO:teuthology.orchestra.run.gibba005.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2021-11-18T10:19:39.571 INFO:teuthology.orchestra.run.gibba005.stdout: python3-tempora-1.14.1-5.el8.noarch 2021-11-18T10:19:39.571 INFO:teuthology.orchestra.run.gibba005.stdout: python3-trustme-0.6.0-4.el8.noarch 2021-11-18T10:19:39.571 INFO:teuthology.orchestra.run.gibba005.stdout: python3-urllib3-1.24.2-5.el8.noarch 2021-11-18T10:19:39.571 INFO:teuthology.orchestra.run.gibba005.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2021-11-18T10:19:39.572 INFO:teuthology.orchestra.run.gibba005.stdout: python3-webencodings-0.5.1-6.el8.noarch 2021-11-18T10:19:39.572 INFO:teuthology.orchestra.run.gibba005.stdout: python3-webob-1.8.5-1.el8.1.noarch 2021-11-18T10:19:39.572 INFO:teuthology.orchestra.run.gibba005.stdout: python3-webtest-2.0.33-1.el8.noarch 2021-11-18T10:19:39.572 INFO:teuthology.orchestra.run.gibba005.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2021-11-18T10:19:39.573 INFO:teuthology.orchestra.run.gibba005.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2021-11-18T10:19:39.573 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:39.573 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:19:39.773 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph-base 2021-11-18T10:19:40.011 INFO:teuthology.orchestra.run.gibba019.stdout:cephadm-17.0.0-9003.g44cd7c76.el8.noarch.rpm 114 kB/s | 68 kB 00:00 2021-11-18T10:19:40.012 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:40.013 INFO:teuthology.orchestra.run.gibba019.stdout:Total 113 kB/s | 68 kB 00:00 2021-11-18T10:19:40.013 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:19:40.018 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:19:40.019 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:19:40.020 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:19:40.022 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:19:40.108 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:00 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:40.147 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:19:40.588 INFO:teuthology.orchestra.run.gibba005.stdout:Package ceph-base-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:19:40.767 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:19:40.768 INFO:teuthology.orchestra.run.gibba005.stdout:Nothing to do. 2021-11-18T10:19:40.769 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:19:40.813 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install cephadm 2021-11-18T10:19:41.144 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:01 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:41.825 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:19:41.825 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:41.825 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repository Size 2021-11-18T10:19:41.826 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:41.826 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:19:41.826 INFO:teuthology.orchestra.run.gibba005.stdout: cephadm noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 68 k 2021-11-18T10:19:41.826 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:41.827 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:19:41.827 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:41.827 INFO:teuthology.orchestra.run.gibba005.stdout:Install 1 Package 2021-11-18T10:19:41.827 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:41.828 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 68 k 2021-11-18T10:19:41.828 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 305 k 2021-11-18T10:19:41.828 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:19:42.057 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:19:42.358 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:19:42.375 INFO:teuthology.orchestra.run.gibba005.stdout:cephadm-17.0.0-9003.g44cd7c76.el8.noarch.rpm 124 kB/s | 68 kB 00:00 2021-11-18T10:19:42.376 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:42.376 INFO:teuthology.orchestra.run.gibba005.stdout:Total 124 kB/s | 68 kB 00:00 2021-11-18T10:19:42.377 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:19:42.382 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:19:42.382 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:19:42.383 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:19:42.386 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:19:42.428 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:19:42.484 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:19:42.748 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:19:42.749 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:42.749 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:19:42.749 INFO:teuthology.orchestra.run.gibba019.stdout: cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:19:42.749 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:42.750 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:19:42.921 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph-immutable-object-cache 2021-11-18T10:19:43.259 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:03 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:43.928 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:19:43.929 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:43.929 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repo Size 2021-11-18T10:19:43.929 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:43.929 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:19:43.930 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 169 k 2021-11-18T10:19:43.930 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:43.930 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:19:43.930 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:43.931 INFO:teuthology.orchestra.run.gibba019.stdout:Install 1 Package 2021-11-18T10:19:43.931 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:43.931 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 169 k 2021-11-18T10:19:43.931 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 567 k 2021-11-18T10:19:43.931 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:19:44.366 INFO:teuthology.orchestra.run.gibba019.stdout:ceph-immutable-object-cache-17.0.0-9003.g44cd7c 386 kB/s | 169 kB 00:00 2021-11-18T10:19:44.367 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:44.367 INFO:teuthology.orchestra.run.gibba019.stdout:Total 385 kB/s | 169 kB 00:00 2021-11-18T10:19:44.368 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:19:44.377 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:19:44.377 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:19:44.411 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:19:44.413 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:19:44.492 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:19:44.502 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:19:44.691 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-9003.g44cd7c76. 1/1 2021-11-18T10:19:44.747 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:19:44.870 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:19:44.965 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-9003.g44cd7c76. 1/1 2021-11-18T10:19:45.081 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:19:45.081 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:45.081 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:19:45.082 INFO:teuthology.orchestra.run.gibba005.stdout: cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:19:45.082 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:45.082 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:19:45.224 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-9003.g44cd7c76. 1/1 2021-11-18T10:19:45.224 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:45.224 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:19:45.224 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-immutable-object-cache-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:45.225 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:45.225 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:19:45.234 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph-immutable-object-cache 2021-11-18T10:19:45.365 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph-mgr 2021-11-18T10:19:45.574 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:05 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:45.697 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:05 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:46.217 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:19:46.219 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:46.219 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repo Size 2021-11-18T10:19:46.219 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:46.220 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:19:46.220 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-immutable-object-cache x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 169 k 2021-11-18T10:19:46.221 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:46.221 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:19:46.222 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:46.222 INFO:teuthology.orchestra.run.gibba005.stdout:Install 1 Package 2021-11-18T10:19:46.222 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:46.223 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 169 k 2021-11-18T10:19:46.223 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 567 k 2021-11-18T10:19:46.224 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:19:46.531 INFO:teuthology.orchestra.run.gibba005.stdout:ceph-immutable-object-cache-17.0.0-9003.g44cd7c 539 kB/s | 169 kB 00:00 2021-11-18T10:19:46.532 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:46.532 INFO:teuthology.orchestra.run.gibba005.stdout:Total 537 kB/s | 169 kB 00:00 2021-11-18T10:19:46.533 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:19:46.542 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:19:46.542 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:19:46.576 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:19:46.578 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:19:46.621 INFO:teuthology.orchestra.run.gibba019.stdout:Package ceph-mgr-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:19:46.709 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:19:46.799 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:19:46.800 INFO:teuthology.orchestra.run.gibba019.stdout:Nothing to do. 2021-11-18T10:19:46.800 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:19:46.909 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-immutable-object-cache-2:17.0.0-9003.g44cd7c76. 1/1 2021-11-18T10:19:47.063 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph-mgr-dashboard 2021-11-18T10:19:47.171 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.0.0-9003.g44cd7c76. 1/1 2021-11-18T10:19:47.401 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:07 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:47.430 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-immutable-object-cache-2:17.0.0-9003.g44cd7c76. 1/1 2021-11-18T10:19:47.431 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:47.431 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:19:47.431 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-immutable-object-cache-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:19:47.431 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:47.432 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:19:47.548 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph-mgr 2021-11-18T10:19:47.887 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:07 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:48.070 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:19:48.070 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:48.071 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repository Size 2021-11-18T10:19:48.071 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:48.071 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:19:48.071 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-dashboard noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 1.5 M 2021-11-18T10:19:48.071 INFO:teuthology.orchestra.run.gibba019.stdout:Installing dependencies: 2021-11-18T10:19:48.072 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-grafana-dashboards noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 23 k 2021-11-18T10:19:48.072 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-prometheus-alerts noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 15 k 2021-11-18T10:19:48.072 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-11-18T10:19:48.072 INFO:teuthology.orchestra.run.gibba019.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-11-18T10:19:48.073 INFO:teuthology.orchestra.run.gibba019.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-11-18T10:19:48.073 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:48.073 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:19:48.073 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:19:48.073 INFO:teuthology.orchestra.run.gibba019.stdout:Install 6 Packages 2021-11-18T10:19:48.074 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:48.074 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 1.8 M 2021-11-18T10:19:48.075 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 7.5 M 2021-11-18T10:19:48.075 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:19:48.371 INFO:teuthology.orchestra.run.gibba005.stdout:Package ceph-mgr-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:19:48.391 INFO:teuthology.orchestra.run.gibba019.stdout:(1/6): ceph-grafana-dashboards-17.0.0-9003.g44c 72 kB/s | 23 kB 00:00 2021-11-18T10:19:48.397 INFO:teuthology.orchestra.run.gibba019.stdout:(2/6): ceph-prometheus-alerts-17.0.0-9003.g44cd 45 kB/s | 15 kB 00:00 2021-11-18T10:19:48.422 INFO:teuthology.orchestra.run.gibba019.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 1.4 MB/s | 43 kB 00:00 2021-11-18T10:19:48.549 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:19:48.550 INFO:teuthology.orchestra.run.gibba005.stdout:Nothing to do. 2021-11-18T10:19:48.550 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:19:48.584 INFO:teuthology.orchestra.run.gibba019.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 181 kB/s | 34 kB 00:00 2021-11-18T10:19:48.597 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph-mgr-dashboard 2021-11-18T10:19:48.727 INFO:teuthology.orchestra.run.gibba019.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 645 kB/s | 196 kB 00:00 2021-11-18T10:19:48.931 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:08 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:49.243 INFO:teuthology.orchestra.run.gibba019.stdout:(6/6): ceph-mgr-dashboard-17.0.0-9003.g44cd7c76 1.3 MB/s | 1.5 MB 00:01 2021-11-18T10:19:49.244 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:49.245 INFO:teuthology.orchestra.run.gibba019.stdout:Total 1.6 MB/s | 1.8 MB 00:01 2021-11-18T10:19:49.246 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:19:49.252 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:19:49.252 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:19:49.300 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:19:49.302 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:19:49.556 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:19:49.587 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:19:49.587 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:49.588 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repository Size 2021-11-18T10:19:49.588 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:49.588 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:19:49.588 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-dashboard noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 1.5 M 2021-11-18T10:19:49.588 INFO:teuthology.orchestra.run.gibba005.stdout:Installing dependencies: 2021-11-18T10:19:49.589 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-grafana-dashboards noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 23 k 2021-11-18T10:19:49.589 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-prometheus-alerts noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 15 k 2021-11-18T10:19:49.589 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jwt noarch 1.6.1-2.el8 CentOS-Base 43 k 2021-11-18T10:19:49.589 INFO:teuthology.orchestra.run.gibba005.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2021-11-18T10:19:49.590 INFO:teuthology.orchestra.run.gibba005.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2021-11-18T10:19:49.590 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:49.590 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:19:49.590 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:19:49.591 INFO:teuthology.orchestra.run.gibba005.stdout:Install 6 Packages 2021-11-18T10:19:49.591 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:49.591 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 1.8 M 2021-11-18T10:19:49.592 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 7.5 M 2021-11-18T10:19:49.592 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:19:49.815 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-11-18T10:19:49.865 INFO:teuthology.orchestra.run.gibba005.stdout:(1/6): ceph-grafana-dashboards-17.0.0-9003.g44c 84 kB/s | 23 kB 00:00 2021-11-18T10:19:49.935 INFO:teuthology.orchestra.run.gibba005.stdout:(2/6): ceph-prometheus-alerts-17.0.0-9003.g44cd 42 kB/s | 15 kB 00:00 2021-11-18T10:19:49.977 INFO:teuthology.orchestra.run.gibba005.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 382 kB/s | 43 kB 00:00 2021-11-18T10:19:50.054 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-11-18T10:19:50.157 INFO:teuthology.orchestra.run.gibba005.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 152 kB/s | 34 kB 00:00 2021-11-18T10:19:50.251 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-11-18T10:19:50.272 INFO:teuthology.orchestra.run.gibba005.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 666 kB/s | 196 kB 00:00 2021-11-18T10:19:50.421 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-9003.g44cd7c76.el8.n 4/6 2021-11-18T10:19:50.623 INFO:teuthology.orchestra.run.gibba005.stdout:(6/6): ceph-mgr-dashboard-17.0.0-9003.g44cd7c76 1.5 MB/s | 1.5 MB 00:01 2021-11-18T10:19:50.625 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:50.626 INFO:teuthology.orchestra.run.gibba005.stdout:Total 1.8 MB/s | 1.8 MB 00:01 2021-11-18T10:19:50.628 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:19:50.634 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:19:50.634 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:19:50.750 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:19:50.752 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:19:50.773 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-9003.g44cd7c76.el8. 5/6 2021-11-18T10:19:50.996 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-9003.g44cd7c76.el8.noarc 6/6 2021-11-18T10:19:51.004 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:19:51.192 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-9003.g44cd7c76.el8.noarc 6/6 2021-11-18T10:19:51.192 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-9003.g44cd7c76.el8. 1/6 2021-11-18T10:19:51.193 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-9003.g44cd7c76.el8.noarc 2/6 2021-11-18T10:19:51.193 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-9003.g44cd7c76.el8.n 3/6 2021-11-18T10:19:51.193 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-11-18T10:19:51.193 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-11-18T10:19:51.258 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2021-11-18T10:19:51.415 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-11-18T10:19:51.415 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:51.415 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:19:51.415 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-grafana-dashboards-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:19:51.416 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-dashboard-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:19:51.416 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-prometheus-alerts-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:19:51.416 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-11-18T10:19:51.416 INFO:teuthology.orchestra.run.gibba019.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-11-18T10:19:51.417 INFO:teuthology.orchestra.run.gibba019.stdout: python3-routes-2.4.1-12.el8.noarch 2021-11-18T10:19:51.417 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:51.417 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:19:51.489 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2021-11-18T10:19:51.496 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph-mgr-diskprediction-local 2021-11-18T10:19:51.694 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2021-11-18T10:19:51.831 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:11 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:51.873 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-prometheus-alerts-2:17.0.0-9003.g44cd7c76.el8.n 4/6 2021-11-18T10:19:52.175 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-grafana-dashboards-2:17.0.0-9003.g44cd7c76.el8. 5/6 2021-11-18T10:19:52.368 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-mgr-dashboard-2:17.0.0-9003.g44cd7c76.el8.noarc 6/6 2021-11-18T10:19:52.457 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:19:52.458 INFO:teuthology.orchestra.run.gibba019.stdout:===================================================================================================== 2021-11-18T10:19:52.458 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repository Size 2021-11-18T10:19:52.459 INFO:teuthology.orchestra.run.gibba019.stdout:===================================================================================================== 2021-11-18T10:19:52.459 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:19:52.459 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 7.4 M 2021-11-18T10:19:52.459 INFO:teuthology.orchestra.run.gibba019.stdout:Upgrading: 2021-11-18T10:19:52.460 INFO:teuthology.orchestra.run.gibba019.stdout: chkconfig x86_64 1.19.1-1.el8 CentOS-Base 198 k 2021-11-18T10:19:52.460 INFO:teuthology.orchestra.run.gibba019.stdout:Installing dependencies: 2021-11-18T10:19:52.460 INFO:teuthology.orchestra.run.gibba019.stdout: libgfortran x86_64 8.5.0-4.el8_5 CentOS-Base 643 k 2021-11-18T10:19:52.460 INFO:teuthology.orchestra.run.gibba019.stdout: libquadmath x86_64 8.5.0-4.el8_5 CentOS-Base 170 k 2021-11-18T10:19:52.461 INFO:teuthology.orchestra.run.gibba019.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2021-11-18T10:19:52.461 INFO:teuthology.orchestra.run.gibba019.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2021-11-18T10:19:52.461 INFO:teuthology.orchestra.run.gibba019.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2021-11-18T10:19:52.461 INFO:teuthology.orchestra.run.gibba019.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2021-11-18T10:19:52.461 INFO:teuthology.orchestra.run.gibba019.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2021-11-18T10:19:52.462 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:52.462 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:19:52.462 INFO:teuthology.orchestra.run.gibba019.stdout:===================================================================================================== 2021-11-18T10:19:52.462 INFO:teuthology.orchestra.run.gibba019.stdout:Install 8 Packages 2021-11-18T10:19:52.463 INFO:teuthology.orchestra.run.gibba019.stdout:Upgrade 1 Package 2021-11-18T10:19:52.463 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:19:52.463 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 35 M 2021-11-18T10:19:52.464 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:19:52.533 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.0.0-9003.g44cd7c76.el8.noarc 6/6 2021-11-18T10:19:52.533 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-grafana-dashboards-2:17.0.0-9003.g44cd7c76.el8. 1/6 2021-11-18T10:19:52.533 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-mgr-dashboard-2:17.0.0-9003.g44cd7c76.el8.noarc 2/6 2021-11-18T10:19:52.534 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-prometheus-alerts-2:17.0.0-9003.g44cd7c76.el8.n 3/6 2021-11-18T10:19:52.534 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2021-11-18T10:19:52.534 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2021-11-18T10:19:52.548 INFO:teuthology.orchestra.run.gibba019.stdout:(1/9): openblas-0.3.12-1.el8.x86_64.rpm 52 MB/s | 4.6 MB 00:00 2021-11-18T10:19:52.590 INFO:teuthology.orchestra.run.gibba019.stdout:(2/9): python3-numpy-1.14.3-10.el8.x86_64.rpm 90 MB/s | 3.7 MB 00:00 2021-11-18T10:19:52.594 INFO:teuthology.orchestra.run.gibba019.stdout:(3/9): python3-numpy-f2py-1.14.3-10.el8.x86_64. 66 MB/s | 225 kB 00:00 2021-11-18T10:19:52.772 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2021-11-18T10:19:52.773 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:52.773 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:19:52.773 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-grafana-dashboards-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:19:52.774 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-dashboard-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:19:52.774 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-prometheus-alerts-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:19:52.774 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jwt-1.6.1-2.el8.noarch 2021-11-18T10:19:52.774 INFO:teuthology.orchestra.run.gibba005.stdout: python3-repoze-lru-0.7-6.el8.noarch 2021-11-18T10:19:52.775 INFO:teuthology.orchestra.run.gibba005.stdout: python3-routes-2.4.1-12.el8.noarch 2021-11-18T10:19:52.775 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:52.775 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:19:52.804 INFO:teuthology.orchestra.run.gibba019.stdout:(4/9): python3-scipy-1.0.0-21.module_el8.5.0+77 65 MB/s | 14 MB 00:00 2021-11-18T10:19:52.812 INFO:teuthology.orchestra.run.gibba019.stdout:(5/9): libgfortran-8.5.0-4.el8_5.x86_64.rpm 79 MB/s | 643 kB 00:00 2021-11-18T10:19:52.815 INFO:teuthology.orchestra.run.gibba019.stdout:(6/9): libquadmath-8.5.0-4.el8_5.x86_64.rpm 61 MB/s | 170 kB 00:00 2021-11-18T10:19:52.818 INFO:teuthology.orchestra.run.gibba019.stdout:(7/9): chkconfig-1.19.1-1.el8.x86_64.rpm 66 MB/s | 198 kB 00:00 2021-11-18T10:19:52.845 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph-mgr-diskprediction-local 2021-11-18T10:19:53.069 INFO:teuthology.orchestra.run.gibba019.stdout:(8/9): openblas-threads-0.3.12-1.el8.x86_64.rpm 7.8 MB/s | 4.7 MB 00:00 2021-11-18T10:19:53.184 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:13 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:19:53.825 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:19:53.825 INFO:teuthology.orchestra.run.gibba005.stdout:===================================================================================================== 2021-11-18T10:19:53.826 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repository Size 2021-11-18T10:19:53.826 INFO:teuthology.orchestra.run.gibba005.stdout:===================================================================================================== 2021-11-18T10:19:53.826 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:19:53.826 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-diskprediction-local noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 7.4 M 2021-11-18T10:19:53.827 INFO:teuthology.orchestra.run.gibba005.stdout:Upgrading: 2021-11-18T10:19:53.827 INFO:teuthology.orchestra.run.gibba005.stdout: chkconfig x86_64 1.19.1-1.el8 CentOS-Base 198 k 2021-11-18T10:19:53.827 INFO:teuthology.orchestra.run.gibba005.stdout:Installing dependencies: 2021-11-18T10:19:53.827 INFO:teuthology.orchestra.run.gibba005.stdout: libgfortran x86_64 8.5.0-4.el8_5 CentOS-Base 643 k 2021-11-18T10:19:53.828 INFO:teuthology.orchestra.run.gibba005.stdout: libquadmath x86_64 8.5.0-4.el8_5 CentOS-Base 170 k 2021-11-18T10:19:53.828 INFO:teuthology.orchestra.run.gibba005.stdout: openblas x86_64 0.3.12-1.el8 CentOS-AppStream 4.6 M 2021-11-18T10:19:53.828 INFO:teuthology.orchestra.run.gibba005.stdout: openblas-threads x86_64 0.3.12-1.el8 CentOS-AppStream 4.7 M 2021-11-18T10:19:53.829 INFO:teuthology.orchestra.run.gibba005.stdout: python3-numpy x86_64 1:1.14.3-10.el8 CentOS-AppStream 3.7 M 2021-11-18T10:19:53.829 INFO:teuthology.orchestra.run.gibba005.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 CentOS-AppStream 225 k 2021-11-18T10:19:53.829 INFO:teuthology.orchestra.run.gibba005.stdout: python3-scipy x86_64 1.0.0-21.module_el8.5.0+771+e5d9a225 CentOS-AppStream 14 M 2021-11-18T10:19:53.830 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:53.830 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:19:53.830 INFO:teuthology.orchestra.run.gibba005.stdout:===================================================================================================== 2021-11-18T10:19:53.830 INFO:teuthology.orchestra.run.gibba005.stdout:Install 8 Packages 2021-11-18T10:19:53.831 INFO:teuthology.orchestra.run.gibba005.stdout:Upgrade 1 Package 2021-11-18T10:19:53.831 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:19:53.832 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 35 M 2021-11-18T10:19:53.832 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:19:54.083 INFO:teuthology.orchestra.run.gibba019.stdout:(9/9): ceph-mgr-diskprediction-local-17.0.0-900 4.6 MB/s | 7.4 MB 00:01 2021-11-18T10:19:54.085 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:54.085 INFO:teuthology.orchestra.run.gibba019.stdout:Total 22 MB/s | 35 MB 00:01 2021-11-18T10:19:54.096 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:19:54.119 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:19:54.119 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:19:54.351 INFO:teuthology.orchestra.run.gibba005.stdout:(1/9): openblas-0.3.12-1.el8.x86_64.rpm 8.8 MB/s | 4.6 MB 00:00 2021-11-18T10:19:54.393 INFO:teuthology.orchestra.run.gibba005.stdout:(2/9): python3-numpy-1.14.3-10.el8.x86_64.rpm 90 MB/s | 3.7 MB 00:00 2021-11-18T10:19:54.397 INFO:teuthology.orchestra.run.gibba005.stdout:(3/9): python3-numpy-f2py-1.14.3-10.el8.x86_64. 66 MB/s | 225 kB 00:00 2021-11-18T10:19:54.538 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:19:54.540 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:19:54.636 INFO:teuthology.orchestra.run.gibba005.stdout:(4/9): python3-scipy-1.0.0-21.module_el8.5.0+77 57 MB/s | 14 MB 00:00 2021-11-18T10:19:54.647 INFO:teuthology.orchestra.run.gibba005.stdout:(5/9): libgfortran-8.5.0-4.el8_5.x86_64.rpm 54 MB/s | 643 kB 00:00 2021-11-18T10:19:54.652 INFO:teuthology.orchestra.run.gibba005.stdout:(6/9): libquadmath-8.5.0-4.el8_5.x86_64.rpm 38 MB/s | 170 kB 00:00 2021-11-18T10:19:54.658 INFO:teuthology.orchestra.run.gibba005.stdout:(7/9): chkconfig-1.19.1-1.el8.x86_64.rpm 34 MB/s | 198 kB 00:00 2021-11-18T10:19:54.667 INFO:teuthology.orchestra.run.gibba005.stdout:(8/9): openblas-threads-0.3.12-1.el8.x86_64.rpm 5.6 MB/s | 4.7 MB 00:00 2021-11-18T10:19:55.078 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:19:55.201 INFO:teuthology.orchestra.run.gibba005.stdout:(9/9): ceph-mgr-diskprediction-local-17.0.0-900 5.4 MB/s | 7.4 MB 00:01 2021-11-18T10:19:55.202 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:19:55.202 INFO:teuthology.orchestra.run.gibba005.stdout:Total 26 MB/s | 35 MB 00:01 2021-11-18T10:19:55.214 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:19:55.236 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:19:55.236 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:19:55.266 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : libquadmath-8.5.0-4.el8_5.x86_64 1/10 2021-11-18T10:19:55.380 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: libquadmath-8.5.0-4.el8_5.x86_64 1/10 2021-11-18T10:19:55.582 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : libgfortran-8.5.0-4.el8_5.x86_64 2/10 2021-11-18T10:19:55.618 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:19:55.620 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:19:56.003 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: libgfortran-8.5.0-4.el8_5.x86_64 2/10 2021-11-18T10:19:56.166 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : openblas-0.3.12-1.el8.x86_64 3/10 2021-11-18T10:19:56.191 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:19:56.629 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 3/10 2021-11-18T10:19:56.808 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 4/10 2021-11-18T10:19:56.842 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : libquadmath-8.5.0-4.el8_5.x86_64 1/10 2021-11-18T10:19:56.950 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: libquadmath-8.5.0-4.el8_5.x86_64 1/10 2021-11-18T10:19:57.125 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : libgfortran-8.5.0-4.el8_5.x86_64 2/10 2021-11-18T10:19:57.335 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 4/10 2021-11-18T10:19:57.568 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: libgfortran-8.5.0-4.el8_5.x86_64 2/10 2021-11-18T10:19:57.734 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : openblas-0.3.12-1.el8.x86_64 3/10 2021-11-18T10:19:58.165 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 3/10 2021-11-18T10:19:58.204 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/10 2021-11-18T10:19:58.350 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 4/10 2021-11-18T10:19:58.520 INFO:teuthology.orchestra.run.gibba019.stdout: Upgrading : chkconfig-1.19.1-1.el8.x86_64 6/10 2021-11-18T10:19:58.741 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 7/10 2021-11-18T10:19:58.897 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 4/10 2021-11-18T10:19:59.452 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/10 2021-11-18T10:19:59.755 INFO:teuthology.orchestra.run.gibba005.stdout: Upgrading : chkconfig-1.19.1-1.el8.x86_64 6/10 2021-11-18T10:19:59.967 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 7/10 2021-11-18T10:20:00.139 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 7/10 2021-11-18T10:20:01.111 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225 8/10 2021-11-18T10:20:01.341 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-9003.g44cd7 9/10 2021-11-18T10:20:01.343 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 7/10 2021-11-18T10:20:01.360 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-9003.g44cd7 9/10 2021-11-18T10:20:01.505 INFO:teuthology.orchestra.run.gibba019.stdout: Cleanup : chkconfig-1.13-2.el8.x86_64 10/10 2021-11-18T10:20:01.795 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: chkconfig-1.13-2.el8.x86_64 10/10 2021-11-18T10:20:01.795 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-9003.g44cd7 1/10 2021-11-18T10:20:01.796 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 2/10 2021-11-18T10:20:01.796 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 3/10 2021-11-18T10:20:01.796 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/10 2021-11-18T10:20:01.796 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/10 2021-11-18T10:20:01.797 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225 6/10 2021-11-18T10:20:01.797 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : libgfortran-8.5.0-4.el8_5.x86_64 7/10 2021-11-18T10:20:01.797 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : libquadmath-8.5.0-4.el8_5.x86_64 8/10 2021-11-18T10:20:01.797 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : chkconfig-1.19.1-1.el8.x86_64 9/10 2021-11-18T10:20:02.140 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : chkconfig-1.13-2.el8.x86_64 10/10 2021-11-18T10:20:02.141 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:02.141 INFO:teuthology.orchestra.run.gibba019.stdout:Upgraded: 2021-11-18T10:20:02.142 INFO:teuthology.orchestra.run.gibba019.stdout: chkconfig-1.19.1-1.el8.x86_64 2021-11-18T10:20:02.142 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:02.142 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:20:02.143 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-diskprediction-local-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:20:02.143 INFO:teuthology.orchestra.run.gibba019.stdout: libgfortran-8.5.0-4.el8_5.x86_64 2021-11-18T10:20:02.143 INFO:teuthology.orchestra.run.gibba019.stdout: libquadmath-8.5.0-4.el8_5.x86_64 2021-11-18T10:20:02.144 INFO:teuthology.orchestra.run.gibba019.stdout: openblas-0.3.12-1.el8.x86_64 2021-11-18T10:20:02.144 INFO:teuthology.orchestra.run.gibba019.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-11-18T10:20:02.145 INFO:teuthology.orchestra.run.gibba019.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2021-11-18T10:20:02.145 INFO:teuthology.orchestra.run.gibba019.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2021-11-18T10:20:02.146 INFO:teuthology.orchestra.run.gibba019.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2021-11-18T10:20:02.146 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:02.146 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:02.270 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225 8/10 2021-11-18T10:20:02.376 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph-mgr-rook 2021-11-18T10:20:02.719 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:22 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:02.992 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-mgr-diskprediction-local-2:17.0.0-9003.g44cd7 9/10 2021-11-18T10:20:03.008 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.0.0-9003.g44cd7 9/10 2021-11-18T10:20:03.164 INFO:teuthology.orchestra.run.gibba005.stdout: Cleanup : chkconfig-1.13-2.el8.x86_64 10/10 2021-11-18T10:20:03.380 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:03.381 INFO:teuthology.orchestra.run.gibba019.stdout:======================================================================================== 2021-11-18T10:20:03.381 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repository Size 2021-11-18T10:20:03.382 INFO:teuthology.orchestra.run.gibba019.stdout:======================================================================================== 2021-11-18T10:20:03.382 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:20:03.382 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-rook noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 47 k 2021-11-18T10:20:03.382 INFO:teuthology.orchestra.run.gibba019.stdout:Installing dependencies: 2021-11-18T10:20:03.383 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-11-18T10:20:03.383 INFO:teuthology.orchestra.run.gibba019.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-11-18T10:20:03.383 INFO:teuthology.orchestra.run.gibba019.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-11-18T10:20:03.383 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-11-18T10:20:03.384 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-11-18T10:20:03.384 INFO:teuthology.orchestra.run.gibba019.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-11-18T10:20:03.384 INFO:teuthology.orchestra.run.gibba019.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-11-18T10:20:03.384 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-11-18T10:20:03.384 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-11-18T10:20:03.385 INFO:teuthology.orchestra.run.gibba019.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-11-18T10:20:03.385 INFO:teuthology.orchestra.run.gibba019.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-11-18T10:20:03.385 INFO:teuthology.orchestra.run.gibba019.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-11-18T10:20:03.385 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:03.385 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:20:03.386 INFO:teuthology.orchestra.run.gibba019.stdout:======================================================================================== 2021-11-18T10:20:03.386 INFO:teuthology.orchestra.run.gibba019.stdout:Install 13 Packages 2021-11-18T10:20:03.386 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:03.387 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 1.9 M 2021-11-18T10:20:03.387 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 25 M 2021-11-18T10:20:03.388 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:20:03.417 INFO:teuthology.orchestra.run.gibba019.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 798 kB/s | 27 kB 00:00 2021-11-18T10:20:03.418 INFO:teuthology.orchestra.run.gibba019.stdout:(2/13): python3-jsonpointer-1.10-11.el8.noarch. 597 kB/s | 20 kB 00:00 2021-11-18T10:20:03.423 INFO:teuthology.orchestra.run.gibba019.stdout:(3/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 21 MB/s | 126 kB 00:00 2021-11-18T10:20:03.423 INFO:teuthology.orchestra.run.gibba019.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 17 MB/s | 110 kB 00:00 2021-11-18T10:20:03.425 INFO:teuthology.orchestra.run.gibba019.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 25 MB/s | 43 kB 00:00 2021-11-18T10:20:03.426 INFO:teuthology.orchestra.run.gibba019.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 54 MB/s | 155 kB 00:00 2021-11-18T10:20:03.492 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: chkconfig-1.13-2.el8.x86_64 10/10 2021-11-18T10:20:03.493 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.0.0-9003.g44cd7 1/10 2021-11-18T10:20:03.493 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 2/10 2021-11-18T10:20:03.493 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 3/10 2021-11-18T10:20:03.493 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/10 2021-11-18T10:20:03.494 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/10 2021-11-18T10:20:03.494 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225 6/10 2021-11-18T10:20:03.494 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : libgfortran-8.5.0-4.el8_5.x86_64 7/10 2021-11-18T10:20:03.494 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : libquadmath-8.5.0-4.el8_5.x86_64 8/10 2021-11-18T10:20:03.495 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : chkconfig-1.19.1-1.el8.x86_64 9/10 2021-11-18T10:20:03.549 INFO:teuthology.orchestra.run.gibba019.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 266 kB/s | 33 kB 00:00 2021-11-18T10:20:03.592 INFO:teuthology.orchestra.run.gibba019.stdout:(8/13): ceph-mgr-rook-17.0.0-9003.g44cd7c76.el8 225 kB/s | 47 kB 00:00 2021-11-18T10:20:03.603 INFO:teuthology.orchestra.run.gibba019.stdout:(9/13): python3-google-auth-1.1.1-10.el8.noarch 1.5 MB/s | 81 kB 00:00 2021-11-18T10:20:03.631 INFO:teuthology.orchestra.run.gibba019.stdout:(10/13): python3-rsa-4.7.2-1.el8.noarch.rpm 2.2 MB/s | 61 kB 00:00 2021-11-18T10:20:03.659 INFO:teuthology.orchestra.run.gibba019.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 2.2 MB/s | 61 kB 00:00 2021-11-18T10:20:03.849 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : chkconfig-1.13-2.el8.x86_64 10/10 2021-11-18T10:20:03.849 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:03.850 INFO:teuthology.orchestra.run.gibba005.stdout:Upgraded: 2021-11-18T10:20:03.850 INFO:teuthology.orchestra.run.gibba005.stdout: chkconfig-1.19.1-1.el8.x86_64 2021-11-18T10:20:03.850 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:03.850 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:20:03.851 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-diskprediction-local-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:20:03.851 INFO:teuthology.orchestra.run.gibba005.stdout: libgfortran-8.5.0-4.el8_5.x86_64 2021-11-18T10:20:03.851 INFO:teuthology.orchestra.run.gibba005.stdout: libquadmath-8.5.0-4.el8_5.x86_64 2021-11-18T10:20:03.851 INFO:teuthology.orchestra.run.gibba005.stdout: openblas-0.3.12-1.el8.x86_64 2021-11-18T10:20:03.851 INFO:teuthology.orchestra.run.gibba005.stdout: openblas-threads-0.3.12-1.el8.x86_64 2021-11-18T10:20:03.852 INFO:teuthology.orchestra.run.gibba005.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2021-11-18T10:20:03.852 INFO:teuthology.orchestra.run.gibba005.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2021-11-18T10:20:03.852 INFO:teuthology.orchestra.run.gibba005.stdout: python3-scipy-1.0.0-21.module_el8.5.0+771+e5d9a225.x86_64 2021-11-18T10:20:03.852 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:03.853 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:03.905 INFO:teuthology.orchestra.run.gibba019.stdout:(12/13): python3-certifi-2018.10.15-7.el8.noarc 34 kB/s | 16 kB 00:00 2021-11-18T10:20:03.998 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph-mgr-rook 2021-11-18T10:20:04.328 INFO:teuthology.orchestra.run.gibba019.stdout:(13/13): python3-kubernetes-11.0.0-6.el8.noarch 1.6 MB/s | 1.2 MB 00:00 2021-11-18T10:20:04.329 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:04.330 INFO:teuthology.orchestra.run.gibba019.stdout:Total 2.0 MB/s | 1.9 MB 00:00 2021-11-18T10:20:04.331 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:24 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:04.336 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:20:04.347 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:20:04.347 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:20:04.400 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:20:04.402 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:20:04.877 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:20:04.984 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:04.985 INFO:teuthology.orchestra.run.gibba005.stdout:======================================================================================== 2021-11-18T10:20:04.985 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repository Size 2021-11-18T10:20:04.986 INFO:teuthology.orchestra.run.gibba005.stdout:======================================================================================== 2021-11-18T10:20:04.986 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:20:04.986 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-rook noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 47 k 2021-11-18T10:20:04.986 INFO:teuthology.orchestra.run.gibba005.stdout:Installing dependencies: 2021-11-18T10:20:04.987 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2021-11-18T10:20:04.987 INFO:teuthology.orchestra.run.gibba005.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2021-11-18T10:20:04.987 INFO:teuthology.orchestra.run.gibba005.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2021-11-18T10:20:04.987 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jsonpatch noarch 1.21-2.el8 CentOS-AppStream 27 k 2021-11-18T10:20:04.988 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jsonpointer noarch 1.10-11.el8 CentOS-AppStream 20 k 2021-11-18T10:20:04.988 INFO:teuthology.orchestra.run.gibba005.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2021-11-18T10:20:04.988 INFO:teuthology.orchestra.run.gibba005.stdout: python3-oauthlib noarch 2.1.0-1.el8 CentOS-Base 155 k 2021-11-18T10:20:04.988 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pyasn1 noarch 0.3.7-6.el8 CentOS-AppStream 126 k 2021-11-18T10:20:04.988 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 CentOS-AppStream 110 k 2021-11-18T10:20:04.989 INFO:teuthology.orchestra.run.gibba005.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 CentOS-Base 43 k 2021-11-18T10:20:04.989 INFO:teuthology.orchestra.run.gibba005.stdout: python3-rsa noarch 4.7.2-1.el8 epel 61 k 2021-11-18T10:20:04.989 INFO:teuthology.orchestra.run.gibba005.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2021-11-18T10:20:04.989 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:04.990 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:20:04.990 INFO:teuthology.orchestra.run.gibba005.stdout:======================================================================================== 2021-11-18T10:20:04.990 INFO:teuthology.orchestra.run.gibba005.stdout:Install 13 Packages 2021-11-18T10:20:04.990 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:04.991 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 1.9 M 2021-11-18T10:20:04.991 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 25 M 2021-11-18T10:20:04.992 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:20:05.034 INFO:teuthology.orchestra.run.gibba005.stdout:(1/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 568 kB/s | 27 kB 00:00 2021-11-18T10:20:05.037 INFO:teuthology.orchestra.run.gibba005.stdout:(2/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 46 MB/s | 126 kB 00:00 2021-11-18T10:20:05.037 INFO:teuthology.orchestra.run.gibba005.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 400 kB/s | 20 kB 00:00 2021-11-18T10:20:05.039 INFO:teuthology.orchestra.run.gibba005.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 45 MB/s | 110 kB 00:00 2021-11-18T10:20:05.041 INFO:teuthology.orchestra.run.gibba005.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 32 MB/s | 43 kB 00:00 2021-11-18T10:20:05.041 INFO:teuthology.orchestra.run.gibba005.stdout:(6/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 37 MB/s | 155 kB 00:00 2021-11-18T10:20:05.093 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-11-18T10:20:05.165 INFO:teuthology.orchestra.run.gibba005.stdout:(7/13): python3-cachetools-3.1.1-4.el8.noarch.r 267 kB/s | 33 kB 00:00 2021-11-18T10:20:05.166 INFO:teuthology.orchestra.run.gibba005.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 131 kB/s | 16 kB 00:00 2021-11-18T10:20:05.202 INFO:teuthology.orchestra.run.gibba005.stdout:(9/13): ceph-mgr-rook-17.0.0-9003.g44cd7c76.el8 219 kB/s | 47 kB 00:00 2021-11-18T10:20:05.219 INFO:teuthology.orchestra.run.gibba005.stdout:(10/13): python3-google-auth-1.1.1-10.el8.noarc 1.5 MB/s | 81 kB 00:00 2021-11-18T10:20:05.247 INFO:teuthology.orchestra.run.gibba005.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 2.1 MB/s | 61 kB 00:00 2021-11-18T10:20:05.310 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-11-18T10:20:05.363 INFO:teuthology.orchestra.run.gibba005.stdout:(12/13): python3-kubernetes-11.0.0-6.el8.noarch 5.9 MB/s | 1.2 MB 00:00 2021-11-18T10:20:05.453 INFO:teuthology.orchestra.run.gibba005.stdout:(13/13): python3-rsa-4.7.2-1.el8.noarch.rpm 244 kB/s | 61 kB 00:00 2021-11-18T10:20:05.455 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:05.455 INFO:teuthology.orchestra.run.gibba005.stdout:Total 4.1 MB/s | 1.9 MB 00:00 2021-11-18T10:20:05.462 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:20:05.472 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:20:05.472 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:20:05.525 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:20:05.527 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:20:05.550 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 3/13 2021-11-18T10:20:05.795 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-11-18T10:20:05.984 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-11-18T10:20:05.989 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:20:06.177 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2021-11-18T10:20:06.224 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-11-18T10:20:06.336 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2021-11-18T10:20:06.509 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-11-18T10:20:06.563 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-rsa-4.7.2-1.el8.noarch 3/13 2021-11-18T10:20:06.714 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-11-18T10:20:06.781 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2021-11-18T10:20:06.952 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2021-11-18T10:20:07.185 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2021-11-18T10:20:07.437 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2021-11-18T10:20:07.560 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-11-18T10:20:07.666 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2021-11-18T10:20:07.796 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-11-18T10:20:08.004 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-11-18T10:20:08.237 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-11-18T10:20:08.486 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2021-11-18T10:20:08.989 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-mgr-rook-2:17.0.0-9003.g44cd7c76.el8.noarch 13/13 2021-11-18T10:20:09.374 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-9003.g44cd7c76.el8.noarch 13/13 2021-11-18T10:20:09.375 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-mgr-rook-2:17.0.0-9003.g44cd7c76.el8.noarch 1/13 2021-11-18T10:20:09.375 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-11-18T10:20:09.375 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-11-18T10:20:09.375 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-11-18T10:20:09.375 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-11-18T10:20:09.376 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-11-18T10:20:09.376 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-11-18T10:20:09.376 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-11-18T10:20:09.376 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-11-18T10:20:09.377 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-11-18T10:20:09.377 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-11-18T10:20:09.377 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 12/13 2021-11-18T10:20:09.414 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2021-11-18T10:20:09.639 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2021-11-18T10:20:09.682 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-11-18T10:20:09.682 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:09.682 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:20:09.683 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-rook-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:20:09.683 INFO:teuthology.orchestra.run.gibba019.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-11-18T10:20:09.683 INFO:teuthology.orchestra.run.gibba019.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-11-18T10:20:09.683 INFO:teuthology.orchestra.run.gibba019.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-11-18T10:20:09.684 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-11-18T10:20:09.684 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-11-18T10:20:09.684 INFO:teuthology.orchestra.run.gibba019.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-11-18T10:20:09.684 INFO:teuthology.orchestra.run.gibba019.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-11-18T10:20:09.685 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-11-18T10:20:09.685 INFO:teuthology.orchestra.run.gibba019.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-11-18T10:20:09.685 INFO:teuthology.orchestra.run.gibba019.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-11-18T10:20:09.685 INFO:teuthology.orchestra.run.gibba019.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-11-18T10:20:09.685 INFO:teuthology.orchestra.run.gibba019.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-11-18T10:20:09.686 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:09.686 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:09.791 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph-mgr-cephadm 2021-11-18T10:20:09.880 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2021-11-18T10:20:10.092 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-mgr-rook-2:17.0.0-9003.g44cd7c76.el8.noarch 13/13 2021-11-18T10:20:10.122 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:30 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:10.265 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-mgr-rook-2:17.0.0-9003.g44cd7c76.el8.noarch 13/13 2021-11-18T10:20:10.265 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-mgr-rook-2:17.0.0-9003.g44cd7c76.el8.noarch 1/13 2021-11-18T10:20:10.265 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2021-11-18T10:20:10.266 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2021-11-18T10:20:10.266 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2021-11-18T10:20:10.266 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2021-11-18T10:20:10.266 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2021-11-18T10:20:10.267 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2021-11-18T10:20:10.267 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2021-11-18T10:20:10.267 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2021-11-18T10:20:10.267 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2021-11-18T10:20:10.268 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2021-11-18T10:20:10.268 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-rsa-4.7.2-1.el8.noarch 12/13 2021-11-18T10:20:10.540 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2021-11-18T10:20:10.540 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:10.540 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:20:10.541 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-rook-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:20:10.541 INFO:teuthology.orchestra.run.gibba005.stdout: python3-cachetools-3.1.1-4.el8.noarch 2021-11-18T10:20:10.541 INFO:teuthology.orchestra.run.gibba005.stdout: python3-certifi-2018.10.15-7.el8.noarch 2021-11-18T10:20:10.541 INFO:teuthology.orchestra.run.gibba005.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2021-11-18T10:20:10.541 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jsonpatch-1.21-2.el8.noarch 2021-11-18T10:20:10.542 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jsonpointer-1.10-11.el8.noarch 2021-11-18T10:20:10.542 INFO:teuthology.orchestra.run.gibba005.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2021-11-18T10:20:10.542 INFO:teuthology.orchestra.run.gibba005.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2021-11-18T10:20:10.542 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2021-11-18T10:20:10.543 INFO:teuthology.orchestra.run.gibba005.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2021-11-18T10:20:10.543 INFO:teuthology.orchestra.run.gibba005.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2021-11-18T10:20:10.543 INFO:teuthology.orchestra.run.gibba005.stdout: python3-rsa-4.7.2-1.el8.noarch 2021-11-18T10:20:10.543 INFO:teuthology.orchestra.run.gibba005.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2021-11-18T10:20:10.543 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:10.544 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:10.640 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph-mgr-cephadm 2021-11-18T10:20:10.793 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:10.794 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:10.794 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repository Size 2021-11-18T10:20:10.794 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:10.795 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:20:10.795 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-cephadm noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 100 k 2021-11-18T10:20:10.795 INFO:teuthology.orchestra.run.gibba019.stdout:Installing dependencies: 2021-11-18T10:20:10.795 INFO:teuthology.orchestra.run.gibba019.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2021-11-18T10:20:10.796 INFO:teuthology.orchestra.run.gibba019.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2021-11-18T10:20:10.796 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2021-11-18T10:20:10.796 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:10.796 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:20:10.796 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:10.797 INFO:teuthology.orchestra.run.gibba019.stdout:Install 4 Packages 2021-11-18T10:20:10.797 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:10.797 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 5.9 M 2021-11-18T10:20:10.797 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 25 M 2021-11-18T10:20:10.798 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:20:10.848 INFO:teuthology.orchestra.run.gibba019.stdout:(1/4): python3-jinja2-2.10.1-3.el8.noarch.rpm 9.9 MB/s | 538 kB 00:00 2021-11-18T10:20:10.895 INFO:teuthology.orchestra.run.gibba019.stdout:(2/4): python3-babel-2.5.1-7.el8.noarch.rpm 48 MB/s | 4.8 MB 00:00 2021-11-18T10:20:10.978 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:30 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:11.037 INFO:teuthology.orchestra.run.gibba019.stdout:(3/4): ceph-mgr-cephadm-17.0.0-9003.g44cd7c76.e 413 kB/s | 100 kB 00:00 2021-11-18T10:20:11.202 INFO:teuthology.orchestra.run.gibba019.stdout:(4/4): python3-asyncssh-2.7.0-2.el8.noarch.rpm 1.3 MB/s | 476 kB 00:00 2021-11-18T10:20:11.204 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:11.204 INFO:teuthology.orchestra.run.gibba019.stdout:Total 14 MB/s | 5.9 MB 00:00 2021-11-18T10:20:11.208 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:20:11.215 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:20:11.215 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:20:11.274 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:20:11.276 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:20:11.567 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:20:11.626 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:11.627 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:11.627 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repository Size 2021-11-18T10:20:11.628 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:11.628 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:20:11.628 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-cephadm noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 100 k 2021-11-18T10:20:11.628 INFO:teuthology.orchestra.run.gibba005.stdout:Installing dependencies: 2021-11-18T10:20:11.629 INFO:teuthology.orchestra.run.gibba005.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2021-11-18T10:20:11.629 INFO:teuthology.orchestra.run.gibba005.stdout: python3-babel noarch 2.5.1-7.el8 CentOS-AppStream 4.8 M 2021-11-18T10:20:11.629 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jinja2 noarch 2.10.1-3.el8 CentOS-AppStream 538 k 2021-11-18T10:20:11.629 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:11.629 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:20:11.630 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:11.630 INFO:teuthology.orchestra.run.gibba005.stdout:Install 4 Packages 2021-11-18T10:20:11.630 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:11.630 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 5.9 M 2021-11-18T10:20:11.631 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 25 M 2021-11-18T10:20:11.631 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:20:11.668 INFO:teuthology.orchestra.run.gibba005.stdout:(1/4): python3-jinja2-2.10.1-3.el8.noarch.rpm 13 MB/s | 538 kB 00:00 2021-11-18T10:20:11.717 INFO:teuthology.orchestra.run.gibba005.stdout:(2/4): python3-babel-2.5.1-7.el8.noarch.rpm 54 MB/s | 4.8 MB 00:00 2021-11-18T10:20:11.863 INFO:teuthology.orchestra.run.gibba005.stdout:(3/4): python3-asyncssh-2.7.0-2.el8.noarch.rpm 2.4 MB/s | 476 kB 00:00 2021-11-18T10:20:11.870 INFO:teuthology.orchestra.run.gibba005.stdout:(4/4): ceph-mgr-cephadm-17.0.0-9003.g44cd7c76.e 411 kB/s | 100 kB 00:00 2021-11-18T10:20:11.872 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:11.872 INFO:teuthology.orchestra.run.gibba005.stdout:Total 24 MB/s | 5.9 MB 00:00 2021-11-18T10:20:11.875 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:20:11.882 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:20:11.883 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:20:11.940 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:20:11.943 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:20:12.213 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:20:12.387 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 1/4 2021-11-18T10:20:12.717 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 2/4 2021-11-18T10:20:12.961 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 1/4 2021-11-18T10:20:12.984 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 3/4 2021-11-18T10:20:13.199 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 4/4 2021-11-18T10:20:13.253 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 2/4 2021-11-18T10:20:13.379 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 4/4 2021-11-18T10:20:13.380 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 1/4 2021-11-18T10:20:13.380 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/4 2021-11-18T10:20:13.380 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/4 2021-11-18T10:20:13.468 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 3/4 2021-11-18T10:20:13.598 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/4 2021-11-18T10:20:13.598 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:13.598 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:20:13.599 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-mgr-cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:20:13.599 INFO:teuthology.orchestra.run.gibba019.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2021-11-18T10:20:13.599 INFO:teuthology.orchestra.run.gibba019.stdout: python3-babel-2.5.1-7.el8.noarch 2021-11-18T10:20:13.599 INFO:teuthology.orchestra.run.gibba019.stdout: python3-jinja2-2.10.1-3.el8.noarch 2021-11-18T10:20:13.600 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:13.600 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:13.667 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-mgr-cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 4/4 2021-11-18T10:20:13.700 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph-fuse 2021-11-18T10:20:13.837 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 4/4 2021-11-18T10:20:13.837 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-mgr-cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 1/4 2021-11-18T10:20:13.838 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/4 2021-11-18T10:20:13.838 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 3/4 2021-11-18T10:20:14.040 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:34 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:14.064 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 4/4 2021-11-18T10:20:14.064 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:14.064 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:20:14.065 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-mgr-cephadm-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:20:14.065 INFO:teuthology.orchestra.run.gibba005.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2021-11-18T10:20:14.065 INFO:teuthology.orchestra.run.gibba005.stdout: python3-babel-2.5.1-7.el8.noarch 2021-11-18T10:20:14.065 INFO:teuthology.orchestra.run.gibba005.stdout: python3-jinja2-2.10.1-3.el8.noarch 2021-11-18T10:20:14.065 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:14.066 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:14.126 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph-fuse 2021-11-18T10:20:14.457 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:34 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:14.694 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:14.695 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:14.695 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repository Size 2021-11-18T10:20:14.696 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:14.696 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:20:14.696 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-fuse x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 871 k 2021-11-18T10:20:14.696 INFO:teuthology.orchestra.run.gibba019.stdout:Installing dependencies: 2021-11-18T10:20:14.697 INFO:teuthology.orchestra.run.gibba019.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-11-18T10:20:14.697 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:14.697 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:20:14.697 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:14.698 INFO:teuthology.orchestra.run.gibba019.stdout:Install 2 Packages 2021-11-18T10:20:14.698 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:14.698 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 954 k 2021-11-18T10:20:14.698 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 3.1 M 2021-11-18T10:20:14.698 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:20:14.772 INFO:teuthology.orchestra.run.gibba019.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 1.1 MB/s | 82 kB 00:00 2021-11-18T10:20:15.041 INFO:teuthology.orchestra.run.gibba019.stdout:(2/2): ceph-fuse-17.0.0-9003.g44cd7c76.el8.x86_ 2.5 MB/s | 871 kB 00:00 2021-11-18T10:20:15.043 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:15.043 INFO:teuthology.orchestra.run.gibba019.stdout:Total 2.7 MB/s | 954 kB 00:00 2021-11-18T10:20:15.045 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:20:15.061 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:20:15.061 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:20:15.101 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:15.102 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:15.102 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repository Size 2021-11-18T10:20:15.102 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:15.103 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:20:15.103 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-fuse x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 871 k 2021-11-18T10:20:15.103 INFO:teuthology.orchestra.run.gibba005.stdout:Installing dependencies: 2021-11-18T10:20:15.104 INFO:teuthology.orchestra.run.gibba005.stdout: fuse x86_64 2.9.7-12.el8 CentOS-Base 82 k 2021-11-18T10:20:15.104 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:15.104 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:20:15.104 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:15.104 INFO:teuthology.orchestra.run.gibba005.stdout:Install 2 Packages 2021-11-18T10:20:15.105 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:15.105 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 954 k 2021-11-18T10:20:15.106 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 3.1 M 2021-11-18T10:20:15.106 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:20:15.116 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:20:15.118 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:20:15.251 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:20:15.257 INFO:teuthology.orchestra.run.gibba005.stdout:(1/2): fuse-2.9.7-12.el8.x86_64.rpm 533 kB/s | 82 kB 00:00 2021-11-18T10:20:15.448 INFO:teuthology.orchestra.run.gibba005.stdout:(2/2): ceph-fuse-17.0.0-9003.g44cd7c76.el8.x86_ 2.5 MB/s | 871 kB 00:00 2021-11-18T10:20:15.449 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:15.450 INFO:teuthology.orchestra.run.gibba005.stdout:Total 2.7 MB/s | 954 kB 00:00 2021-11-18T10:20:15.451 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:20:15.468 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:20:15.468 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:20:15.508 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-11-18T10:20:15.522 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:20:15.524 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:20:15.656 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:20:15.705 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 2/2 2021-11-18T10:20:15.918 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : fuse-2.9.7-12.el8.x86_64 1/2 2021-11-18T10:20:15.971 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 2/2 2021-11-18T10:20:15.971 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/2 2021-11-18T10:20:16.115 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 2/2 2021-11-18T10:20:16.240 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-11-18T10:20:16.240 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:16.241 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:20:16.241 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-11-18T10:20:16.241 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:16.241 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:16.370 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 2/2 2021-11-18T10:20:16.370 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/2 2021-11-18T10:20:16.422 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install ceph-volume 2021-11-18T10:20:16.600 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 2/2 2021-11-18T10:20:16.601 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:16.601 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:20:16.601 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 fuse-2.9.7-12.el8.x86_64 2021-11-18T10:20:16.601 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:16.602 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:16.747 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install ceph-volume 2021-11-18T10:20:16.754 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:36 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:17.079 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:37 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:17.422 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:17.423 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:17.423 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repository Size 2021-11-18T10:20:17.423 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:17.424 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:20:17.424 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-volume noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 255 k 2021-11-18T10:20:17.424 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:17.424 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:20:17.425 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:17.425 INFO:teuthology.orchestra.run.gibba019.stdout:Install 1 Package 2021-11-18T10:20:17.425 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:17.425 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 255 k 2021-11-18T10:20:17.425 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 1.2 M 2021-11-18T10:20:17.426 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:20:17.717 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:17.719 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:17.719 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repository Size 2021-11-18T10:20:17.719 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:17.719 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:20:17.720 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-volume noarch 2:17.0.0-9003.g44cd7c76.el8 ceph-noarch 255 k 2021-11-18T10:20:17.720 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:17.720 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:20:17.720 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:17.720 INFO:teuthology.orchestra.run.gibba005.stdout:Install 1 Package 2021-11-18T10:20:17.721 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:17.721 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 255 k 2021-11-18T10:20:17.721 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 1.2 M 2021-11-18T10:20:17.721 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:20:17.913 INFO:teuthology.orchestra.run.gibba019.stdout:ceph-volume-17.0.0-9003.g44cd7c76.el8.noarch.rp 521 kB/s | 255 kB 00:00 2021-11-18T10:20:17.914 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:17.915 INFO:teuthology.orchestra.run.gibba019.stdout:Total 520 kB/s | 255 kB 00:00 2021-11-18T10:20:17.915 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:20:17.923 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:20:17.923 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:20:17.941 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:20:17.943 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:20:18.077 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:20:18.296 INFO:teuthology.orchestra.run.gibba005.stdout:ceph-volume-17.0.0-9003.g44cd7c76.el8.noarch.rp 443 kB/s | 255 kB 00:00 2021-11-18T10:20:18.297 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:18.297 INFO:teuthology.orchestra.run.gibba005.stdout:Total 442 kB/s | 255 kB 00:00 2021-11-18T10:20:18.297 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:20:18.305 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:20:18.305 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:20:18.326 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:20:18.328 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:20:18.358 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : ceph-volume-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:20:18.456 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:20:18.663 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: ceph-volume-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:20:18.726 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : ceph-volume-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:20:18.873 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : ceph-volume-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:20:18.874 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:18.874 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:20:18.874 INFO:teuthology.orchestra.run.gibba019.stdout: ceph-volume-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:20:18.875 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:18.875 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:18.984 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: ceph-volume-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:20:19.056 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install librados-devel 2021-11-18T10:20:19.223 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : ceph-volume-2:17.0.0-9003.g44cd7c76.el8.noarch 1/1 2021-11-18T10:20:19.223 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:19.224 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:20:19.224 INFO:teuthology.orchestra.run.gibba005.stdout: ceph-volume-2:17.0.0-9003.g44cd7c76.el8.noarch 2021-11-18T10:20:19.224 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:19.224 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:19.392 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:39 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:19.406 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install librados-devel 2021-11-18T10:20:19.746 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:39 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:20.044 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:20.045 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:20.046 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repo Size 2021-11-18T10:20:20.046 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:20.046 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:20:20.046 INFO:teuthology.orchestra.run.gibba019.stdout: librados-devel x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 125 k 2021-11-18T10:20:20.047 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:20.047 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:20:20.047 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:20.047 INFO:teuthology.orchestra.run.gibba019.stdout:Install 1 Package 2021-11-18T10:20:20.047 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:20.048 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 125 k 2021-11-18T10:20:20.048 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 432 k 2021-11-18T10:20:20.048 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:20:20.290 INFO:teuthology.orchestra.run.gibba019.stdout:librados-devel-17.0.0-9003.g44cd7c76.el8.x86_64 509 kB/s | 125 kB 00:00 2021-11-18T10:20:20.291 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:20.291 INFO:teuthology.orchestra.run.gibba019.stdout:Total 506 kB/s | 125 kB 00:00 2021-11-18T10:20:20.292 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:20:20.297 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:20:20.297 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:20:20.333 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:20:20.335 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:20:20.415 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:20.416 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:20.416 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repo Size 2021-11-18T10:20:20.416 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:20.417 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:20:20.417 INFO:teuthology.orchestra.run.gibba005.stdout: librados-devel x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 125 k 2021-11-18T10:20:20.417 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:20.417 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:20:20.418 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:20.418 INFO:teuthology.orchestra.run.gibba005.stdout:Install 1 Package 2021-11-18T10:20:20.418 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:20.418 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 125 k 2021-11-18T10:20:20.419 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 432 k 2021-11-18T10:20:20.419 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:20:20.426 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:20:20.654 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : librados-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:20.785 INFO:teuthology.orchestra.run.gibba005.stdout:librados-devel-17.0.0-9003.g44cd7c76.el8.x86_64 338 kB/s | 125 kB 00:00 2021-11-18T10:20:20.786 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:20.786 INFO:teuthology.orchestra.run.gibba005.stdout:Total 337 kB/s | 125 kB 00:00 2021-11-18T10:20:20.786 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:20:20.791 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:20:20.791 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:20:20.827 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:20:20.829 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:20:20.840 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: librados-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:20.957 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:20:21.037 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : librados-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:21.038 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:21.038 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:20:21.038 INFO:teuthology.orchestra.run.gibba019.stdout: librados-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:20:21.039 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:21.039 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:21.164 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : librados-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:21.173 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install libcephfs2 2021-11-18T10:20:21.368 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: librados-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:21.508 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:41 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:21.604 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : librados-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:21.604 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:21.604 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:20:21.604 INFO:teuthology.orchestra.run.gibba005.stdout: librados-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:20:21.605 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:21.605 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:21.726 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install libcephfs2 2021-11-18T10:20:22.006 INFO:teuthology.orchestra.run.gibba019.stdout:Package libcephfs2-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:22.145 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:42 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:22.190 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:22.190 INFO:teuthology.orchestra.run.gibba019.stdout:Nothing to do. 2021-11-18T10:20:22.191 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:22.242 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install libcephfs-devel 2021-11-18T10:20:22.538 INFO:teuthology.orchestra.run.gibba005.stdout:Package libcephfs2-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:22.574 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:42 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:22.718 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:22.720 INFO:teuthology.orchestra.run.gibba005.stdout:Nothing to do. 2021-11-18T10:20:22.720 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:22.763 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install libcephfs-devel 2021-11-18T10:20:23.097 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:43 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:23.218 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:23.219 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:23.219 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repo Size 2021-11-18T10:20:23.219 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:23.220 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:20:23.220 INFO:teuthology.orchestra.run.gibba019.stdout: libcephfs-devel x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 24 k 2021-11-18T10:20:23.220 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:23.220 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:20:23.221 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:23.221 INFO:teuthology.orchestra.run.gibba019.stdout:Install 1 Package 2021-11-18T10:20:23.221 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:23.221 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 24 k 2021-11-18T10:20:23.222 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 105 k 2021-11-18T10:20:23.222 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:20:23.413 INFO:teuthology.orchestra.run.gibba019.stdout:libcephfs-devel-17.0.0-9003.g44cd7c76.el8.x86_6 124 kB/s | 24 kB 00:00 2021-11-18T10:20:23.414 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:23.414 INFO:teuthology.orchestra.run.gibba019.stdout:Total 123 kB/s | 24 kB 00:00 2021-11-18T10:20:23.415 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:20:23.417 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:20:23.418 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:20:23.418 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:20:23.421 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:20:23.467 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:20:23.629 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : libcephfs-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:23.775 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:23.776 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:23.776 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repo Size 2021-11-18T10:20:23.777 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:23.777 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:20:23.777 INFO:teuthology.orchestra.run.gibba005.stdout: libcephfs-devel x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 24 k 2021-11-18T10:20:23.777 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:23.778 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:20:23.778 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:23.778 INFO:teuthology.orchestra.run.gibba005.stdout:Install 1 Package 2021-11-18T10:20:23.778 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:23.779 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 24 k 2021-11-18T10:20:23.779 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 105 k 2021-11-18T10:20:23.779 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:20:23.833 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:23.970 INFO:teuthology.orchestra.run.gibba005.stdout:libcephfs-devel-17.0.0-9003.g44cd7c76.el8.x86_6 124 kB/s | 24 kB 00:00 2021-11-18T10:20:23.971 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:23.971 INFO:teuthology.orchestra.run.gibba005.stdout:Total 123 kB/s | 24 kB 00:00 2021-11-18T10:20:23.972 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:20:23.975 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:20:23.975 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:20:23.976 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:20:23.978 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:20:23.998 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : libcephfs-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:23.998 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:23.999 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:20:23.999 INFO:teuthology.orchestra.run.gibba019.stdout: libcephfs-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:20:23.999 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:23.999 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:24.031 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:20:24.058 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install librados2 2021-11-18T10:20:24.197 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : libcephfs-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:24.363 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: libcephfs-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:24.395 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:44 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:24.547 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : libcephfs-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:24.547 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:24.547 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:20:24.547 INFO:teuthology.orchestra.run.gibba005.stdout: libcephfs-devel-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:20:24.548 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:24.548 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:24.604 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install librados2 2021-11-18T10:20:24.864 INFO:teuthology.orchestra.run.gibba019.stdout:Package librados2-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:24.943 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:44 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:25.047 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:25.047 INFO:teuthology.orchestra.run.gibba019.stdout:Nothing to do. 2021-11-18T10:20:25.048 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:25.101 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install librbd1 2021-11-18T10:20:25.404 INFO:teuthology.orchestra.run.gibba005.stdout:Package librados2-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:25.440 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:45 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:25.586 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:25.587 INFO:teuthology.orchestra.run.gibba005.stdout:Nothing to do. 2021-11-18T10:20:25.588 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:25.638 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install librbd1 2021-11-18T10:20:25.914 INFO:teuthology.orchestra.run.gibba019.stdout:Package librbd1-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:25.981 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:45 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:26.099 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:26.100 INFO:teuthology.orchestra.run.gibba019.stdout:Nothing to do. 2021-11-18T10:20:26.100 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:26.151 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install python3-rados 2021-11-18T10:20:26.438 INFO:teuthology.orchestra.run.gibba005.stdout:Package librbd1-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:26.486 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:46 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:26.620 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:26.621 INFO:teuthology.orchestra.run.gibba005.stdout:Nothing to do. 2021-11-18T10:20:26.621 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:26.671 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install python3-rados 2021-11-18T10:20:26.956 INFO:teuthology.orchestra.run.gibba019.stdout:Package python3-rados-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:27.006 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:47 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:27.135 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:27.135 INFO:teuthology.orchestra.run.gibba019.stdout:Nothing to do. 2021-11-18T10:20:27.136 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:27.192 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install python3-rgw 2021-11-18T10:20:27.471 INFO:teuthology.orchestra.run.gibba005.stdout:Package python3-rados-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:27.526 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:47 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:27.655 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:27.656 INFO:teuthology.orchestra.run.gibba005.stdout:Nothing to do. 2021-11-18T10:20:27.656 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:27.715 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install python3-rgw 2021-11-18T10:20:27.998 INFO:teuthology.orchestra.run.gibba019.stdout:Package python3-rgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:28.052 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:48 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:28.177 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:28.178 INFO:teuthology.orchestra.run.gibba019.stdout:Nothing to do. 2021-11-18T10:20:28.178 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:28.234 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install python3-cephfs 2021-11-18T10:20:28.521 INFO:teuthology.orchestra.run.gibba005.stdout:Package python3-rgw-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:28.573 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:48 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:28.699 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:28.700 INFO:teuthology.orchestra.run.gibba005.stdout:Nothing to do. 2021-11-18T10:20:28.700 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:28.746 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install python3-cephfs 2021-11-18T10:20:29.047 INFO:teuthology.orchestra.run.gibba019.stdout:Package python3-cephfs-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:29.080 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:49 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:29.225 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:29.226 INFO:teuthology.orchestra.run.gibba019.stdout:Nothing to do. 2021-11-18T10:20:29.226 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:29.276 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install python3-rbd 2021-11-18T10:20:29.546 INFO:teuthology.orchestra.run.gibba005.stdout:Package python3-cephfs-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:29.611 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:49 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:29.723 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:29.724 INFO:teuthology.orchestra.run.gibba005.stdout:Nothing to do. 2021-11-18T10:20:29.724 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:29.771 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install python3-rbd 2021-11-18T10:20:30.081 INFO:teuthology.orchestra.run.gibba019.stdout:Package python3-rbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:30.104 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:50 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:30.260 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:30.261 INFO:teuthology.orchestra.run.gibba019.stdout:Nothing to do. 2021-11-18T10:20:30.261 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:30.318 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install rbd-fuse 2021-11-18T10:20:30.650 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:50 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:30.804 INFO:teuthology.orchestra.run.gibba005.stdout:Package python3-rbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:30.988 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:30.988 INFO:teuthology.orchestra.run.gibba005.stdout:Nothing to do. 2021-11-18T10:20:30.989 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:31.188 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install rbd-fuse 2021-11-18T10:20:31.527 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:51 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:31.712 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:31.713 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:31.713 INFO:teuthology.orchestra.run.gibba019.stdout: Package Architecture Version Repository Size 2021-11-18T10:20:31.714 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:31.714 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:20:31.714 INFO:teuthology.orchestra.run.gibba019.stdout: rbd-fuse x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 94 k 2021-11-18T10:20:31.714 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:31.715 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:20:31.715 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:31.715 INFO:teuthology.orchestra.run.gibba019.stdout:Install 1 Package 2021-11-18T10:20:31.715 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:31.716 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 94 k 2021-11-18T10:20:31.716 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 281 k 2021-11-18T10:20:31.716 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:20:32.125 INFO:teuthology.orchestra.run.gibba019.stdout:rbd-fuse-17.0.0-9003.g44cd7c76.el8.x86_64.rpm 227 kB/s | 94 kB 00:00 2021-11-18T10:20:32.126 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:32.127 INFO:teuthology.orchestra.run.gibba019.stdout:Total 226 kB/s | 94 kB 00:00 2021-11-18T10:20:32.127 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:20:32.135 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:20:32.136 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:20:32.171 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:20:32.173 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:20:32.186 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:32.187 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:32.187 INFO:teuthology.orchestra.run.gibba005.stdout: Package Architecture Version Repository Size 2021-11-18T10:20:32.188 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:32.188 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:20:32.188 INFO:teuthology.orchestra.run.gibba005.stdout: rbd-fuse x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 94 k 2021-11-18T10:20:32.188 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:32.189 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:20:32.189 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:32.189 INFO:teuthology.orchestra.run.gibba005.stdout:Install 1 Package 2021-11-18T10:20:32.189 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:32.190 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 94 k 2021-11-18T10:20:32.190 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 281 k 2021-11-18T10:20:32.190 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:20:32.263 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:20:32.429 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : rbd-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:32.511 INFO:teuthology.orchestra.run.gibba005.stdout:rbd-fuse-17.0.0-9003.g44cd7c76.el8.x86_64.rpm 289 kB/s | 94 kB 00:00 2021-11-18T10:20:32.512 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:32.513 INFO:teuthology.orchestra.run.gibba005.stdout:Total 288 kB/s | 94 kB 00:00 2021-11-18T10:20:32.513 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:20:32.521 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:20:32.522 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:20:32.558 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:20:32.560 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:20:32.643 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: rbd-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:32.650 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:20:32.847 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : rbd-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:32.849 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : rbd-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:32.850 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:32.850 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:20:32.850 INFO:teuthology.orchestra.run.gibba019.stdout: rbd-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:20:32.850 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:32.851 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:33.031 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install rbd-mirror 2021-11-18T10:20:33.032 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: rbd-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:33.247 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : rbd-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:33.247 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:33.247 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:20:33.248 INFO:teuthology.orchestra.run.gibba005.stdout: rbd-fuse-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:20:33.248 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:33.248 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:33.354 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install rbd-mirror 2021-11-18T10:20:33.371 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:53 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:33.687 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:53 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:34.060 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:34.061 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:34.062 INFO:teuthology.orchestra.run.gibba019.stdout: Package Arch Version Repo Size 2021-11-18T10:20:34.062 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:34.062 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:20:34.062 INFO:teuthology.orchestra.run.gibba019.stdout: rbd-mirror x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 3.8 M 2021-11-18T10:20:34.063 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:34.063 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:20:34.063 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:34.063 INFO:teuthology.orchestra.run.gibba019.stdout:Install 1 Package 2021-11-18T10:20:34.063 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:34.064 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 3.8 M 2021-11-18T10:20:34.064 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 19 M 2021-11-18T10:20:34.064 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:20:34.332 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:34.333 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:34.333 INFO:teuthology.orchestra.run.gibba005.stdout: Package Arch Version Repo Size 2021-11-18T10:20:34.333 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:34.334 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:20:34.334 INFO:teuthology.orchestra.run.gibba005.stdout: rbd-mirror x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 3.8 M 2021-11-18T10:20:34.334 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:34.334 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:20:34.335 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:34.335 INFO:teuthology.orchestra.run.gibba005.stdout:Install 1 Package 2021-11-18T10:20:34.335 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:34.335 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 3.8 M 2021-11-18T10:20:34.336 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 19 M 2021-11-18T10:20:34.336 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:20:35.786 INFO:teuthology.orchestra.run.gibba019.stdout:rbd-mirror-17.0.0-9003.g44cd7c76.el8.x86_64.rpm 2.2 MB/s | 3.8 MB 00:01 2021-11-18T10:20:35.787 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:35.787 INFO:teuthology.orchestra.run.gibba019.stdout:Total 2.2 MB/s | 3.8 MB 00:01 2021-11-18T10:20:35.788 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:20:35.798 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:20:35.798 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:20:35.845 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:20:35.848 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:20:36.206 INFO:teuthology.orchestra.run.gibba005.stdout:rbd-mirror-17.0.0-9003.g44cd7c76.el8.x86_64.rpm 2.0 MB/s | 3.8 MB 00:01 2021-11-18T10:20:36.207 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:36.207 INFO:teuthology.orchestra.run.gibba005.stdout:Total 2.0 MB/s | 3.8 MB 00:01 2021-11-18T10:20:36.208 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:20:36.218 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:20:36.218 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:20:36.265 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:20:36.267 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:20:36.339 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:20:36.566 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : rbd-mirror-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:36.864 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: rbd-mirror-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:37.035 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:20:37.225 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : rbd-mirror-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:37.262 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : rbd-mirror-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:37.263 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:37.263 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:20:37.263 INFO:teuthology.orchestra.run.gibba019.stdout: rbd-mirror-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:20:37.263 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:37.264 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:37.491 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: rbd-mirror-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:37.686 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : rbd-mirror-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:37.687 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:37.687 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:20:37.687 INFO:teuthology.orchestra.run.gibba005.stdout: rbd-mirror-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:20:37.687 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:37.688 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:37.719 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install rbd-nbd 2021-11-18T10:20:37.833 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install rbd-nbd 2021-11-18T10:20:38.063 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:01:58 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:38.171 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:01:58 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:38.730 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:38.731 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:38.731 INFO:teuthology.orchestra.run.gibba019.stdout: Package Architecture Version Repository Size 2021-11-18T10:20:38.731 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:38.731 INFO:teuthology.orchestra.run.gibba019.stdout:Installing: 2021-11-18T10:20:38.732 INFO:teuthology.orchestra.run.gibba019.stdout: rbd-nbd x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 175 k 2021-11-18T10:20:38.732 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:38.732 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction Summary 2021-11-18T10:20:38.732 INFO:teuthology.orchestra.run.gibba019.stdout:================================================================================ 2021-11-18T10:20:38.733 INFO:teuthology.orchestra.run.gibba019.stdout:Install 1 Package 2021-11-18T10:20:38.733 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:38.733 INFO:teuthology.orchestra.run.gibba019.stdout:Total download size: 175 k 2021-11-18T10:20:38.733 INFO:teuthology.orchestra.run.gibba019.stdout:Installed size: 568 k 2021-11-18T10:20:38.733 INFO:teuthology.orchestra.run.gibba019.stdout:Downloading Packages: 2021-11-18T10:20:38.837 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:38.838 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:38.838 INFO:teuthology.orchestra.run.gibba005.stdout: Package Architecture Version Repository Size 2021-11-18T10:20:38.839 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:38.839 INFO:teuthology.orchestra.run.gibba005.stdout:Installing: 2021-11-18T10:20:38.839 INFO:teuthology.orchestra.run.gibba005.stdout: rbd-nbd x86_64 2:17.0.0-9003.g44cd7c76.el8 ceph 175 k 2021-11-18T10:20:38.839 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:38.840 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction Summary 2021-11-18T10:20:38.840 INFO:teuthology.orchestra.run.gibba005.stdout:================================================================================ 2021-11-18T10:20:38.840 INFO:teuthology.orchestra.run.gibba005.stdout:Install 1 Package 2021-11-18T10:20:38.840 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:38.841 INFO:teuthology.orchestra.run.gibba005.stdout:Total download size: 175 k 2021-11-18T10:20:38.841 INFO:teuthology.orchestra.run.gibba005.stdout:Installed size: 568 k 2021-11-18T10:20:38.841 INFO:teuthology.orchestra.run.gibba005.stdout:Downloading Packages: 2021-11-18T10:20:39.168 INFO:teuthology.orchestra.run.gibba019.stdout:rbd-nbd-17.0.0-9003.g44cd7c76.el8.x86_64.rpm 401 kB/s | 175 kB 00:00 2021-11-18T10:20:39.168 INFO:teuthology.orchestra.run.gibba019.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:39.169 INFO:teuthology.orchestra.run.gibba019.stdout:Total 399 kB/s | 175 kB 00:00 2021-11-18T10:20:39.169 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction check 2021-11-18T10:20:39.178 INFO:teuthology.orchestra.run.gibba005.stdout:rbd-nbd-17.0.0-9003.g44cd7c76.el8.x86_64.rpm 516 kB/s | 175 kB 00:00 2021-11-18T10:20:39.178 INFO:teuthology.orchestra.run.gibba005.stdout:-------------------------------------------------------------------------------- 2021-11-18T10:20:39.179 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction check succeeded. 2021-11-18T10:20:39.180 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction test 2021-11-18T10:20:39.180 INFO:teuthology.orchestra.run.gibba005.stdout:Total 514 kB/s | 175 kB 00:00 2021-11-18T10:20:39.180 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction check 2021-11-18T10:20:39.189 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction check succeeded. 2021-11-18T10:20:39.189 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction test 2021-11-18T10:20:39.215 INFO:teuthology.orchestra.run.gibba019.stdout:Transaction test succeeded. 2021-11-18T10:20:39.217 INFO:teuthology.orchestra.run.gibba019.stdout:Running transaction 2021-11-18T10:20:39.224 INFO:teuthology.orchestra.run.gibba005.stdout:Transaction test succeeded. 2021-11-18T10:20:39.227 INFO:teuthology.orchestra.run.gibba005.stdout:Running transaction 2021-11-18T10:20:39.305 INFO:teuthology.orchestra.run.gibba019.stdout: Preparing : 1/1 2021-11-18T10:20:39.319 INFO:teuthology.orchestra.run.gibba005.stdout: Preparing : 1/1 2021-11-18T10:20:39.504 INFO:teuthology.orchestra.run.gibba019.stdout: Installing : rbd-nbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:39.505 INFO:teuthology.orchestra.run.gibba005.stdout: Installing : rbd-nbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:39.680 INFO:teuthology.orchestra.run.gibba005.stdout: Running scriptlet: rbd-nbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:39.685 INFO:teuthology.orchestra.run.gibba019.stdout: Running scriptlet: rbd-nbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:39.897 INFO:teuthology.orchestra.run.gibba005.stdout: Verifying : rbd-nbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:39.897 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:39.897 INFO:teuthology.orchestra.run.gibba005.stdout:Installed: 2021-11-18T10:20:39.897 INFO:teuthology.orchestra.run.gibba005.stdout: rbd-nbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:20:39.898 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:39.898 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:39.916 INFO:teuthology.orchestra.run.gibba019.stdout: Verifying : rbd-nbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 1/1 2021-11-18T10:20:39.916 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:39.916 INFO:teuthology.orchestra.run.gibba019.stdout:Installed: 2021-11-18T10:20:39.917 INFO:teuthology.orchestra.run.gibba019.stdout: rbd-nbd-2:17.0.0-9003.g44cd7c76.el8.x86_64 2021-11-18T10:20:39.917 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:39.917 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:40.002 DEBUG:teuthology.orchestra.run.gibba005:> sudo yum -y install rbd-mirror 2021-11-18T10:20:40.016 DEBUG:teuthology.orchestra.run.gibba019:> sudo yum -y install rbd-mirror 2021-11-18T10:20:40.346 INFO:teuthology.orchestra.run.gibba005.stdout:Last metadata expiration check: 0:02:00 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:40.351 INFO:teuthology.orchestra.run.gibba019.stdout:Last metadata expiration check: 0:02:00 ago on Thu 18 Nov 2021 10:18:40 AM UTC. 2021-11-18T10:20:40.822 INFO:teuthology.orchestra.run.gibba019.stdout:Package rbd-mirror-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:40.846 INFO:teuthology.orchestra.run.gibba005.stdout:Package rbd-mirror-2:17.0.0-9003.g44cd7c76.el8.x86_64 is already installed. 2021-11-18T10:20:41.004 INFO:teuthology.orchestra.run.gibba019.stdout:Dependencies resolved. 2021-11-18T10:20:41.005 INFO:teuthology.orchestra.run.gibba019.stdout:Nothing to do. 2021-11-18T10:20:41.005 INFO:teuthology.orchestra.run.gibba019.stdout:Complete! 2021-11-18T10:20:41.027 INFO:teuthology.orchestra.run.gibba005.stdout:Dependencies resolved. 2021-11-18T10:20:41.028 INFO:teuthology.orchestra.run.gibba005.stdout:Nothing to do. 2021-11-18T10:20:41.028 INFO:teuthology.orchestra.run.gibba005.stdout:Complete! 2021-11-18T10:20:41.059 DEBUG:teuthology.parallel:result is None 2021-11-18T10:20:41.071 DEBUG:teuthology.parallel:result is None 2021-11-18T10:20:41.072 DEBUG:teuthology.orchestra.run.gibba005:> sudo lsb_release -is 2021-11-18T10:20:41.097 INFO:teuthology.orchestra.run.gibba005.stdout:CentOS 2021-11-18T10:20:41.099 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-18T10:20:41.100 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44cd7c7650ed2227d3597352b00bd2ef65f4388f 2021-11-18T10:20:41.315 DEBUG:teuthology.orchestra.run.gibba005:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-11-18T10:20:41.333 INFO:teuthology.orchestra.run.gibba005.stdout:17.0.0-9003.g44cd7c76.el8 2021-11-18T10:20:41.334 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-9003.g44cd7c76.el8 2021-11-18T10:20:41.334 INFO:teuthology.task.install:The correct ceph version 17.0.0-9003.g44cd7c76 is installed. 2021-11-18T10:20:41.335 DEBUG:teuthology.orchestra.run.gibba019:> sudo lsb_release -is 2021-11-18T10:20:41.362 INFO:teuthology.orchestra.run.gibba019.stdout:CentOS 2021-11-18T10:20:41.363 DEBUG:teuthology.misc:System to be installed: CentOS 2021-11-18T10:20:41.364 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=44cd7c7650ed2227d3597352b00bd2ef65f4388f 2021-11-18T10:20:41.569 DEBUG:teuthology.orchestra.run.gibba019:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2021-11-18T10:20:41.586 INFO:teuthology.orchestra.run.gibba019.stdout:17.0.0-9003.g44cd7c76.el8 2021-11-18T10:20:41.586 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-9003.g44cd7c76.el8 2021-11-18T10:20:41.586 INFO:teuthology.task.install:The correct ceph version 17.0.0-9003.g44cd7c76 is installed. 2021-11-18T10:20:41.587 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-11-18T10:20:41.587 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:41.588 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-18T10:20:41.608 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:41.608 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-11-18T10:20:41.646 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-11-18T10:20:41.647 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:41.647 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/usr/bin/daemon-helper 2021-11-18T10:20:41.667 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-18T10:20:41.725 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:41.726 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/usr/bin/daemon-helper 2021-11-18T10:20:41.745 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-11-18T10:20:41.805 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-11-18T10:20:41.805 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:41.806 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-18T10:20:41.825 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-18T10:20:41.884 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:41.885 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/usr/bin/adjust-ulimits 2021-11-18T10:20:41.904 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-11-18T10:20:41.962 INFO:teuthology.run_tasks:Running task ceph... 2021-11-18T10:20:42.025 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2021-11-18T10:20:42.025 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 777 /var/log/ceph 2021-11-18T10:20:42.029 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 777 /var/log/ceph 2021-11-18T10:20:42.047 INFO:tasks.ceph:Disabling ceph logrotate... 2021-11-18T10:20:42.048 DEBUG:teuthology.orchestra.run.gibba005:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-18T10:20:42.088 DEBUG:teuthology.orchestra.run.gibba019:> sudo rm -f -- /etc/logrotate.d/ceph 2021-11-18T10:20:42.108 INFO:tasks.ceph:Creating extra log directories... 2021-11-18T10:20:42.108 DEBUG:teuthology.orchestra.run.gibba005:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-18T10:20:42.148 DEBUG:teuthology.orchestra.run.gibba019:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2021-11-18T10:20:42.211 INFO:tasks.ceph:Creating ceph cluster cluster1... 2021-11-18T10:20:42.211 INFO:tasks.ceph:config {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'cluster1', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-11-18T10:20:42.212 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-11-15_02:01:02-rbd-master-distro-default-gibba/6503461', 'branch': 'master', 'description': 'rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6503461', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'gibba', 'meta': [{'desc': 'run two ceph clusters and install rbd-mirror'}, {'desc': 'configure the permissions for client.mirror'}, {'desc': '2 ceph clusters with 1 mon and 3 osds each'}, {'desc': 'run four rbd-mirror daemons per cluster'}, {'desc': 'run the rbd_mirror_stress.sh workunit to test the rbd-mirror daemon'}], 'name': 'teuthology-2021-11-15_02:01:02-rbd-master-distro-default-gibba', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'centos', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'master'}, 'ceph': {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'master', 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'], ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6']], 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f', 'sleep_before_teardown': 0, 'suite': 'rbd', 'suite_branch': 'master', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_44cd7c7650ed2227d3597352b00bd2ef65f4388f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f', 'targets': {'gibba005.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNiR1RqNqSftUOVGBiSU14AICZY8bEQYJD+zFAQmbYcV8dqVM2O6OspTmMlFXqme9oybYX6b0Wz1KYL5OAi+4QqU6kpiUhay1jAcoplneO95QnkpnEeC7SshfACme6Q7VPEQADdKMvB6i/ZAPbjG38FajSbX1+err7kFlcvaI5Cdi9zUuctG6PXGalivEgSCfZGrY69lLMUpbaxoKliQ7yCVOpvGYkpykzoMN06mCSdgE2dKEqrw438SmGD33T9qJPTk+5MLH1xYIFzbPlZLhQaNXqUDrKWeoHiJW4hLeBqLqddvSXA04+HmXb74b/lrObsmJ1czaZLIyeNQ7+2eBSm2Ddk1nUOk0ItK0XhC2iOxfZsXyCJ9EOJpXN3sB6NLBQSC0Vbq9R5LrC/OBhk4FTlgWwPpGIf+MVHIfDLu7Q5FO99lYiVHZC5BLu6fFtB/37zJXDZvQZn0d+6e2ergWNBOrukuFWyQ6WbHP5+S4UuloGC9DkzNI6PgbyY0vAyKU=', 'gibba019.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1zpyjLs/XrLyk2CdygXDeA7ImscLQ62Xf41IuMr15/X4ICxR0/juDU0y9kqXl8x3tqiGdswB0HyTDIZayyt97N2N7/6jru0nljN4SeKrZrHnoJVxB570CCGHmD99wSxkQLl6Ho6SI1jdlsycAuslQvsag1rcH1ti74mMe3Pmz7U/1XMHlpEVuTDfKzY3lUfnkBr5WJ0p4c39TSxHc+M+jMQsE39lsL3OOdfjZrnGVFeduc6WYvg7PeDv7PoKjZhe+TI7WnJHi5S/aX6ggQ3CTg8q/c3wgQkHa4kYQkVilNV42vkwjE0gES570IWj4iFG0hiDbb+CvHkQIzSnTRTE4VPDiCA7tq6pc+fQrNIcxQNAvbhjvwNFIQgOueNYeDb3awS787a8u4YEW5JYaglLhElANQOxOsBtKaDQVKVkRCPYYnyWv9ofsTrVG71nFlBMXgr5xooVGjMiveyQ7EzejNWauMuhYiQsboOqQD4BQYJ715hzcd29QgpFg53ohDgs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}}, {'ceph': {'cluster': 'cluster1', 'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}}, {'ceph': {'cluster': 'cluster2'}}, {'exec': {'cluster1.client.mirror.0': ["sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'"]}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.3', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.3', 'thrash': True}}, {'rbd-mirror-thrash': {'cluster': 'cluster1'}}, {'rbd-mirror-thrash': {'cluster': 'cluster2'}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_stress.sh']}, 'env': {'CEPH_ARGS': '', 'MIRROR_IMAGE_MODE': 'snapshot', 'MIRROR_POOL_MODE': 'image', 'RBD_IMAGE_FEATURES': 'layering,exclusive-lock', 'RBD_MIRROR_INSTANCES': '4', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1', 'RBD_MIRROR_USE_RBD_MIRROR': '1'}, 'timeout': '6h'}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'd4737010a85099043cf081dc05b4069d301b23fb', 'timestamp': '2021-11-15_02:01:02', 'tube': 'gibba', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.gibba.19943'} 2021-11-18T10:20:42.213 DEBUG:teuthology.orchestra.run.gibba005:> install -d -m0755 -- /home/ubuntu/cephtest/cluster1.data 2021-11-18T10:20:42.216 DEBUG:teuthology.orchestra.run.gibba019:> install -d -m0755 -- /home/ubuntu/cephtest/cluster1.data 2021-11-18T10:20:42.227 DEBUG:teuthology.orchestra.run.gibba005:> sudo install -d -m0777 -- /var/run/ceph 2021-11-18T10:20:42.268 DEBUG:teuthology.orchestra.run.gibba019:> sudo install -d -m0777 -- /var/run/ceph 2021-11-18T10:20:42.287 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:42.288 DEBUG:teuthology.orchestra.run.gibba005:> dd if=/scratch_devs of=/dev/stdout 2021-11-18T10:20:42.337 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-18T10:20:42.338 DEBUG:teuthology.orchestra.run.gibba005:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-18T10:20:42.389 INFO:teuthology.orchestra.run.gibba005.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-18T10:20:42.389 INFO:teuthology.orchestra.run.gibba005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-18T10:20:42.390 INFO:teuthology.orchestra.run.gibba005.stdout:Device: 6h/6d Inode: 114104 Links: 1 2021-11-18T10:20:42.390 INFO:teuthology.orchestra.run.gibba005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-18T10:20:42.390 INFO:teuthology.orchestra.run.gibba005.stdout:Context: system_u:object_r:device_t:s0 2021-11-18T10:20:42.390 INFO:teuthology.orchestra.run.gibba005.stdout:Access: 2021-11-18 10:20:37.353691766 +0000 2021-11-18T10:20:42.391 INFO:teuthology.orchestra.run.gibba005.stdout:Modify: 2021-11-18 10:17:52.415054439 +0000 2021-11-18T10:20:42.391 INFO:teuthology.orchestra.run.gibba005.stdout:Change: 2021-11-18 10:17:52.415054439 +0000 2021-11-18T10:20:42.391 INFO:teuthology.orchestra.run.gibba005.stdout: Birth: - 2021-11-18T10:20:42.397 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records in 2021-11-18T10:20:42.397 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records out 2021-11-18T10:20:42.398 INFO:teuthology.orchestra.run.gibba005.stderr:512 bytes copied, 0.000184981 s, 2.8 MB/s 2021-11-18T10:20:42.400 DEBUG:teuthology.orchestra.run.gibba005:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-18T10:20:42.452 INFO:teuthology.orchestra.run.gibba005.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-18T10:20:42.452 INFO:teuthology.orchestra.run.gibba005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-18T10:20:42.453 INFO:teuthology.orchestra.run.gibba005.stdout:Device: 6h/6d Inode: 121067 Links: 1 2021-11-18T10:20:42.453 INFO:teuthology.orchestra.run.gibba005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-18T10:20:42.453 INFO:teuthology.orchestra.run.gibba005.stdout:Context: system_u:object_r:device_t:s0 2021-11-18T10:20:42.453 INFO:teuthology.orchestra.run.gibba005.stdout:Access: 2021-11-18 10:20:37.353691766 +0000 2021-11-18T10:20:42.454 INFO:teuthology.orchestra.run.gibba005.stdout:Modify: 2021-11-18 10:17:52.724054806 +0000 2021-11-18T10:20:42.454 INFO:teuthology.orchestra.run.gibba005.stdout:Change: 2021-11-18 10:17:52.724054806 +0000 2021-11-18T10:20:42.454 INFO:teuthology.orchestra.run.gibba005.stdout: Birth: - 2021-11-18T10:20:42.459 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records in 2021-11-18T10:20:42.460 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records out 2021-11-18T10:20:42.461 INFO:teuthology.orchestra.run.gibba005.stderr:512 bytes copied, 0.000136671 s, 3.7 MB/s 2021-11-18T10:20:42.462 DEBUG:teuthology.orchestra.run.gibba005:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-18T10:20:42.514 INFO:teuthology.orchestra.run.gibba005.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-18T10:20:42.514 INFO:teuthology.orchestra.run.gibba005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-18T10:20:42.515 INFO:teuthology.orchestra.run.gibba005.stdout:Device: 6h/6d Inode: 120176 Links: 1 2021-11-18T10:20:42.515 INFO:teuthology.orchestra.run.gibba005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-18T10:20:42.515 INFO:teuthology.orchestra.run.gibba005.stdout:Context: system_u:object_r:device_t:s0 2021-11-18T10:20:42.515 INFO:teuthology.orchestra.run.gibba005.stdout:Access: 2021-11-18 10:20:37.353691766 +0000 2021-11-18T10:20:42.516 INFO:teuthology.orchestra.run.gibba005.stdout:Modify: 2021-11-18 10:17:53.016055154 +0000 2021-11-18T10:20:42.516 INFO:teuthology.orchestra.run.gibba005.stdout:Change: 2021-11-18 10:17:53.016055154 +0000 2021-11-18T10:20:42.516 INFO:teuthology.orchestra.run.gibba005.stdout: Birth: - 2021-11-18T10:20:42.521 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records in 2021-11-18T10:20:42.522 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records out 2021-11-18T10:20:42.522 INFO:teuthology.orchestra.run.gibba005.stderr:512 bytes copied, 0.000147567 s, 3.5 MB/s 2021-11-18T10:20:42.524 DEBUG:teuthology.orchestra.run.gibba005:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-18T10:20:42.576 INFO:teuthology.orchestra.run.gibba005.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-18T10:20:42.576 INFO:teuthology.orchestra.run.gibba005.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-18T10:20:42.577 INFO:teuthology.orchestra.run.gibba005.stdout:Device: 6h/6d Inode: 122073 Links: 1 2021-11-18T10:20:42.577 INFO:teuthology.orchestra.run.gibba005.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-18T10:20:42.577 INFO:teuthology.orchestra.run.gibba005.stdout:Context: system_u:object_r:device_t:s0 2021-11-18T10:20:42.577 INFO:teuthology.orchestra.run.gibba005.stdout:Access: 2021-11-18 10:20:37.353691766 +0000 2021-11-18T10:20:42.578 INFO:teuthology.orchestra.run.gibba005.stdout:Modify: 2021-11-18 10:17:53.325055522 +0000 2021-11-18T10:20:42.578 INFO:teuthology.orchestra.run.gibba005.stdout:Change: 2021-11-18 10:17:53.325055522 +0000 2021-11-18T10:20:42.578 INFO:teuthology.orchestra.run.gibba005.stdout: Birth: - 2021-11-18T10:20:42.583 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records in 2021-11-18T10:20:42.583 INFO:teuthology.orchestra.run.gibba005.stderr:1+0 records out 2021-11-18T10:20:42.584 INFO:teuthology.orchestra.run.gibba005.stderr:512 bytes copied, 0.000145594 s, 3.5 MB/s 2021-11-18T10:20:42.585 INFO:tasks.ceph:osd dev map: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-18T10:20:42.586 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba005.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-11-18T10:20:42.586 INFO:tasks.ceph:Generating config... 2021-11-18T10:20:42.588 INFO:tasks.ceph:[client] debug rbd = 20 2021-11-18T10:20:42.588 INFO:tasks.ceph:[client] debug rbd_mirror = 15 2021-11-18T10:20:42.589 INFO:tasks.ceph:[client] log to stderr = False 2021-11-18T10:20:42.589 INFO:tasks.ceph:[client] rbd default features = 125 2021-11-18T10:20:42.589 INFO:tasks.ceph:[client] rbd mirror image policy type = simple 2021-11-18T10:20:42.589 INFO:tasks.ceph:[client.mirror.0] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:42.590 INFO:tasks.ceph:[client.mirror.0] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:42.590 INFO:tasks.ceph:[client.mirror.1] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:42.590 INFO:tasks.ceph:[client.mirror.1] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:42.591 INFO:tasks.ceph:[client.mirror.2] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:42.591 INFO:tasks.ceph:[client.mirror.2] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:42.591 INFO:tasks.ceph:[client.mirror.3] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:42.592 INFO:tasks.ceph:[client.mirror.3] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:42.592 INFO:tasks.ceph:[global] mon client directed command retry = 5 2021-11-18T10:20:42.592 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2021-11-18T10:20:42.593 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-11-18T10:20:42.593 INFO:tasks.ceph:[mgr] debug ms = 1 2021-11-18T10:20:42.593 INFO:tasks.ceph:[mon] debug mon = 20 2021-11-18T10:20:42.594 INFO:tasks.ceph:[mon] debug ms = 1 2021-11-18T10:20:42.594 INFO:tasks.ceph:[mon] debug paxos = 20 2021-11-18T10:20:42.594 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2021-11-18T10:20:42.594 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2021-11-18T10:20:42.595 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-11-18T10:20:42.595 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-11-18T10:20:42.595 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2021-11-18T10:20:42.596 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2021-11-18T10:20:42.596 INFO:tasks.ceph:[osd] debug ms = 1 2021-11-18T10:20:42.596 INFO:tasks.ceph:[osd] debug osd = 20 2021-11-18T10:20:42.597 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2021-11-18T10:20:42.597 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-11-18T10:20:42.597 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-11-18T10:20:42.598 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-11-18T10:20:42.598 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-11-18T10:20:42.598 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-11-18T10:20:42.599 INFO:tasks.ceph:Setting up cluster1.mon.a... 2021-11-18T10:20:42.599 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/cluster1.keyring 2021-11-18T10:20:42.682 INFO:teuthology.orchestra.run.gibba005.stdout:creating /etc/ceph/cluster1.keyring 2021-11-18T10:20:42.684 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/cluster1.keyring 2021-11-18T10:20:42.714 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2021-11-18T10:20:42.775 DEBUG:tasks.ceph:Ceph mon addresses: [('cluster1.mon.a', '172.21.2.105')] 2021-11-18T10:20:42.776 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.2.105', 'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'mon.a': {}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}} 2021-11-18T10:20:42.777 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:42.778 DEBUG:teuthology.orchestra.run.gibba005:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-11-18T10:20:42.829 DEBUG:teuthology.orchestra.run.gibba005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.2.105 --print /home/ubuntu/cephtest/cluster1.monmap 2021-11-18T10:20:42.897 INFO:teuthology.orchestra.run.gibba005.stdout:monmaptool: monmap file /home/ubuntu/cephtest/cluster1.monmap 2021-11-18T10:20:42.897 INFO:teuthology.orchestra.run.gibba005.stdout:monmaptool: generated fsid a2c35310-9d46-4e5d-be3a-3b110bd4a7c0 2021-11-18T10:20:42.898 INFO:teuthology.orchestra.run.gibba005.stdout:setting min_mon_release = octopus 2021-11-18T10:20:42.898 INFO:teuthology.orchestra.run.gibba005.stdout:epoch 0 2021-11-18T10:20:42.899 INFO:teuthology.orchestra.run.gibba005.stdout:fsid a2c35310-9d46-4e5d-be3a-3b110bd4a7c0 2021-11-18T10:20:42.899 INFO:teuthology.orchestra.run.gibba005.stdout:last_changed 2021-11-18T10:20:42.899263+0000 2021-11-18T10:20:42.900 INFO:teuthology.orchestra.run.gibba005.stdout:created 2021-11-18T10:20:42.899263+0000 2021-11-18T10:20:42.900 INFO:teuthology.orchestra.run.gibba005.stdout:min_mon_release 15 (octopus) 2021-11-18T10:20:42.900 INFO:teuthology.orchestra.run.gibba005.stdout:election_strategy: 1 2021-11-18T10:20:42.901 INFO:teuthology.orchestra.run.gibba005.stdout:0: [v2:172.21.2.105:3300/0,v1:172.21.2.105:6789/0] mon.a 2021-11-18T10:20:42.901 INFO:teuthology.orchestra.run.gibba005.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/cluster1.monmap (1 monitors) 2021-11-18T10:20:42.904 DEBUG:teuthology.orchestra.run.gibba005:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-11-18T10:20:42.955 INFO:tasks.ceph:Writing /etc/ceph/cluster1.conf for FSID a2c35310-9d46-4e5d-be3a-3b110bd4a7c0... 2021-11-18T10:20:42.956 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster1.conf && sudo chmod 0644 /etc/ceph/cluster1.conf > /dev/null 2021-11-18T10:20:42.998 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster1.conf && sudo chmod 0644 /etc/ceph/cluster1.conf > /dev/null 2021-11-18T10:20:43.028 INFO:teuthology.orchestra.run.gibba005.stdout:[global] 2021-11-18T10:20:43.029 INFO:teuthology.orchestra.run.gibba005.stdout: chdir = "" 2021-11-18T10:20:43.029 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-18T10:20:43.029 INFO:teuthology.orchestra.run.gibba005.stdout: auth supported = cephx 2021-11-18T10:20:43.030 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.030 INFO:teuthology.orchestra.run.gibba005.stdout: filestore xattr use omap = true 2021-11-18T10:20:43.030 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.030 INFO:teuthology.orchestra.run.gibba005.stdout: mon clock drift allowed = 1.000 2021-11-18T10:20:43.031 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.031 INFO:teuthology.orchestra.run.gibba005.stdout: osd crush chooseleaf type = 0 2021-11-18T10:20:43.031 INFO:teuthology.orchestra.run.gibba005.stdout: auth debug = true 2021-11-18T10:20:43.031 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.032 INFO:teuthology.orchestra.run.gibba005.stdout: ms die on old message = true 2021-11-18T10:20:43.032 INFO:teuthology.orchestra.run.gibba005.stdout: ms die on bug = true 2021-11-18T10:20:43.032 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.032 INFO:teuthology.orchestra.run.gibba005.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-18T10:20:43.032 INFO:teuthology.orchestra.run.gibba005.stdout: mon pg warn max object skew = 0 2021-11-18T10:20:43.033 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.033 INFO:teuthology.orchestra.run.gibba005.stdout: # disable pg_autoscaler by default for new pools 2021-11-18T10:20:43.033 INFO:teuthology.orchestra.run.gibba005.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-18T10:20:43.033 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.034 INFO:teuthology.orchestra.run.gibba005.stdout: osd pool default size = 2 2021-11-18T10:20:43.034 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.034 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd allow primary affinity = true 2021-11-18T10:20:43.034 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd allow pg remap = true 2021-11-18T10:20:43.035 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on legacy crush tunables = false 2021-11-18T10:20:43.035 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on crush straw calc version zero = false 2021-11-18T10:20:43.035 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on no sortbitwise = false 2021-11-18T10:20:43.035 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on osd down out interval zero = false 2021-11-18T10:20:43.035 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on too few osds = false 2021-11-18T10:20:43.036 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-18T10:20:43.036 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-18T10:20:43.036 INFO:teuthology.orchestra.run.gibba005.stdout: mon_allow_pool_size_one = true 2021-11-18T10:20:43.036 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.037 INFO:teuthology.orchestra.run.gibba005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-11-18T10:20:43.037 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.037 INFO:teuthology.orchestra.run.gibba005.stdout: osd default data pool replay window = 5 2021-11-18T10:20:43.037 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.038 INFO:teuthology.orchestra.run.gibba005.stdout: mon allow pool delete = true 2021-11-18T10:20:43.038 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.038 INFO:teuthology.orchestra.run.gibba005.stdout: mon cluster log file level = debug 2021-11-18T10:20:43.038 INFO:teuthology.orchestra.run.gibba005.stdout: debug asserts on shutdown = true 2021-11-18T10:20:43.038 INFO:teuthology.orchestra.run.gibba005.stdout: mon health detail to clog = false 2021-11-18T10:20:43.039 INFO:teuthology.orchestra.run.gibba005.stdout: mon host = 172.21.2.105 2021-11-18T10:20:43.039 INFO:teuthology.orchestra.run.gibba005.stdout: mon client directed command retry = 5 2021-11-18T10:20:43.039 INFO:teuthology.orchestra.run.gibba005.stdout: ms inject socket failures = 5000 2021-11-18T10:20:43.039 INFO:teuthology.orchestra.run.gibba005.stdout: fsid = a2c35310-9d46-4e5d-be3a-3b110bd4a7c0 2021-11-18T10:20:43.040 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.040 INFO:teuthology.orchestra.run.gibba005.stdout:[osd] 2021-11-18T10:20:43.040 INFO:teuthology.orchestra.run.gibba005.stdout: osd journal size = 100 2021-11-18T10:20:43.040 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.041 INFO:teuthology.orchestra.run.gibba005.stdout: osd scrub load threshold = 5.0 2021-11-18T10:20:43.041 INFO:teuthology.orchestra.run.gibba005.stdout: osd scrub max interval = 600 2021-11-18T10:20:43.041 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.041 INFO:teuthology.orchestra.run.gibba005.stdout: osd recover clone overlap = true 2021-11-18T10:20:43.041 INFO:teuthology.orchestra.run.gibba005.stdout: osd recovery max chunk = 1048576 2021-11-18T10:20:43.042 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.042 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug shutdown = true 2021-11-18T10:20:43.042 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug op order = true 2021-11-18T10:20:43.042 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug verify stray on activate = true 2021-11-18T10:20:43.043 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.043 INFO:teuthology.orchestra.run.gibba005.stdout: osd open classes on start = true 2021-11-18T10:20:43.043 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug pg log writeout = true 2021-11-18T10:20:43.043 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.043 INFO:teuthology.orchestra.run.gibba005.stdout: osd deep scrub update digest min age = 30 2021-11-18T10:20:43.044 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.044 INFO:teuthology.orchestra.run.gibba005.stdout: osd map max advance = 10 2021-11-18T10:20:43.044 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.044 INFO:teuthology.orchestra.run.gibba005.stdout: journal zero on create = true 2021-11-18T10:20:43.045 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.045 INFO:teuthology.orchestra.run.gibba005.stdout: filestore ondisk finisher threads = 3 2021-11-18T10:20:43.045 INFO:teuthology.orchestra.run.gibba005.stdout: filestore apply finisher threads = 3 2021-11-18T10:20:43.045 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.045 INFO:teuthology.orchestra.run.gibba005.stdout: bdev debug aio = true 2021-11-18T10:20:43.046 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug misdirected ops = true 2021-11-18T10:20:43.046 INFO:teuthology.orchestra.run.gibba005.stdout: bluefs allocator = hybrid 2021-11-18T10:20:43.046 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore allocator = hybrid 2021-11-18T10:20:43.046 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore block size = 96636764160 2021-11-18T10:20:43.047 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore fsck on mount = True 2021-11-18T10:20:43.047 INFO:teuthology.orchestra.run.gibba005.stdout: debug bluefs = 1/20 2021-11-18T10:20:43.047 INFO:teuthology.orchestra.run.gibba005.stdout: debug bluestore = 1/20 2021-11-18T10:20:43.047 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-18T10:20:43.047 INFO:teuthology.orchestra.run.gibba005.stdout: debug osd = 20 2021-11-18T10:20:43.048 INFO:teuthology.orchestra.run.gibba005.stdout: debug rocksdb = 4/10 2021-11-18T10:20:43.048 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd backfillfull_ratio = 0.85 2021-11-18T10:20:43.048 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd full ratio = 0.9 2021-11-18T10:20:43.048 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd nearfull ratio = 0.8 2021-11-18T10:20:43.049 INFO:teuthology.orchestra.run.gibba005.stdout: osd failsafe full ratio = 0.95 2021-11-18T10:20:43.049 INFO:teuthology.orchestra.run.gibba005.stdout: osd objectstore = bluestore 2021-11-18T10:20:43.049 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.049 INFO:teuthology.orchestra.run.gibba005.stdout:[mgr] 2021-11-18T10:20:43.049 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-18T10:20:43.050 INFO:teuthology.orchestra.run.gibba005.stdout: debug mgr = 20 2021-11-18T10:20:43.050 INFO:teuthology.orchestra.run.gibba005.stdout: debug mon = 20 2021-11-18T10:20:43.050 INFO:teuthology.orchestra.run.gibba005.stdout: debug auth = 20 2021-11-18T10:20:43.050 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min pgs per osd = 4 2021-11-18T10:20:43.051 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min bytes per osd = 10 2021-11-18T10:20:43.051 INFO:teuthology.orchestra.run.gibba005.stdout: mgr/telemetry/nag = false 2021-11-18T10:20:43.051 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.051 INFO:teuthology.orchestra.run.gibba005.stdout:[mon] 2021-11-18T10:20:43.051 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-18T10:20:43.052 INFO:teuthology.orchestra.run.gibba005.stdout: debug mon = 20 2021-11-18T10:20:43.052 INFO:teuthology.orchestra.run.gibba005.stdout: debug paxos = 20 2021-11-18T10:20:43.052 INFO:teuthology.orchestra.run.gibba005.stdout: debug auth = 20 2021-11-18T10:20:43.052 INFO:teuthology.orchestra.run.gibba005.stdout: mon data avail warn = 5 2021-11-18T10:20:43.053 INFO:teuthology.orchestra.run.gibba005.stdout: mon mgr mkfs grace = 240 2021-11-18T10:20:43.053 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min pgs per osd = 4 2021-11-18T10:20:43.053 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd reporter subtree level = osd 2021-11-18T10:20:43.053 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd prime pg temp = true 2021-11-18T10:20:43.053 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min bytes per osd = 10 2021-11-18T10:20:43.054 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.054 INFO:teuthology.orchestra.run.gibba005.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-18T10:20:43.054 INFO:teuthology.orchestra.run.gibba005.stdout: auth mon ticket ttl = 660 # 11m 2021-11-18T10:20:43.054 INFO:teuthology.orchestra.run.gibba005.stdout: auth service ticket ttl = 240 # 4m 2021-11-18T10:20:43.055 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.055 INFO:teuthology.orchestra.run.gibba005.stdout: # don't complain about insecure global_id in the test suite 2021-11-18T10:20:43.055 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-18T10:20:43.055 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-18T10:20:43.055 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:43.056 INFO:teuthology.orchestra.run.gibba005.stdout:[client] 2021-11-18T10:20:43.056 INFO:teuthology.orchestra.run.gibba005.stdout: rgw cache enabled = true 2021-11-18T10:20:43.056 INFO:teuthology.orchestra.run.gibba005.stdout: rgw enable ops log = true 2021-11-18T10:20:43.056 INFO:teuthology.orchestra.run.gibba005.stdout: rgw enable usage log = true 2021-11-18T10:20:43.057 INFO:teuthology.orchestra.run.gibba005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-18T10:20:43.057 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-18T10:20:43.057 INFO:teuthology.orchestra.run.gibba005.stdout: debug rbd = 20 2021-11-18T10:20:43.057 INFO:teuthology.orchestra.run.gibba005.stdout: debug rbd_mirror = 15 2021-11-18T10:20:43.057 INFO:teuthology.orchestra.run.gibba005.stdout: log to stderr = False 2021-11-18T10:20:43.058 INFO:teuthology.orchestra.run.gibba005.stdout: rbd default features = 125 2021-11-18T10:20:43.058 INFO:teuthology.orchestra.run.gibba005.stdout: rbd mirror image policy type = simple 2021-11-18T10:20:43.058 INFO:teuthology.orchestra.run.gibba005.stdout:[mon.a] 2021-11-18T10:20:43.058 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.0] 2021-11-18T10:20:43.058 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:43.059 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:43.059 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.1] 2021-11-18T10:20:43.059 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:43.059 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:43.060 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.2] 2021-11-18T10:20:43.060 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:43.060 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:43.060 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.3] 2021-11-18T10:20:43.060 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:43.061 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:43.063 INFO:teuthology.orchestra.run.gibba019.stdout:[global] 2021-11-18T10:20:43.063 INFO:teuthology.orchestra.run.gibba019.stdout: chdir = "" 2021-11-18T10:20:43.064 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-18T10:20:43.064 INFO:teuthology.orchestra.run.gibba019.stdout: auth supported = cephx 2021-11-18T10:20:43.064 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.064 INFO:teuthology.orchestra.run.gibba019.stdout: filestore xattr use omap = true 2021-11-18T10:20:43.065 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.065 INFO:teuthology.orchestra.run.gibba019.stdout: mon clock drift allowed = 1.000 2021-11-18T10:20:43.065 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.065 INFO:teuthology.orchestra.run.gibba019.stdout: osd crush chooseleaf type = 0 2021-11-18T10:20:43.066 INFO:teuthology.orchestra.run.gibba019.stdout: auth debug = true 2021-11-18T10:20:43.066 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.066 INFO:teuthology.orchestra.run.gibba019.stdout: ms die on old message = true 2021-11-18T10:20:43.066 INFO:teuthology.orchestra.run.gibba019.stdout: ms die on bug = true 2021-11-18T10:20:43.067 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.067 INFO:teuthology.orchestra.run.gibba019.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-18T10:20:43.067 INFO:teuthology.orchestra.run.gibba019.stdout: mon pg warn max object skew = 0 2021-11-18T10:20:43.067 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.068 INFO:teuthology.orchestra.run.gibba019.stdout: # disable pg_autoscaler by default for new pools 2021-11-18T10:20:43.068 INFO:teuthology.orchestra.run.gibba019.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-18T10:20:43.068 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.068 INFO:teuthology.orchestra.run.gibba019.stdout: osd pool default size = 2 2021-11-18T10:20:43.069 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.069 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd allow primary affinity = true 2021-11-18T10:20:43.069 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd allow pg remap = true 2021-11-18T10:20:43.070 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on legacy crush tunables = false 2021-11-18T10:20:43.070 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on crush straw calc version zero = false 2021-11-18T10:20:43.070 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on no sortbitwise = false 2021-11-18T10:20:43.070 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on osd down out interval zero = false 2021-11-18T10:20:43.071 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on too few osds = false 2021-11-18T10:20:43.071 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-18T10:20:43.071 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-18T10:20:43.071 INFO:teuthology.orchestra.run.gibba019.stdout: mon_allow_pool_size_one = true 2021-11-18T10:20:43.072 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.072 INFO:teuthology.orchestra.run.gibba019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-11-18T10:20:43.072 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.072 INFO:teuthology.orchestra.run.gibba019.stdout: osd default data pool replay window = 5 2021-11-18T10:20:43.073 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.073 INFO:teuthology.orchestra.run.gibba019.stdout: mon allow pool delete = true 2021-11-18T10:20:43.073 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.073 INFO:teuthology.orchestra.run.gibba019.stdout: mon cluster log file level = debug 2021-11-18T10:20:43.074 INFO:teuthology.orchestra.run.gibba019.stdout: debug asserts on shutdown = true 2021-11-18T10:20:43.074 INFO:teuthology.orchestra.run.gibba019.stdout: mon health detail to clog = false 2021-11-18T10:20:43.074 INFO:teuthology.orchestra.run.gibba019.stdout: mon host = 172.21.2.105 2021-11-18T10:20:43.074 INFO:teuthology.orchestra.run.gibba019.stdout: mon client directed command retry = 5 2021-11-18T10:20:43.075 INFO:teuthology.orchestra.run.gibba019.stdout: ms inject socket failures = 5000 2021-11-18T10:20:43.075 INFO:teuthology.orchestra.run.gibba019.stdout: fsid = a2c35310-9d46-4e5d-be3a-3b110bd4a7c0 2021-11-18T10:20:43.075 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.075 INFO:teuthology.orchestra.run.gibba019.stdout:[osd] 2021-11-18T10:20:43.076 INFO:teuthology.orchestra.run.gibba019.stdout: osd journal size = 100 2021-11-18T10:20:43.076 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.076 INFO:teuthology.orchestra.run.gibba019.stdout: osd scrub load threshold = 5.0 2021-11-18T10:20:43.076 INFO:teuthology.orchestra.run.gibba019.stdout: osd scrub max interval = 600 2021-11-18T10:20:43.076 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.077 INFO:teuthology.orchestra.run.gibba019.stdout: osd recover clone overlap = true 2021-11-18T10:20:43.077 INFO:teuthology.orchestra.run.gibba019.stdout: osd recovery max chunk = 1048576 2021-11-18T10:20:43.078 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.078 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug shutdown = true 2021-11-18T10:20:43.078 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug op order = true 2021-11-18T10:20:43.078 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug verify stray on activate = true 2021-11-18T10:20:43.079 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.079 INFO:teuthology.orchestra.run.gibba019.stdout: osd open classes on start = true 2021-11-18T10:20:43.079 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug pg log writeout = true 2021-11-18T10:20:43.079 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.079 INFO:teuthology.orchestra.run.gibba019.stdout: osd deep scrub update digest min age = 30 2021-11-18T10:20:43.080 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.080 INFO:teuthology.orchestra.run.gibba019.stdout: osd map max advance = 10 2021-11-18T10:20:43.080 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.080 INFO:teuthology.orchestra.run.gibba019.stdout: journal zero on create = true 2021-11-18T10:20:43.081 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.081 INFO:teuthology.orchestra.run.gibba019.stdout: filestore ondisk finisher threads = 3 2021-11-18T10:20:43.081 INFO:teuthology.orchestra.run.gibba019.stdout: filestore apply finisher threads = 3 2021-11-18T10:20:43.081 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.082 INFO:teuthology.orchestra.run.gibba019.stdout: bdev debug aio = true 2021-11-18T10:20:43.082 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug misdirected ops = true 2021-11-18T10:20:43.082 INFO:teuthology.orchestra.run.gibba019.stdout: bluefs allocator = hybrid 2021-11-18T10:20:43.082 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore allocator = hybrid 2021-11-18T10:20:43.083 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore block size = 96636764160 2021-11-18T10:20:43.083 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore fsck on mount = True 2021-11-18T10:20:43.083 INFO:teuthology.orchestra.run.gibba019.stdout: debug bluefs = 1/20 2021-11-18T10:20:43.083 INFO:teuthology.orchestra.run.gibba019.stdout: debug bluestore = 1/20 2021-11-18T10:20:43.084 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-18T10:20:43.084 INFO:teuthology.orchestra.run.gibba019.stdout: debug osd = 20 2021-11-18T10:20:43.084 INFO:teuthology.orchestra.run.gibba019.stdout: debug rocksdb = 4/10 2021-11-18T10:20:43.084 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd backfillfull_ratio = 0.85 2021-11-18T10:20:43.085 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd full ratio = 0.9 2021-11-18T10:20:43.085 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd nearfull ratio = 0.8 2021-11-18T10:20:43.085 INFO:teuthology.orchestra.run.gibba019.stdout: osd failsafe full ratio = 0.95 2021-11-18T10:20:43.085 INFO:teuthology.orchestra.run.gibba019.stdout: osd objectstore = bluestore 2021-11-18T10:20:43.086 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.086 INFO:teuthology.orchestra.run.gibba019.stdout:[mgr] 2021-11-18T10:20:43.086 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-18T10:20:43.086 INFO:teuthology.orchestra.run.gibba019.stdout: debug mgr = 20 2021-11-18T10:20:43.087 INFO:teuthology.orchestra.run.gibba019.stdout: debug mon = 20 2021-11-18T10:20:43.087 INFO:teuthology.orchestra.run.gibba019.stdout: debug auth = 20 2021-11-18T10:20:43.087 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min pgs per osd = 4 2021-11-18T10:20:43.087 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min bytes per osd = 10 2021-11-18T10:20:43.088 INFO:teuthology.orchestra.run.gibba019.stdout: mgr/telemetry/nag = false 2021-11-18T10:20:43.088 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.088 INFO:teuthology.orchestra.run.gibba019.stdout:[mon] 2021-11-18T10:20:43.088 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-18T10:20:43.088 INFO:teuthology.orchestra.run.gibba019.stdout: debug mon = 20 2021-11-18T10:20:43.089 INFO:teuthology.orchestra.run.gibba019.stdout: debug paxos = 20 2021-11-18T10:20:43.089 INFO:teuthology.orchestra.run.gibba019.stdout: debug auth = 20 2021-11-18T10:20:43.089 INFO:teuthology.orchestra.run.gibba019.stdout: mon data avail warn = 5 2021-11-18T10:20:43.089 INFO:teuthology.orchestra.run.gibba019.stdout: mon mgr mkfs grace = 240 2021-11-18T10:20:43.090 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min pgs per osd = 4 2021-11-18T10:20:43.090 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd reporter subtree level = osd 2021-11-18T10:20:43.090 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd prime pg temp = true 2021-11-18T10:20:43.090 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min bytes per osd = 10 2021-11-18T10:20:43.091 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.091 INFO:teuthology.orchestra.run.gibba019.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-18T10:20:43.091 INFO:teuthology.orchestra.run.gibba019.stdout: auth mon ticket ttl = 660 # 11m 2021-11-18T10:20:43.091 INFO:teuthology.orchestra.run.gibba019.stdout: auth service ticket ttl = 240 # 4m 2021-11-18T10:20:43.092 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.092 INFO:teuthology.orchestra.run.gibba019.stdout: # don't complain about insecure global_id in the test suite 2021-11-18T10:20:43.092 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-18T10:20:43.092 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-18T10:20:43.093 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:20:43.093 INFO:teuthology.orchestra.run.gibba019.stdout:[client] 2021-11-18T10:20:43.093 INFO:teuthology.orchestra.run.gibba019.stdout: rgw cache enabled = true 2021-11-18T10:20:43.093 INFO:teuthology.orchestra.run.gibba019.stdout: rgw enable ops log = true 2021-11-18T10:20:43.094 INFO:teuthology.orchestra.run.gibba019.stdout: rgw enable usage log = true 2021-11-18T10:20:43.094 INFO:teuthology.orchestra.run.gibba019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-18T10:20:43.094 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-18T10:20:43.094 INFO:teuthology.orchestra.run.gibba019.stdout: debug rbd = 20 2021-11-18T10:20:43.095 INFO:teuthology.orchestra.run.gibba019.stdout: debug rbd_mirror = 15 2021-11-18T10:20:43.095 INFO:teuthology.orchestra.run.gibba019.stdout: log to stderr = False 2021-11-18T10:20:43.095 INFO:teuthology.orchestra.run.gibba019.stdout: rbd default features = 125 2021-11-18T10:20:43.095 INFO:teuthology.orchestra.run.gibba019.stdout: rbd mirror image policy type = simple 2021-11-18T10:20:43.096 INFO:teuthology.orchestra.run.gibba019.stdout:[mon.a] 2021-11-18T10:20:43.096 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.0] 2021-11-18T10:20:43.096 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:43.096 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:43.097 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.1] 2021-11-18T10:20:43.097 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:43.097 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:43.097 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.2] 2021-11-18T10:20:43.098 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:43.098 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:43.098 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.3] 2021-11-18T10:20:43.098 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:20:43.099 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:20:43.099 INFO:tasks.ceph:Creating admin key on cluster1.mon.a... 2021-11-18T10:20:43.100 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/cluster1.keyring 2021-11-18T10:20:43.141 INFO:tasks.ceph:Copying monmap to all nodes... 2021-11-18T10:20:43.142 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:43.142 DEBUG:teuthology.orchestra.run.gibba005:> dd if=/etc/ceph/cluster1.keyring of=/dev/stdout 2021-11-18T10:20:43.194 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:43.194 DEBUG:teuthology.orchestra.run.gibba005:> dd if=/home/ubuntu/cephtest/cluster1.monmap of=/dev/stdout 2021-11-18T10:20:43.248 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba005.front.sepia.ceph.com 2021-11-18T10:20:43.249 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:43.250 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/etc/ceph/cluster1.keyring 2021-11-18T10:20:43.251 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2021-11-18T10:20:43.314 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:43.315 DEBUG:teuthology.orchestra.run.gibba005:> dd of=/home/ubuntu/cephtest/cluster1.monmap 2021-11-18T10:20:43.366 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba019.front.sepia.ceph.com 2021-11-18T10:20:43.367 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:43.367 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/etc/ceph/cluster1.keyring 2021-11-18T10:20:43.368 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0644 /etc/ceph/cluster1.keyring 2021-11-18T10:20:43.396 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:43.397 DEBUG:teuthology.orchestra.run.gibba019:> dd of=/home/ubuntu/cephtest/cluster1.monmap 2021-11-18T10:20:43.450 INFO:tasks.ceph:Setting up mon nodes... 2021-11-18T10:20:43.450 INFO:tasks.ceph:Setting up mgr nodes... 2021-11-18T10:20:43.451 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/mgr/cluster1-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/cluster1-x/keyring 2021-11-18T10:20:43.487 INFO:teuthology.orchestra.run.gibba005.stdout:creating /var/lib/ceph/mgr/cluster1-x/keyring 2021-11-18T10:20:43.489 INFO:tasks.ceph:Setting up mds nodes... 2021-11-18T10:20:43.490 INFO:tasks.ceph_client:Setting up client nodes... 2021-11-18T10:20:43.491 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/cluster1.client.0.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.0.keyring 2021-11-18T10:20:43.558 INFO:teuthology.orchestra.run.gibba005.stdout:creating /etc/ceph/cluster1.client.0.keyring 2021-11-18T10:20:43.568 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror /etc/ceph/cluster1.client.mirror.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.keyring 2021-11-18T10:20:43.643 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster1.client.mirror.keyring 2021-11-18T10:20:43.653 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.0 /etc/ceph/cluster1.client.mirror.0.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.0.keyring 2021-11-18T10:20:43.681 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster1.client.mirror.0.keyring 2021-11-18T10:20:43.691 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.1 /etc/ceph/cluster1.client.mirror.1.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.1.keyring 2021-11-18T10:20:43.759 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster1.client.mirror.1.keyring 2021-11-18T10:20:43.769 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.2 /etc/ceph/cluster1.client.mirror.2.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.2.keyring 2021-11-18T10:20:43.838 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster1.client.mirror.2.keyring 2021-11-18T10:20:43.847 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.3 /etc/ceph/cluster1.client.mirror.3.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.3.keyring 2021-11-18T10:20:43.916 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster1.client.mirror.3.keyring 2021-11-18T10:20:43.925 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.4 /etc/ceph/cluster1.client.mirror.4.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.4.keyring 2021-11-18T10:20:43.994 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster1.client.mirror.4.keyring 2021-11-18T10:20:44.004 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.5 /etc/ceph/cluster1.client.mirror.5.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.5.keyring 2021-11-18T10:20:44.072 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster1.client.mirror.5.keyring 2021-11-18T10:20:44.082 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.6 /etc/ceph/cluster1.client.mirror.6.keyring && sudo chmod 0644 /etc/ceph/cluster1.client.mirror.6.keyring 2021-11-18T10:20:44.151 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster1.client.mirror.6.keyring 2021-11-18T10:20:44.161 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-11-18T10:20:44.161 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba005.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}} 2021-11-18T10:20:44.162 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/osd/cluster1-0 2021-11-18T10:20:44.182 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-18T10:20:44.183 INFO:tasks.ceph:role: cluster1.osd.0 2021-11-18T10:20:44.183 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba005.front.sepia.ceph.com 2021-11-18T10:20:44.183 DEBUG:teuthology.orchestra.run.gibba005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-11-18T10:20:44.242 INFO:teuthology.orchestra.run.gibba005.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-11-18T10:20:44.242 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-18T10:20:44.243 INFO:teuthology.orchestra.run.gibba005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-18T10:20:44.243 INFO:teuthology.orchestra.run.gibba005.stdout: = reflink=1 2021-11-18T10:20:44.243 INFO:teuthology.orchestra.run.gibba005.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-18T10:20:44.243 INFO:teuthology.orchestra.run.gibba005.stdout: = sunit=0 swidth=0 blks 2021-11-18T10:20:44.243 INFO:teuthology.orchestra.run.gibba005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-18T10:20:44.244 INFO:teuthology.orchestra.run.gibba005.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-18T10:20:44.244 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-18T10:20:44.244 INFO:teuthology.orchestra.run.gibba005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-18T10:20:44.264 INFO:teuthology.orchestra.run.gibba005.stdout:Discarding blocks...Done. 2021-11-18T10:20:44.266 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba005.front.sepia.ceph.com -o noatime 2021-11-18T10:20:44.266 DEBUG:teuthology.orchestra.run.gibba005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/cluster1-0 2021-11-18T10:20:44.339 DEBUG:teuthology.orchestra.run.gibba005:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-0 2021-11-18T10:20:44.401 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/osd/cluster1-1 2021-11-18T10:20:44.461 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-18T10:20:44.461 INFO:tasks.ceph:role: cluster1.osd.1 2021-11-18T10:20:44.462 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba005.front.sepia.ceph.com 2021-11-18T10:20:44.462 DEBUG:teuthology.orchestra.run.gibba005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-11-18T10:20:44.519 INFO:teuthology.orchestra.run.gibba005.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-11-18T10:20:44.519 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-18T10:20:44.519 INFO:teuthology.orchestra.run.gibba005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-18T10:20:44.519 INFO:teuthology.orchestra.run.gibba005.stdout: = reflink=1 2021-11-18T10:20:44.520 INFO:teuthology.orchestra.run.gibba005.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-18T10:20:44.520 INFO:teuthology.orchestra.run.gibba005.stdout: = sunit=0 swidth=0 blks 2021-11-18T10:20:44.520 INFO:teuthology.orchestra.run.gibba005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-18T10:20:44.520 INFO:teuthology.orchestra.run.gibba005.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-18T10:20:44.521 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-18T10:20:44.521 INFO:teuthology.orchestra.run.gibba005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-18T10:20:44.542 INFO:teuthology.orchestra.run.gibba005.stdout:Discarding blocks...Done. 2021-11-18T10:20:44.543 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba005.front.sepia.ceph.com -o noatime 2021-11-18T10:20:44.544 DEBUG:teuthology.orchestra.run.gibba005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/cluster1-1 2021-11-18T10:20:44.615 DEBUG:teuthology.orchestra.run.gibba005:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-1 2021-11-18T10:20:44.677 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/osd/cluster1-2 2021-11-18T10:20:44.736 INFO:tasks.ceph:roles_to_devs: {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-18T10:20:44.737 INFO:tasks.ceph:role: cluster1.osd.2 2021-11-18T10:20:44.737 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba005.front.sepia.ceph.com 2021-11-18T10:20:44.737 DEBUG:teuthology.orchestra.run.gibba005:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-11-18T10:20:44.794 INFO:teuthology.orchestra.run.gibba005.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-11-18T10:20:44.794 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-18T10:20:44.794 INFO:teuthology.orchestra.run.gibba005.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-18T10:20:44.794 INFO:teuthology.orchestra.run.gibba005.stdout: = reflink=1 2021-11-18T10:20:44.795 INFO:teuthology.orchestra.run.gibba005.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-18T10:20:44.795 INFO:teuthology.orchestra.run.gibba005.stdout: = sunit=0 swidth=0 blks 2021-11-18T10:20:44.795 INFO:teuthology.orchestra.run.gibba005.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-18T10:20:44.795 INFO:teuthology.orchestra.run.gibba005.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-18T10:20:44.796 INFO:teuthology.orchestra.run.gibba005.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-18T10:20:44.796 INFO:teuthology.orchestra.run.gibba005.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-18T10:20:44.817 INFO:teuthology.orchestra.run.gibba005.stdout:Discarding blocks...Done. 2021-11-18T10:20:44.818 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba005.front.sepia.ceph.com -o noatime 2021-11-18T10:20:44.818 DEBUG:teuthology.orchestra.run.gibba005:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/cluster1-2 2021-11-18T10:20:44.888 DEBUG:teuthology.orchestra.run.gibba005:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster1-2 2021-11-18T10:20:44.950 DEBUG:teuthology.orchestra.run.gibba005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/cluster1.monmap 2021-11-18T10:20:45.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:45.061+0000 7f0391c9f0c0 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-0/keyring: can't open /var/lib/ceph/osd/cluster1-0/keyring: (2) No such file or directory 2021-11-18T10:20:45.059 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:45.061+0000 7f0391c9f0c0 -1 created new key in keyring /var/lib/ceph/osd/cluster1-0/keyring 2021-11-18T10:20:45.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:45.061+0000 7f0391c9f0c0 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2021-11-18T10:20:45.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:45.061+0000 7f0391c9f0c0 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2021-11-18T10:20:45.060 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:45.061+0000 7f0391c9f0c0 -1 bluestore(/var/lib/ceph/osd/cluster1-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-0/block: (2) No such file or directory 2021-11-18T10:20:45.061 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:45.061+0000 7f0391c9f0c0 -1 bluestore(/var/lib/ceph/osd/cluster1-0) _read_fsid unparsable uuid 2021-11-18T10:20:47.924 DEBUG:teuthology.orchestra.run.gibba005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-0 2021-11-18T10:20:47.945 DEBUG:teuthology.orchestra.run.gibba005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/cluster1.monmap 2021-11-18T10:20:48.015 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:48.017+0000 7fccceb260c0 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-1/keyring: can't open /var/lib/ceph/osd/cluster1-1/keyring: (2) No such file or directory 2021-11-18T10:20:48.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:48.017+0000 7fccceb260c0 -1 created new key in keyring /var/lib/ceph/osd/cluster1-1/keyring 2021-11-18T10:20:48.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:48.017+0000 7fccceb260c0 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2021-11-18T10:20:48.016 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:48.017+0000 7fccceb260c0 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2021-11-18T10:20:48.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:48.017+0000 7fccceb260c0 -1 bluestore(/var/lib/ceph/osd/cluster1-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-1/block: (2) No such file or directory 2021-11-18T10:20:48.017 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:48.017+0000 7fccceb260c0 -1 bluestore(/var/lib/ceph/osd/cluster1-1) _read_fsid unparsable uuid 2021-11-18T10:20:50.868 DEBUG:teuthology.orchestra.run.gibba005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-1 2021-11-18T10:20:50.935 DEBUG:teuthology.orchestra.run.gibba005:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster1 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/cluster1.monmap 2021-11-18T10:20:51.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:51.011+0000 7f14e36c20c0 -1 auth: error reading file: /var/lib/ceph/osd/cluster1-2/keyring: can't open /var/lib/ceph/osd/cluster1-2/keyring: (2) No such file or directory 2021-11-18T10:20:51.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:51.011+0000 7f14e36c20c0 -1 created new key in keyring /var/lib/ceph/osd/cluster1-2/keyring 2021-11-18T10:20:51.010 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:51.011+0000 7f14e36c20c0 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2021-11-18T10:20:51.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:51.011+0000 7f14e36c20c0 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2021-11-18T10:20:51.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:51.011+0000 7f14e36c20c0 -1 bluestore(/var/lib/ceph/osd/cluster1-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster1-2/block: (2) No such file or directory 2021-11-18T10:20:51.011 INFO:teuthology.orchestra.run.gibba005.stderr:2021-11-18T10:20:51.011+0000 7f14e36c20c0 -1 bluestore(/var/lib/ceph/osd/cluster1-2) _read_fsid unparsable uuid 2021-11-18T10:20:53.860 DEBUG:teuthology.orchestra.run.gibba005:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster1-2 2021-11-18T10:20:53.919 INFO:tasks.ceph:Reading keys from all nodes... 2021-11-18T10:20:53.920 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:53.920 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd if=/var/lib/ceph/mgr/cluster1-x/keyring of=/dev/stdout 2021-11-18T10:20:53.977 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:53.978 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd if=/var/lib/ceph/osd/cluster1-0/keyring of=/dev/stdout 2021-11-18T10:20:54.036 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:54.036 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd if=/var/lib/ceph/osd/cluster1-1/keyring of=/dev/stdout 2021-11-18T10:20:54.095 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:54.096 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd if=/var/lib/ceph/osd/cluster1-2/keyring of=/dev/stdout 2021-11-18T10:20:54.154 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:54.154 DEBUG:teuthology.orchestra.run.gibba005:> dd if=/etc/ceph/cluster1.client.0.keyring of=/dev/stdout 2021-11-18T10:20:54.206 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:54.207 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster1.client.mirror.keyring of=/dev/stdout 2021-11-18T10:20:54.220 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:54.221 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster1.client.mirror.0.keyring of=/dev/stdout 2021-11-18T10:20:54.273 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:54.273 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster1.client.mirror.1.keyring of=/dev/stdout 2021-11-18T10:20:54.325 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:54.325 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster1.client.mirror.2.keyring of=/dev/stdout 2021-11-18T10:20:54.377 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:54.378 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster1.client.mirror.3.keyring of=/dev/stdout 2021-11-18T10:20:54.430 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:54.431 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster1.client.mirror.4.keyring of=/dev/stdout 2021-11-18T10:20:54.483 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:54.483 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster1.client.mirror.5.keyring of=/dev/stdout 2021-11-18T10:20:54.535 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:20:54.536 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster1.client.mirror.6.keyring of=/dev/stdout 2021-11-18T10:20:54.587 INFO:tasks.ceph:Adding keys to all mons... 2021-11-18T10:20:54.588 DEBUG:teuthology.orchestra.run.gibba005:> sudo tee -a /etc/ceph/cluster1.keyring 2021-11-18T10:20:54.606 INFO:teuthology.orchestra.run.gibba005.stdout:[mgr.x] 2021-11-18T10:20:54.607 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQD7KJZhqoQ5HRAAvc6Dbx8qPUl2rjQsJujTAA== 2021-11-18T10:20:54.607 INFO:teuthology.orchestra.run.gibba005.stdout:[osd.0] 2021-11-18T10:20:54.607 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQD9KJZh//6vAxAA52d0w1W6Dyk1TqCJb2jP1g== 2021-11-18T10:20:54.608 INFO:teuthology.orchestra.run.gibba005.stdout:[osd.1] 2021-11-18T10:20:54.608 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQAAKZZhAnsTARAAfxWDJGxmhvc5HR6Jn1F58Q== 2021-11-18T10:20:54.608 INFO:teuthology.orchestra.run.gibba005.stdout:[osd.2] 2021-11-18T10:20:54.608 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQADKZZhDpO5ABAAmUmoEIs9N9v80iN1ykJXkw== 2021-11-18T10:20:54.609 INFO:teuthology.orchestra.run.gibba005.stdout:[client.0] 2021-11-18T10:20:54.609 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQD7KJZhvtF0IRAAyWBFqqvoKUnTQGOeTsbOXA== 2021-11-18T10:20:54.609 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror] 2021-11-18T10:20:54.609 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQD7KJZhJAWBJhAAWM0zTbY8xzUUGsqLmIi5uA== 2021-11-18T10:20:54.609 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.0] 2021-11-18T10:20:54.610 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQD7KJZh+5zFKBAAA57Qm/X+oYRGBXbIz5danQ== 2021-11-18T10:20:54.610 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.1] 2021-11-18T10:20:54.610 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQD7KJZhgGlpLRAALch4AONKy7CDy2/WKrerww== 2021-11-18T10:20:54.610 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.2] 2021-11-18T10:20:54.611 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQD7KJZh6vAaMhAAyxg3CCczXE6KAsbwkkatHw== 2021-11-18T10:20:54.611 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.3] 2021-11-18T10:20:54.611 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQD7KJZhfo/BNhAAEDJkx+PNYErOfspV8UkI1g== 2021-11-18T10:20:54.611 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.4] 2021-11-18T10:20:54.612 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQD7KJZhIpdwOxAAKIuO0jCCQaMUiIQv+PAMiw== 2021-11-18T10:20:54.612 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.5] 2021-11-18T10:20:54.612 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQD8KJZhG4l6BBAARgDvoEN06Y6kRUBTke+d2A== 2021-11-18T10:20:54.612 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.6] 2021-11-18T10:20:54.612 INFO:teuthology.orchestra.run.gibba005.stdout: key = AQD8KJZhGX8wCRAAOdxm6Cb8j+FPpH1Qc0sOXw== 2021-11-18T10:20:54.614 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-18T10:20:54.691 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-11-18T10:20:54.767 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-11-18T10:20:54.844 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-11-18T10:20:54.919 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:20:54.996 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:20:55.074 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:20:55.152 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:20:55.231 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:20:55.311 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:20:55.390 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.4 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:20:55.466 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.5 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:20:55.545 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster1.keyring --name=client.mirror.6 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:20:55.623 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-11-18T10:20:55.624 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/mon/cluster1-a 2021-11-18T10:20:55.683 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster cluster1 --mkfs -i a --monmap /home/ubuntu/cephtest/cluster1.monmap --keyring /etc/ceph/cluster1.keyring 2021-11-18T10:20:55.765 DEBUG:teuthology.orchestra.run.gibba005:> sudo chown -R ceph:ceph /var/lib/ceph/mon/cluster1-a 2021-11-18T10:20:55.824 DEBUG:teuthology.orchestra.run.gibba005:> rm -- /home/ubuntu/cephtest/cluster1.monmap 2021-11-18T10:20:55.876 INFO:tasks.ceph:Starting mon daemons in cluster cluster1... 2021-11-18T10:20:55.876 INFO:tasks.ceph.cluster1.mon.a:Restarting daemon 2021-11-18T10:20:55.877 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster cluster1 -i a 2021-11-18T10:20:55.919 INFO:tasks.ceph.cluster1.mon.a:Started 2021-11-18T10:20:55.919 INFO:tasks.ceph:Starting mgr daemons in cluster cluster1... 2021-11-18T10:20:55.920 INFO:tasks.ceph.cluster1.mgr.x:Restarting daemon 2021-11-18T10:20:55.920 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster cluster1 -i x 2021-11-18T10:20:55.923 INFO:tasks.ceph.cluster1.mgr.x:Started 2021-11-18T10:20:55.923 INFO:tasks.ceph:Setting crush tunables to default 2021-11-18T10:20:55.924 DEBUG:teuthology.orchestra.run.gibba005:> sudo ceph --cluster cluster1 osd crush tunables default 2021-11-18T10:20:56.076 INFO:teuthology.orchestra.run.gibba005.stderr:adjusted tunables profile to default 2021-11-18T10:20:56.084 INFO:tasks.ceph:Starting osd daemons in cluster cluster1... 2021-11-18T10:20:56.084 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:56.084 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd if=/var/lib/ceph/osd/cluster1-0/fsid of=/dev/stdout 2021-11-18T10:20:56.103 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:56.103 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd if=/var/lib/ceph/osd/cluster1-1/fsid of=/dev/stdout 2021-11-18T10:20:56.162 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:20:56.163 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd if=/var/lib/ceph/osd/cluster1-2/fsid of=/dev/stdout 2021-11-18T10:20:56.220 DEBUG:teuthology.orchestra.run.gibba005:> sudo ceph --cluster cluster1 osd new f45c593b-7a94-4304-83ff-60334562c99a 0 2021-11-18T10:20:56.413 INFO:teuthology.orchestra.run.gibba005.stdout:0 2021-11-18T10:20:56.423 DEBUG:teuthology.orchestra.run.gibba005:> sudo ceph --cluster cluster1 osd new 1230dbfe-2e44-4f8a-bbb5-3aba8f8323b6 1 2021-11-18T10:20:56.577 INFO:teuthology.orchestra.run.gibba005.stdout:1 2021-11-18T10:20:56.587 DEBUG:teuthology.orchestra.run.gibba005:> sudo ceph --cluster cluster1 osd new 1d28e45c-0790-4762-a4a9-1466c58a19e2 2 2021-11-18T10:20:56.739 INFO:teuthology.orchestra.run.gibba005.stdout:2 2021-11-18T10:20:56.748 INFO:tasks.ceph.cluster1.osd.0:Restarting daemon 2021-11-18T10:20:56.748 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 0 2021-11-18T10:20:56.751 INFO:tasks.ceph.cluster1.osd.0:Started 2021-11-18T10:20:56.751 INFO:tasks.ceph.cluster1.osd.1:Restarting daemon 2021-11-18T10:20:56.752 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 1 2021-11-18T10:20:56.755 INFO:tasks.ceph.cluster1.osd.1:Started 2021-11-18T10:20:56.755 INFO:tasks.ceph.cluster1.osd.2:Restarting daemon 2021-11-18T10:20:56.756 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster1 -i 2 2021-11-18T10:20:56.758 INFO:tasks.ceph.cluster1.osd.2:Started 2021-11-18T10:20:56.758 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2021-11-18T10:20:56.901 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:20:56.902 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":5,"fsid":"a2c35310-9d46-4e5d-be3a-3b110bd4a7c0","created":"2021-11-18T10:20:56.007668+0000","modified":"2021-11-18T10:20:56.740292+0000","last_up_change":"0.000000","last_in_change":"2021-11-18T10:20:56.740292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"f45c593b-7a94-4304-83ff-60334562c99a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1230dbfe-2e44-4f8a-bbb5-3aba8f8323b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1d28e45c-0790-4762-a4a9-1466c58a19e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-18T10:20:56.910 INFO:tasks.ceph.ceph_manager.cluster1:[] 2021-11-18T10:20:56.911 INFO:tasks.ceph:Waiting for OSDs to come up 2021-11-18T10:20:57.076 INFO:tasks.ceph.cluster1.osd.0.gibba005.stderr:2021-11-18T10:20:57.077+0000 7fdd81fd80c0 -1 Falling back to public interface 2021-11-18T10:20:57.214 DEBUG:teuthology.orchestra.run.gibba005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2021-11-18T10:20:57.329 INFO:tasks.ceph.cluster1.osd.2.gibba005.stderr:2021-11-18T10:20:57.330+0000 7fe0c30f30c0 -1 Falling back to public interface 2021-11-18T10:20:57.329 INFO:tasks.ceph.cluster1.osd.1.gibba005.stderr:2021-11-18T10:20:57.330+0000 7f1de0e300c0 -1 Falling back to public interface 2021-11-18T10:20:57.548 INFO:teuthology.misc.health.gibba005.stdout: 2021-11-18T10:20:57.549 INFO:teuthology.misc.health.gibba005.stdout:{"epoch":5,"fsid":"a2c35310-9d46-4e5d-be3a-3b110bd4a7c0","created":"2021-11-18T10:20:56.007668+0000","modified":"2021-11-18T10:20:56.740292+0000","last_up_change":"0.000000","last_in_change":"2021-11-18T10:20:56.740292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"f45c593b-7a94-4304-83ff-60334562c99a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"1230dbfe-2e44-4f8a-bbb5-3aba8f8323b6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1d28e45c-0790-4762-a4a9-1466c58a19e2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-18T10:20:57.557 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-11-18T10:21:00.676 INFO:tasks.ceph.cluster1.osd.0.gibba005.stderr:2021-11-18T10:21:00.678+0000 7fdd81fd80c0 -1 osd.0 0 log_to_monitors {default=true} 2021-11-18T10:21:00.913 INFO:tasks.ceph.cluster1.osd.2.gibba005.stderr:2021-11-18T10:21:00.914+0000 7fe0c30f30c0 -1 osd.2 0 log_to_monitors {default=true} 2021-11-18T10:21:00.914 INFO:tasks.ceph.cluster1.osd.1.gibba005.stderr:2021-11-18T10:21:00.915+0000 7f1de0e300c0 -1 osd.1 0 log_to_monitors {default=true} 2021-11-18T10:21:02.950 INFO:tasks.ceph.cluster1.osd.2.gibba005.stderr:2021-11-18T10:21:02.951+0000 7fe0b9ab1700 -1 osd.2 0 waiting for initial osdmap 2021-11-18T10:21:02.952 INFO:tasks.ceph.cluster1.osd.2.gibba005.stderr:2021-11-18T10:21:02.954+0000 7fe0b2444700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-18T10:21:02.989 INFO:tasks.ceph.cluster1.osd.1.gibba005.stderr:2021-11-18T10:21:02.990+0000 7f1dd8ff1700 -1 osd.1 0 waiting for initial osdmap 2021-11-18T10:21:02.990 INFO:tasks.ceph.cluster1.osd.0.gibba005.stderr:2021-11-18T10:21:02.992+0000 7fdd78996700 -1 osd.0 0 waiting for initial osdmap 2021-11-18T10:21:02.992 INFO:tasks.ceph.cluster1.osd.1.gibba005.stderr:2021-11-18T10:21:02.994+0000 7f1dd0181700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-18T10:21:02.993 INFO:tasks.ceph.cluster1.osd.0.gibba005.stderr:2021-11-18T10:21:02.994+0000 7fdd71329700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-18T10:21:03.866 DEBUG:teuthology.orchestra.run.gibba005:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster1 osd dump --format=json 2021-11-18T10:21:04.083 INFO:teuthology.misc.health.gibba005.stdout: 2021-11-18T10:21:04.083 INFO:teuthology.misc.health.gibba005.stdout:{"epoch":8,"fsid":"a2c35310-9d46-4e5d-be3a-3b110bd4a7c0","created":"2021-11-18T10:20:56.007668+0000","modified":"2021-11-18T10:21:03.950481+0000","last_up_change":"2021-11-18T10:21:03.950481+0000","last_in_change":"2021-11-18T10:20:56.740292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"f45c593b-7a94-4304-83ff-60334562c99a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6800","nonce":32929},{"type":"v1","addr":"172.21.2.105:6801","nonce":32929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":32929},{"type":"v1","addr":"172.21.2.105:6803","nonce":32929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":32929},{"type":"v1","addr":"172.21.2.105:6807","nonce":32929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":32929},{"type":"v1","addr":"172.21.2.105:6805","nonce":32929}]},"public_addr":"172.21.2.105:6801/32929","cluster_addr":"172.21.2.105:6803/32929","heartbeat_back_addr":"172.21.2.105:6807/32929","heartbeat_front_addr":"172.21.2.105:6805/32929","state":["exists","up"]},{"osd":1,"uuid":"1230dbfe-2e44-4f8a-bbb5-3aba8f8323b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":32930},{"type":"v1","addr":"172.21.2.105:6810","nonce":32930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":32930},{"type":"v1","addr":"172.21.2.105:6814","nonce":32930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":32930},{"type":"v1","addr":"172.21.2.105:6822","nonce":32930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":32930},{"type":"v1","addr":"172.21.2.105:6818","nonce":32930}]},"public_addr":"172.21.2.105:6810/32930","cluster_addr":"172.21.2.105:6814/32930","heartbeat_back_addr":"172.21.2.105:6822/32930","heartbeat_front_addr":"172.21.2.105:6818/32930","state":["exists","up"]},{"osd":2,"uuid":"1d28e45c-0790-4762-a4a9-1466c58a19e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6809","nonce":32931},{"type":"v1","addr":"172.21.2.105:6811","nonce":32931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6813","nonce":32931},{"type":"v1","addr":"172.21.2.105:6815","nonce":32931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6821","nonce":32931},{"type":"v1","addr":"172.21.2.105:6823","nonce":32931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6817","nonce":32931},{"type":"v1","addr":"172.21.2.105:6819","nonce":32931}]},"public_addr":"172.21.2.105:6811/32931","cluster_addr":"172.21.2.105:6815/32931","heartbeat_back_addr":"172.21.2.105:6823/32931","heartbeat_front_addr":"172.21.2.105:6819/32931","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-18T10:21:04.092 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-11-18T10:21:04.093 INFO:tasks.ceph:Creating RBD pool 2021-11-18T10:21:04.093 DEBUG:teuthology.orchestra.run.gibba005:> sudo ceph --cluster cluster1 osd pool create rbd 8 2021-11-18T10:21:04.953 INFO:teuthology.orchestra.run.gibba005.stderr:pool 'rbd' created 2021-11-18T10:21:04.961 DEBUG:teuthology.orchestra.run.gibba005:> sudo ceph --cluster cluster1 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-11-18T10:21:05.954 INFO:teuthology.orchestra.run.gibba005.stderr:enabled application 'rbd' on pool 'rbd' 2021-11-18T10:21:05.964 INFO:tasks.ceph:Starting mds daemons in cluster cluster1... 2021-11-18T10:21:05.964 INFO:tasks.ceph:Waiting until cluster1 daemons up and pgs clean... 2021-11-18T10:21:05.965 INFO:tasks.ceph.ceph_manager.cluster1:waiting for mgr available 2021-11-18T10:21:05.965 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 mgr dump --format=json 2021-11-18T10:21:05.966 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-11-18T10:21:06.233 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:06.241 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":4,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6824","nonce":32594},{"type":"v1","addr":"172.21.2.105:6825","nonce":32594}]},"active_addr":"172.21.2.105:6825/32594","active_change":"2021-11-18T10:20:59.782595+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"autoscale_profile":{"name":"autoscale_profile","type":"str","level":"advanced","flags":1,"default_value":"scale-down","min":"","max":"","enum_allowed":[],"desc":"pg_autoscale profiler","long_desc":"Determines the behavior of the autoscaler algorithm, `scale-down means start out with full pgs and scalesdown when there is pressure`scale-up` means that it starts out with minmum pgs and scales up when there is pressure","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share perf counter metrics summed across the whole cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.105:0","nonce":3453016072}]},{"addrvec":[{"type":"v2","addr":"172.21.2.105:0","nonce":4294090387}]},{"addrvec":[{"type":"v2","addr":"172.21.2.105:0","nonce":3221047306}]}]}} 2021-11-18T10:21:06.244 INFO:tasks.ceph.ceph_manager.cluster1:mgr available! 2021-11-18T10:21:06.245 INFO:tasks.ceph.ceph_manager.cluster1:waiting for all up 2021-11-18T10:21:06.245 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2021-11-18T10:21:06.463 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:06.464 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":10,"fsid":"a2c35310-9d46-4e5d-be3a-3b110bd4a7c0","created":"2021-11-18T10:20:56.007668+0000","modified":"2021-11-18T10:21:05.952651+0000","last_up_change":"2021-11-18T10:21:03.950481+0000","last_in_change":"2021-11-18T10:20:56.740292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-11-18T10:21:04.018492+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-18T10:21:04.319309+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f45c593b-7a94-4304-83ff-60334562c99a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6800","nonce":32929},{"type":"v1","addr":"172.21.2.105:6801","nonce":32929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":32929},{"type":"v1","addr":"172.21.2.105:6803","nonce":32929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":32929},{"type":"v1","addr":"172.21.2.105:6807","nonce":32929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":32929},{"type":"v1","addr":"172.21.2.105:6805","nonce":32929}]},"public_addr":"172.21.2.105:6801/32929","cluster_addr":"172.21.2.105:6803/32929","heartbeat_back_addr":"172.21.2.105:6807/32929","heartbeat_front_addr":"172.21.2.105:6805/32929","state":["exists","up"]},{"osd":1,"uuid":"1230dbfe-2e44-4f8a-bbb5-3aba8f8323b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":32930},{"type":"v1","addr":"172.21.2.105:6810","nonce":32930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":32930},{"type":"v1","addr":"172.21.2.105:6814","nonce":32930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":32930},{"type":"v1","addr":"172.21.2.105:6822","nonce":32930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":32930},{"type":"v1","addr":"172.21.2.105:6818","nonce":32930}]},"public_addr":"172.21.2.105:6810/32930","cluster_addr":"172.21.2.105:6814/32930","heartbeat_back_addr":"172.21.2.105:6822/32930","heartbeat_front_addr":"172.21.2.105:6818/32930","state":["exists","up"]},{"osd":2,"uuid":"1d28e45c-0790-4762-a4a9-1466c58a19e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6809","nonce":32931},{"type":"v1","addr":"172.21.2.105:6811","nonce":32931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6813","nonce":32931},{"type":"v1","addr":"172.21.2.105:6815","nonce":32931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6821","nonce":32931},{"type":"v1","addr":"172.21.2.105:6823","nonce":32931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6817","nonce":32931},{"type":"v1","addr":"172.21.2.105:6819","nonce":32931}]},"public_addr":"172.21.2.105:6811/32931","cluster_addr":"172.21.2.105:6815/32931","heartbeat_back_addr":"172.21.2.105:6823/32931","heartbeat_front_addr":"172.21.2.105:6819/32931","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:01.726461+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:01.935327+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:01.905535+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-18T10:21:06.473 INFO:tasks.ceph.ceph_manager.cluster1:all up! 2021-11-18T10:21:06.473 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd dump --format=json 2021-11-18T10:21:06.691 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:06.692 INFO:teuthology.orchestra.run.gibba005.stdout:{"epoch":10,"fsid":"a2c35310-9d46-4e5d-be3a-3b110bd4a7c0","created":"2021-11-18T10:20:56.007668+0000","modified":"2021-11-18T10:21:05.952651+0000","last_up_change":"2021-11-18T10:21:03.950481+0000","last_in_change":"2021-11-18T10:20:56.740292+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-11-18T10:21:04.018492+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-18T10:21:04.319309+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"10","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f45c593b-7a94-4304-83ff-60334562c99a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6800","nonce":32929},{"type":"v1","addr":"172.21.2.105:6801","nonce":32929}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6802","nonce":32929},{"type":"v1","addr":"172.21.2.105:6803","nonce":32929}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6806","nonce":32929},{"type":"v1","addr":"172.21.2.105:6807","nonce":32929}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6804","nonce":32929},{"type":"v1","addr":"172.21.2.105:6805","nonce":32929}]},"public_addr":"172.21.2.105:6801/32929","cluster_addr":"172.21.2.105:6803/32929","heartbeat_back_addr":"172.21.2.105:6807/32929","heartbeat_front_addr":"172.21.2.105:6805/32929","state":["exists","up"]},{"osd":1,"uuid":"1230dbfe-2e44-4f8a-bbb5-3aba8f8323b6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6808","nonce":32930},{"type":"v1","addr":"172.21.2.105:6810","nonce":32930}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6812","nonce":32930},{"type":"v1","addr":"172.21.2.105:6814","nonce":32930}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6820","nonce":32930},{"type":"v1","addr":"172.21.2.105:6822","nonce":32930}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6816","nonce":32930},{"type":"v1","addr":"172.21.2.105:6818","nonce":32930}]},"public_addr":"172.21.2.105:6810/32930","cluster_addr":"172.21.2.105:6814/32930","heartbeat_back_addr":"172.21.2.105:6822/32930","heartbeat_front_addr":"172.21.2.105:6818/32930","state":["exists","up"]},{"osd":2,"uuid":"1d28e45c-0790-4762-a4a9-1466c58a19e2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6809","nonce":32931},{"type":"v1","addr":"172.21.2.105:6811","nonce":32931}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6813","nonce":32931},{"type":"v1","addr":"172.21.2.105:6815","nonce":32931}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6821","nonce":32931},{"type":"v1","addr":"172.21.2.105:6823","nonce":32931}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6817","nonce":32931},{"type":"v1","addr":"172.21.2.105:6819","nonce":32931}]},"public_addr":"172.21.2.105:6811/32931","cluster_addr":"172.21.2.105:6815/32931","heartbeat_back_addr":"172.21.2.105:6823/32931","heartbeat_front_addr":"172.21.2.105:6819/32931","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:01.726461+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:01.935327+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:01.905535+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-18T10:21:06.701 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.0 flush_pg_stats 2021-11-18T10:21:06.812 INFO:teuthology.orchestra.run.gibba005.stdout:34359738371 2021-11-18T10:21:06.813 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.1 flush_pg_stats 2021-11-18T10:21:06.924 INFO:teuthology.orchestra.run.gibba005.stdout:34359738371 2021-11-18T10:21:06.925 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 tell osd.2 flush_pg_stats 2021-11-18T10:21:07.036 INFO:teuthology.orchestra.run.gibba005.stdout:34359738370 2021-11-18T10:21:07.037 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.0 2021-11-18T10:21:07.254 INFO:teuthology.orchestra.run.gibba005.stdout:34359738370 2021-11-18T10:21:07.264 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738371 got 34359738370 for osd.0 2021-11-18T10:21:08.265 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.0 2021-11-18T10:21:08.486 INFO:teuthology.orchestra.run.gibba005.stdout:34359738371 2021-11-18T10:21:08.496 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738371 got 34359738371 for osd.0 2021-11-18T10:21:08.497 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.1 2021-11-18T10:21:08.715 INFO:teuthology.orchestra.run.gibba005.stdout:34359738371 2021-11-18T10:21:08.725 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738371 got 34359738371 for osd.1 2021-11-18T10:21:08.725 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 osd last-stat-seq osd.2 2021-11-18T10:21:08.942 INFO:teuthology.orchestra.run.gibba005.stdout:34359738370 2021-11-18T10:21:08.952 INFO:tasks.ceph.ceph_manager.cluster1:need seq 34359738370 got 34359738370 for osd.2 2021-11-18T10:21:08.952 INFO:tasks.ceph.ceph_manager.cluster1:waiting for clean 2021-11-18T10:21:08.953 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2021-11-18T10:21:09.167 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:09.168 INFO:teuthology.orchestra.run.gibba005.stderr:dumped all 2021-11-18T10:21:09.177 INFO:teuthology.orchestra.run.gibba005.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2021-11-18T10:21:07.787588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":37216,"kb_used_data":1416,"kb_used_omap":0,"kb_used_meta":35520,"kb_avail":283078304,"statfs":{"total":289910292480,"available":289872183296,"internally_reserved":0,"allocated":1449984,"data_stored":1245696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":36372480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.833201"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957371+0000","last_change":"2021-11-18T10:21:05.957371+0000","last_active":"2021-11-18T10:21:05.957371+0000","last_peered":"2021-11-18T10:21:05.957371+0000","last_clean":"2021-11-18T10:21:05.957371+0000","last_became_active":"2021-11-18T10:21:05.957199+0000","last_became_peered":"2021-11-18T10:21:05.957199+0000","last_unstale":"2021-11-18T10:21:05.957371+0000","last_undegraded":"2021-11-18T10:21:05.957371+0000","last_fullsized":"2021-11-18T10:21:05.957371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T15:41:15.844316+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957275+0000","last_change":"2021-11-18T10:21:05.957275+0000","last_active":"2021-11-18T10:21:05.957275+0000","last_peered":"2021-11-18T10:21:05.957275+0000","last_clean":"2021-11-18T10:21:05.957275+0000","last_became_active":"2021-11-18T10:21:05.957076+0000","last_became_peered":"2021-11-18T10:21:05.957076+0000","last_unstale":"2021-11-18T10:21:05.957275+0000","last_undegraded":"2021-11-18T10:21:05.957275+0000","last_fullsized":"2021-11-18T10:21:05.957275+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T15:08:15.707218+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957551+0000","last_change":"2021-11-18T10:21:05.957551+0000","last_active":"2021-11-18T10:21:05.957551+0000","last_peered":"2021-11-18T10:21:05.957551+0000","last_clean":"2021-11-18T10:21:05.957551+0000","last_became_active":"2021-11-18T10:21:05.957353+0000","last_became_peered":"2021-11-18T10:21:05.957353+0000","last_unstale":"2021-11-18T10:21:05.957551+0000","last_undegraded":"2021-11-18T10:21:05.957551+0000","last_fullsized":"2021-11-18T10:21:05.957551+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T14:46:33.019393+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.958285+0000","last_change":"2021-11-18T10:21:05.958285+0000","last_active":"2021-11-18T10:21:05.958285+0000","last_peered":"2021-11-18T10:21:05.958285+0000","last_clean":"2021-11-18T10:21:05.958285+0000","last_became_active":"2021-11-18T10:21:05.958132+0000","last_became_peered":"2021-11-18T10:21:05.958132+0000","last_unstale":"2021-11-18T10:21:05.958285+0000","last_undegraded":"2021-11-18T10:21:05.958285+0000","last_fullsized":"2021-11-18T10:21:05.958285+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:21:37.331222+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'97","reported_seq":135,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:06.219275+0000","last_change":"2021-11-18T10:21:05.957821+0000","last_active":"2021-11-18T10:21:06.219275+0000","last_peered":"2021-11-18T10:21:06.219275+0000","last_clean":"2021-11-18T10:21:06.219275+0000","last_became_active":"2021-11-18T10:21:05.957231+0000","last_became_peered":"2021-11-18T10:21:05.957231+0000","last_unstale":"2021-11-18T10:21:06.219275+0000","last_undegraded":"2021-11-18T10:21:06.219275+0000","last_fullsized":"2021-11-18T10:21:06.219275+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:48:13.960301+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957347+0000","last_change":"2021-11-18T10:21:05.957347+0000","last_active":"2021-11-18T10:21:05.957347+0000","last_peered":"2021-11-18T10:21:05.957347+0000","last_clean":"2021-11-18T10:21:05.957347+0000","last_became_active":"2021-11-18T10:21:05.957121+0000","last_became_peered":"2021-11-18T10:21:05.957121+0000","last_unstale":"2021-11-18T10:21:05.957347+0000","last_undegraded":"2021-11-18T10:21:05.957347+0000","last_fullsized":"2021-11-18T10:21:05.957347+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:57:23.672166+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957256+0000","last_change":"2021-11-18T10:21:05.957256+0000","last_active":"2021-11-18T10:21:05.957256+0000","last_peered":"2021-11-18T10:21:05.957256+0000","last_clean":"2021-11-18T10:21:05.957256+0000","last_became_active":"2021-11-18T10:21:05.957068+0000","last_became_peered":"2021-11-18T10:21:05.957068+0000","last_unstale":"2021-11-18T10:21:05.957256+0000","last_undegraded":"2021-11-18T10:21:05.957256+0000","last_fullsized":"2021-11-18T10:21:05.957256+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T19:01:38.419264+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.958035+0000","last_change":"2021-11-18T10:21:05.958035+0000","last_active":"2021-11-18T10:21:05.958035+0000","last_peered":"2021-11-18T10:21:05.958035+0000","last_clean":"2021-11-18T10:21:05.958035+0000","last_became_active":"2021-11-18T10:21:05.957809+0000","last_became_peered":"2021-11-18T10:21:05.957809+0000","last_unstale":"2021-11-18T10:21:05.958035+0000","last_undegraded":"2021-11-18T10:21:05.958035+0000","last_fullsized":"2021-11-18T10:21:05.958035+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T14:06:09.803105+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957537+0000","last_change":"2021-11-18T10:21:05.957537+0000","last_active":"2021-11-18T10:21:05.957537+0000","last_peered":"2021-11-18T10:21:05.957537+0000","last_clean":"2021-11-18T10:21:05.957537+0000","last_became_active":"2021-11-18T10:21:05.957105+0000","last_became_peered":"2021-11-18T10:21:05.957105+0000","last_unstale":"2021-11-18T10:21:05.957537+0000","last_undegraded":"2021-11-18T10:21:05.957537+0000","last_fullsized":"2021-11-18T10:21:05.957537+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T18:53:38.687909+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11676,"kb_used_data":84,"kb_used_omap":0,"kb_used_meta":11584,"kb_avail":94360164,"statfs":{"total":96636764160,"available":96624807936,"internally_reserved":0,"allocated":86016,"data_stored":21291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11862016},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12772,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359068,"statfs":{"total":96636764160,"available":96623685632,"internally_reserved":0,"allocated":684032,"data_stored":612746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.10199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17999999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12768,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359072,"statfs":{"total":96636764160,"available":96623689728,"internally_reserved":0,"allocated":679936,"data_stored":611659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-11-18T10:21:09.179 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 pg dump --format=json 2021-11-18T10:21:09.395 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:09.395 INFO:teuthology.orchestra.run.gibba005.stderr:dumped all 2021-11-18T10:21:09.404 INFO:teuthology.orchestra.run.gibba005.stdout:{"pg_ready":true,"pg_map":{"version":11,"stamp":"2021-11-18T10:21:07.787588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":37216,"kb_used_data":1416,"kb_used_omap":0,"kb_used_meta":35520,"kb_avail":283078304,"statfs":{"total":289910292480,"available":289872183296,"internally_reserved":0,"allocated":1449984,"data_stored":1245696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":36372480},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.833201"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957371+0000","last_change":"2021-11-18T10:21:05.957371+0000","last_active":"2021-11-18T10:21:05.957371+0000","last_peered":"2021-11-18T10:21:05.957371+0000","last_clean":"2021-11-18T10:21:05.957371+0000","last_became_active":"2021-11-18T10:21:05.957199+0000","last_became_peered":"2021-11-18T10:21:05.957199+0000","last_unstale":"2021-11-18T10:21:05.957371+0000","last_undegraded":"2021-11-18T10:21:05.957371+0000","last_fullsized":"2021-11-18T10:21:05.957371+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T15:41:15.844316+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957275+0000","last_change":"2021-11-18T10:21:05.957275+0000","last_active":"2021-11-18T10:21:05.957275+0000","last_peered":"2021-11-18T10:21:05.957275+0000","last_clean":"2021-11-18T10:21:05.957275+0000","last_became_active":"2021-11-18T10:21:05.957076+0000","last_became_peered":"2021-11-18T10:21:05.957076+0000","last_unstale":"2021-11-18T10:21:05.957275+0000","last_undegraded":"2021-11-18T10:21:05.957275+0000","last_fullsized":"2021-11-18T10:21:05.957275+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T15:08:15.707218+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957551+0000","last_change":"2021-11-18T10:21:05.957551+0000","last_active":"2021-11-18T10:21:05.957551+0000","last_peered":"2021-11-18T10:21:05.957551+0000","last_clean":"2021-11-18T10:21:05.957551+0000","last_became_active":"2021-11-18T10:21:05.957353+0000","last_became_peered":"2021-11-18T10:21:05.957353+0000","last_unstale":"2021-11-18T10:21:05.957551+0000","last_undegraded":"2021-11-18T10:21:05.957551+0000","last_fullsized":"2021-11-18T10:21:05.957551+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T14:46:33.019393+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.958285+0000","last_change":"2021-11-18T10:21:05.958285+0000","last_active":"2021-11-18T10:21:05.958285+0000","last_peered":"2021-11-18T10:21:05.958285+0000","last_clean":"2021-11-18T10:21:05.958285+0000","last_became_active":"2021-11-18T10:21:05.958132+0000","last_became_peered":"2021-11-18T10:21:05.958132+0000","last_unstale":"2021-11-18T10:21:05.958285+0000","last_undegraded":"2021-11-18T10:21:05.958285+0000","last_fullsized":"2021-11-18T10:21:05.958285+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:21:37.331222+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"10'97","reported_seq":135,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:06.219275+0000","last_change":"2021-11-18T10:21:05.957821+0000","last_active":"2021-11-18T10:21:06.219275+0000","last_peered":"2021-11-18T10:21:06.219275+0000","last_clean":"2021-11-18T10:21:06.219275+0000","last_became_active":"2021-11-18T10:21:05.957231+0000","last_became_peered":"2021-11-18T10:21:05.957231+0000","last_unstale":"2021-11-18T10:21:06.219275+0000","last_undegraded":"2021-11-18T10:21:06.219275+0000","last_fullsized":"2021-11-18T10:21:06.219275+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:48:13.960301+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957347+0000","last_change":"2021-11-18T10:21:05.957347+0000","last_active":"2021-11-18T10:21:05.957347+0000","last_peered":"2021-11-18T10:21:05.957347+0000","last_clean":"2021-11-18T10:21:05.957347+0000","last_became_active":"2021-11-18T10:21:05.957121+0000","last_became_peered":"2021-11-18T10:21:05.957121+0000","last_unstale":"2021-11-18T10:21:05.957347+0000","last_undegraded":"2021-11-18T10:21:05.957347+0000","last_fullsized":"2021-11-18T10:21:05.957347+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:57:23.672166+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957256+0000","last_change":"2021-11-18T10:21:05.957256+0000","last_active":"2021-11-18T10:21:05.957256+0000","last_peered":"2021-11-18T10:21:05.957256+0000","last_clean":"2021-11-18T10:21:05.957256+0000","last_became_active":"2021-11-18T10:21:05.957068+0000","last_became_peered":"2021-11-18T10:21:05.957068+0000","last_unstale":"2021-11-18T10:21:05.957256+0000","last_undegraded":"2021-11-18T10:21:05.957256+0000","last_fullsized":"2021-11-18T10:21:05.957256+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T19:01:38.419264+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.958035+0000","last_change":"2021-11-18T10:21:05.958035+0000","last_active":"2021-11-18T10:21:05.958035+0000","last_peered":"2021-11-18T10:21:05.958035+0000","last_clean":"2021-11-18T10:21:05.958035+0000","last_became_active":"2021-11-18T10:21:05.957809+0000","last_became_peered":"2021-11-18T10:21:05.957809+0000","last_unstale":"2021-11-18T10:21:05.958035+0000","last_undegraded":"2021-11-18T10:21:05.958035+0000","last_fullsized":"2021-11-18T10:21:05.958035+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T14:06:09.803105+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":8,"reported_epoch":10,"state":"active+clean","last_fresh":"2021-11-18T10:21:05.957537+0000","last_change":"2021-11-18T10:21:05.957537+0000","last_active":"2021-11-18T10:21:05.957537+0000","last_peered":"2021-11-18T10:21:05.957537+0000","last_clean":"2021-11-18T10:21:05.957537+0000","last_became_active":"2021-11-18T10:21:05.957105+0000","last_became_peered":"2021-11-18T10:21:05.957105+0000","last_unstale":"2021-11-18T10:21:05.957537+0000","last_undegraded":"2021-11-18T10:21:05.957537+0000","last_fullsized":"2021-11-18T10:21:05.957537+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":9,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:04.951445+0000","last_clean_scrub_stamp":"2021-11-18T10:21:04.951445+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T18:53:38.687909+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738370,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11676,"kb_used_data":84,"kb_used_omap":0,"kb_used_meta":11584,"kb_avail":94360164,"statfs":{"total":96636764160,"available":96624807936,"internally_reserved":0,"allocated":86016,"data_stored":21291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11862016},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]}]},{"osd":0,"up_from":8,"seq":34359738371,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12772,"kb_used_data":668,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359068,"statfs":{"total":96636764160,"available":96623685632,"internally_reserved":0,"allocated":684032,"data_stored":612746,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.10199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17999999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738371,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12768,"kb_used_data":664,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359072,"statfs":{"total":96636764160,"available":96623689728,"internally_reserved":0,"allocated":679936,"data_stored":611659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-11-18T10:21:09.406 INFO:tasks.ceph.ceph_manager.cluster1:clean! 2021-11-18T10:21:09.407 INFO:tasks.ceph:Waiting until ceph cluster cluster1 is healthy... 2021-11-18T10:21:09.407 INFO:tasks.ceph.ceph_manager.cluster1:wait_until_healthy 2021-11-18T10:21:09.407 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster1 health --format=json 2021-11-18T10:21:09.650 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:09.651 INFO:teuthology.orchestra.run.gibba005.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-11-18T10:21:09.660 INFO:tasks.ceph.ceph_manager.cluster1:wait_until_healthy done 2021-11-18T10:21:09.661 INFO:teuthology.run_tasks:Running task ceph... 2021-11-18T10:21:09.672 INFO:tasks.ceph:Creating ceph cluster cluster2... 2021-11-18T10:21:09.673 INFO:tasks.ceph:config {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'cluster2', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2021-11-18T10:21:09.673 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2021-11-15_02:01:02-rbd-master-distro-default-gibba/6503461', 'branch': 'master', 'description': 'rbd/mirror-thrash/{base/install clients/mirror cluster/{2-node openstack} msgr-failures/few objectstore/bluestore-hybrid policy/simple rbd-mirror/four-per-cluster supported-random-distro$/{centos_8} workloads/rbd-mirror-snapshot-stress-workunit-exclusive-lock}', 'email': 'ceph-qa@ceph.io', 'first_in_suite': False, 'job_id': '6503461', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'gibba', 'meta': [{'desc': 'run two ceph clusters and install rbd-mirror'}, {'desc': 'configure the permissions for client.mirror'}, {'desc': '2 ceph clusters with 1 mon and 3 osds each'}, {'desc': 'run four rbd-mirror daemons per cluster'}, {'desc': 'run the rbd_mirror_stress.sh workunit to test the rbd-mirror daemon'}], 'name': 'teuthology-2021-11-15_02:01:02-rbd-master-distro-default-gibba', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 30}}], 'os_type': 'centos', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'master'}, 'ceph': {'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'master', 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 1000, 'repo': 'https://github.com/ceph/ceph.git', 'roles': [['cluster1.mon.a', 'cluster1.mgr.x', 'cluster2.mgr.x', 'cluster1.osd.0', 'cluster1.osd.1', 'cluster1.osd.2', 'cluster1.client.0', 'cluster2.client.0'], ['cluster2.mon.a', 'cluster2.osd.0', 'cluster2.osd.1', 'cluster2.osd.2', 'cluster1.client.mirror', 'cluster1.client.mirror.0', 'cluster1.client.mirror.1', 'cluster1.client.mirror.2', 'cluster1.client.mirror.3', 'cluster1.client.mirror.4', 'cluster1.client.mirror.5', 'cluster1.client.mirror.6', 'cluster2.client.mirror', 'cluster2.client.mirror.0', 'cluster2.client.mirror.1', 'cluster2.client.mirror.2', 'cluster2.client.mirror.3', 'cluster2.client.mirror.4', 'cluster2.client.mirror.5', 'cluster2.client.mirror.6']], 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f', 'sleep_before_teardown': 0, 'suite': 'rbd', 'suite_branch': 'master', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_44cd7c7650ed2227d3597352b00bd2ef65f4388f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph.git', 'suite_sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f', 'targets': {'gibba005.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDNiR1RqNqSftUOVGBiSU14AICZY8bEQYJD+zFAQmbYcV8dqVM2O6OspTmMlFXqme9oybYX6b0Wz1KYL5OAi+4QqU6kpiUhay1jAcoplneO95QnkpnEeC7SshfACme6Q7VPEQADdKMvB6i/ZAPbjG38FajSbX1+err7kFlcvaI5Cdi9zUuctG6PXGalivEgSCfZGrY69lLMUpbaxoKliQ7yCVOpvGYkpykzoMN06mCSdgE2dKEqrw438SmGD33T9qJPTk+5MLH1xYIFzbPlZLhQaNXqUDrKWeoHiJW4hLeBqLqddvSXA04+HmXb74b/lrObsmJ1czaZLIyeNQ7+2eBSm2Ddk1nUOk0ItK0XhC2iOxfZsXyCJ9EOJpXN3sB6NLBQSC0Vbq9R5LrC/OBhk4FTlgWwPpGIf+MVHIfDLu7Q5FO99lYiVHZC5BLu6fFtB/37zJXDZvQZn0d+6e2ergWNBOrukuFWyQ6WbHP5+S4UuloGC9DkzNI6PgbyY0vAyKU=', 'gibba019.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC1zpyjLs/XrLyk2CdygXDeA7ImscLQ62Xf41IuMr15/X4ICxR0/juDU0y9kqXl8x3tqiGdswB0HyTDIZayyt97N2N7/6jru0nljN4SeKrZrHnoJVxB570CCGHmD99wSxkQLl6Ho6SI1jdlsycAuslQvsag1rcH1ti74mMe3Pmz7U/1XMHlpEVuTDfKzY3lUfnkBr5WJ0p4c39TSxHc+M+jMQsE39lsL3OOdfjZrnGVFeduc6WYvg7PeDv7PoKjZhe+TI7WnJHi5S/aX6ggQ3CTg8q/c3wgQkHa4kYQkVilNV42vkwjE0gES570IWj4iFG0hiDbb+CvHkQIzSnTRTE4VPDiCA7tq6pc+fQrNIcxQNAvbhjvwNFIQgOueNYeDb3awS787a8u4YEW5JYaglLhElANQOxOsBtKaDQVKVkRCPYYnyWv9ofsTrVG71nFlBMXgr5xooVGjMiveyQ7EzejNWauMuhYiQsboOqQD4BQYJ715hzcd29QgpFg53ohDgs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': ['rbd-mirror'], 'flavor': 'default', 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}}, {'ceph': {'cluster': 'cluster1', 'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}}, {'ceph': {'cluster': 'cluster2', 'conf': {'client': {'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '44cd7c7650ed2227d3597352b00bd2ef65f4388f'}}, {'exec': {'cluster1.client.mirror.0': ["sudo ceph --cluster cluster1 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster1 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror mon 'profile rbd-mirror-peer' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.0 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.1 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.2 mon 'profile rbd-mirror' osd 'profile rbd'", "sudo ceph --cluster cluster2 auth caps client.mirror.3 mon 'profile rbd-mirror' osd 'profile rbd'"]}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster1.client.mirror.3', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.0', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.1', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.2', 'thrash': True}}, {'rbd-mirror': {'client': 'cluster2.client.mirror.3', 'thrash': True}}, {'rbd-mirror-thrash': {'cluster': 'cluster1'}}, {'rbd-mirror-thrash': {'cluster': 'cluster2'}}, {'workunit': {'clients': {'cluster1.client.mirror': ['rbd/rbd_mirror_stress.sh']}, 'env': {'CEPH_ARGS': '', 'MIRROR_IMAGE_MODE': 'snapshot', 'MIRROR_POOL_MODE': 'image', 'RBD_IMAGE_FEATURES': 'layering,exclusive-lock', 'RBD_MIRROR_INSTANCES': '4', 'RBD_MIRROR_USE_EXISTING_CLUSTER': '1', 'RBD_MIRROR_USE_RBD_MIRROR': '1'}, 'timeout': '6h'}}], 'teuthology_branch': 'master', 'teuthology_sha1': 'd4737010a85099043cf081dc05b4069d301b23fb', 'timestamp': '2021-11-15_02:01:02', 'tube': 'gibba', 'user': 'teuthology', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.gibba.19943'} 2021-11-18T10:21:09.674 DEBUG:teuthology.orchestra.run.gibba005:> install -d -m0755 -- /home/ubuntu/cephtest/cluster2.data 2021-11-18T10:21:09.677 DEBUG:teuthology.orchestra.run.gibba019:> install -d -m0755 -- /home/ubuntu/cephtest/cluster2.data 2021-11-18T10:21:09.690 DEBUG:teuthology.orchestra.run.gibba005:> sudo install -d -m0777 -- /var/run/ceph 2021-11-18T10:21:09.729 DEBUG:teuthology.orchestra.run.gibba019:> sudo install -d -m0777 -- /var/run/ceph 2021-11-18T10:21:09.749 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:09.750 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/scratch_devs of=/dev/stdout 2021-11-18T10:21:09.801 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-11-18T10:21:09.801 DEBUG:teuthology.orchestra.run.gibba019:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-11-18T10:21:09.853 INFO:teuthology.orchestra.run.gibba019.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-11-18T10:21:09.853 INFO:teuthology.orchestra.run.gibba019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-18T10:21:09.854 INFO:teuthology.orchestra.run.gibba019.stdout:Device: 6h/6d Inode: 121991 Links: 1 2021-11-18T10:21:09.854 INFO:teuthology.orchestra.run.gibba019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-18T10:21:09.854 INFO:teuthology.orchestra.run.gibba019.stdout:Context: system_u:object_r:device_t:s0 2021-11-18T10:21:09.854 INFO:teuthology.orchestra.run.gibba019.stdout:Access: 2021-11-18 10:20:36.725125494 +0000 2021-11-18T10:21:09.855 INFO:teuthology.orchestra.run.gibba019.stdout:Modify: 2021-11-18 10:17:53.784595938 +0000 2021-11-18T10:21:09.855 INFO:teuthology.orchestra.run.gibba019.stdout:Change: 2021-11-18 10:17:53.784595938 +0000 2021-11-18T10:21:09.855 INFO:teuthology.orchestra.run.gibba019.stdout: Birth: - 2021-11-18T10:21:09.860 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records in 2021-11-18T10:21:09.860 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records out 2021-11-18T10:21:09.860 INFO:teuthology.orchestra.run.gibba019.stderr:512 bytes copied, 0.000167808 s, 3.1 MB/s 2021-11-18T10:21:09.862 DEBUG:teuthology.orchestra.run.gibba019:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-11-18T10:21:09.915 INFO:teuthology.orchestra.run.gibba019.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-11-18T10:21:09.916 INFO:teuthology.orchestra.run.gibba019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-18T10:21:09.916 INFO:teuthology.orchestra.run.gibba019.stdout:Device: 6h/6d Inode: 108330 Links: 1 2021-11-18T10:21:09.916 INFO:teuthology.orchestra.run.gibba019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-18T10:21:09.917 INFO:teuthology.orchestra.run.gibba019.stdout:Context: system_u:object_r:device_t:s0 2021-11-18T10:21:09.917 INFO:teuthology.orchestra.run.gibba019.stdout:Access: 2021-11-18 10:20:36.725125494 +0000 2021-11-18T10:21:09.917 INFO:teuthology.orchestra.run.gibba019.stdout:Modify: 2021-11-18 10:17:54.101594293 +0000 2021-11-18T10:21:09.917 INFO:teuthology.orchestra.run.gibba019.stdout:Change: 2021-11-18 10:17:54.101594293 +0000 2021-11-18T10:21:09.918 INFO:teuthology.orchestra.run.gibba019.stdout: Birth: - 2021-11-18T10:21:09.923 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records in 2021-11-18T10:21:09.923 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records out 2021-11-18T10:21:09.923 INFO:teuthology.orchestra.run.gibba019.stderr:512 bytes copied, 0.000165577 s, 3.1 MB/s 2021-11-18T10:21:09.925 DEBUG:teuthology.orchestra.run.gibba019:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-11-18T10:21:09.977 INFO:teuthology.orchestra.run.gibba019.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-11-18T10:21:09.978 INFO:teuthology.orchestra.run.gibba019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-18T10:21:09.978 INFO:teuthology.orchestra.run.gibba019.stdout:Device: 6h/6d Inode: 113291 Links: 1 2021-11-18T10:21:09.978 INFO:teuthology.orchestra.run.gibba019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-18T10:21:09.978 INFO:teuthology.orchestra.run.gibba019.stdout:Context: system_u:object_r:device_t:s0 2021-11-18T10:21:09.979 INFO:teuthology.orchestra.run.gibba019.stdout:Access: 2021-11-18 10:20:36.725125494 +0000 2021-11-18T10:21:09.979 INFO:teuthology.orchestra.run.gibba019.stdout:Modify: 2021-11-18 10:17:54.401592736 +0000 2021-11-18T10:21:09.979 INFO:teuthology.orchestra.run.gibba019.stdout:Change: 2021-11-18 10:17:54.401592736 +0000 2021-11-18T10:21:09.979 INFO:teuthology.orchestra.run.gibba019.stdout: Birth: - 2021-11-18T10:21:09.984 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records in 2021-11-18T10:21:09.985 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records out 2021-11-18T10:21:09.985 INFO:teuthology.orchestra.run.gibba019.stderr:512 bytes copied, 0.000204803 s, 2.5 MB/s 2021-11-18T10:21:09.987 DEBUG:teuthology.orchestra.run.gibba019:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-11-18T10:21:10.038 INFO:teuthology.orchestra.run.gibba019.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-11-18T10:21:10.038 INFO:teuthology.orchestra.run.gibba019.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-11-18T10:21:10.039 INFO:teuthology.orchestra.run.gibba019.stdout:Device: 6h/6d Inode: 113354 Links: 1 2021-11-18T10:21:10.039 INFO:teuthology.orchestra.run.gibba019.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-11-18T10:21:10.039 INFO:teuthology.orchestra.run.gibba019.stdout:Context: system_u:object_r:device_t:s0 2021-11-18T10:21:10.039 INFO:teuthology.orchestra.run.gibba019.stdout:Access: 2021-11-18 10:20:36.725125494 +0000 2021-11-18T10:21:10.039 INFO:teuthology.orchestra.run.gibba019.stdout:Modify: 2021-11-18 10:17:54.735591003 +0000 2021-11-18T10:21:10.040 INFO:teuthology.orchestra.run.gibba019.stdout:Change: 2021-11-18 10:17:54.735591003 +0000 2021-11-18T10:21:10.040 INFO:teuthology.orchestra.run.gibba019.stdout: Birth: - 2021-11-18T10:21:10.045 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records in 2021-11-18T10:21:10.045 INFO:teuthology.orchestra.run.gibba019.stderr:1+0 records out 2021-11-18T10:21:10.045 INFO:teuthology.orchestra.run.gibba019.stderr:512 bytes copied, 0.0001751 s, 2.9 MB/s 2021-11-18T10:21:10.047 INFO:tasks.ceph:osd dev map: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-18T10:21:10.047 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@gibba019.front.sepia.ceph.com'): {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-11-18T10:21:10.048 INFO:tasks.ceph:Generating config... 2021-11-18T10:21:10.049 INFO:tasks.ceph:[client] debug rbd = 20 2021-11-18T10:21:10.049 INFO:tasks.ceph:[client] debug rbd_mirror = 15 2021-11-18T10:21:10.050 INFO:tasks.ceph:[client] log to stderr = False 2021-11-18T10:21:10.050 INFO:tasks.ceph:[client] rbd default features = 125 2021-11-18T10:21:10.050 INFO:tasks.ceph:[client] rbd mirror image policy type = simple 2021-11-18T10:21:10.051 INFO:tasks.ceph:[client.mirror.0] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.051 INFO:tasks.ceph:[client.mirror.0] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.051 INFO:tasks.ceph:[client.mirror.1] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.052 INFO:tasks.ceph:[client.mirror.1] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.052 INFO:tasks.ceph:[client.mirror.2] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.052 INFO:tasks.ceph:[client.mirror.2] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.052 INFO:tasks.ceph:[client.mirror.3] admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.053 INFO:tasks.ceph:[client.mirror.3] pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.053 INFO:tasks.ceph:[global] mon client directed command retry = 5 2021-11-18T10:21:10.053 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2021-11-18T10:21:10.054 INFO:tasks.ceph:[mgr] debug mgr = 20 2021-11-18T10:21:10.054 INFO:tasks.ceph:[mgr] debug ms = 1 2021-11-18T10:21:10.054 INFO:tasks.ceph:[mon] debug mon = 20 2021-11-18T10:21:10.055 INFO:tasks.ceph:[mon] debug ms = 1 2021-11-18T10:21:10.055 INFO:tasks.ceph:[mon] debug paxos = 20 2021-11-18T10:21:10.055 INFO:tasks.ceph:[osd] bluefs allocator = hybrid 2021-11-18T10:21:10.055 INFO:tasks.ceph:[osd] bluestore allocator = hybrid 2021-11-18T10:21:10.056 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2021-11-18T10:21:10.056 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2021-11-18T10:21:10.056 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2021-11-18T10:21:10.057 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2021-11-18T10:21:10.057 INFO:tasks.ceph:[osd] debug ms = 1 2021-11-18T10:21:10.057 INFO:tasks.ceph:[osd] debug osd = 20 2021-11-18T10:21:10.058 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2021-11-18T10:21:10.058 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2021-11-18T10:21:10.058 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2021-11-18T10:21:10.058 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2021-11-18T10:21:10.059 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2021-11-18T10:21:10.059 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2021-11-18T10:21:10.059 INFO:tasks.ceph:Setting up cluster2.mon.a... 2021-11-18T10:21:10.060 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/cluster2.keyring 2021-11-18T10:21:10.115 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster2.keyring 2021-11-18T10:21:10.116 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/cluster2.keyring 2021-11-18T10:21:10.185 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2021-11-18T10:21:10.244 DEBUG:tasks.ceph:Ceph mon addresses: [('cluster2.mon.a', '172.21.2.119')] 2021-11-18T10:21:10.244 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.2.119', 'mon client directed command retry': 5, 'ms inject socket failures': 5000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluefs allocator': 'hybrid', 'bluestore allocator': 'hybrid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rbd': 20, 'debug rbd_mirror': 15, 'log to stderr': False, 'rbd default features': 125, 'rbd mirror image policy type': 'simple'}, 'mon.a': {}, 'client.mirror.0': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.1': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.2': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}, 'client.mirror.3': {'admin socket': '/var/run/ceph/rbd-mirror.$cluster-$name.asok', 'pid file': '/var/run/ceph/rbd-mirror.$cluster-$name.pid'}} 2021-11-18T10:21:10.246 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:10.246 DEBUG:teuthology.orchestra.run.gibba019:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2021-11-18T10:21:10.295 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.2.119 --print /home/ubuntu/cephtest/cluster2.monmap 2021-11-18T10:21:10.362 INFO:teuthology.orchestra.run.gibba019.stdout:monmaptool: monmap file /home/ubuntu/cephtest/cluster2.monmap 2021-11-18T10:21:10.362 INFO:teuthology.orchestra.run.gibba019.stdout:monmaptool: generated fsid 0e3c81ae-f64c-415d-9409-6e21fdce6c71 2021-11-18T10:21:10.363 INFO:teuthology.orchestra.run.gibba019.stdout:setting min_mon_release = octopus 2021-11-18T10:21:10.363 INFO:teuthology.orchestra.run.gibba019.stdout:epoch 0 2021-11-18T10:21:10.363 INFO:teuthology.orchestra.run.gibba019.stdout:fsid 0e3c81ae-f64c-415d-9409-6e21fdce6c71 2021-11-18T10:21:10.363 INFO:teuthology.orchestra.run.gibba019.stdout:last_changed 2021-11-18T10:21:10.364660+0000 2021-11-18T10:21:10.364 INFO:teuthology.orchestra.run.gibba019.stdout:created 2021-11-18T10:21:10.364660+0000 2021-11-18T10:21:10.364 INFO:teuthology.orchestra.run.gibba019.stdout:min_mon_release 15 (octopus) 2021-11-18T10:21:10.364 INFO:teuthology.orchestra.run.gibba019.stdout:election_strategy: 1 2021-11-18T10:21:10.364 INFO:teuthology.orchestra.run.gibba019.stdout:0: [v2:172.21.2.119:3300/0,v1:172.21.2.119:6789/0] mon.a 2021-11-18T10:21:10.364 INFO:teuthology.orchestra.run.gibba019.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/cluster2.monmap (1 monitors) 2021-11-18T10:21:10.366 DEBUG:teuthology.orchestra.run.gibba019:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2021-11-18T10:21:10.418 INFO:tasks.ceph:Writing /etc/ceph/cluster2.conf for FSID 0e3c81ae-f64c-415d-9409-6e21fdce6c71... 2021-11-18T10:21:10.420 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster2.conf && sudo chmod 0644 /etc/ceph/cluster2.conf > /dev/null 2021-11-18T10:21:10.422 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/cluster2.conf && sudo chmod 0644 /etc/ceph/cluster2.conf > /dev/null 2021-11-18T10:21:10.463 INFO:teuthology.orchestra.run.gibba005.stdout:[global] 2021-11-18T10:21:10.463 INFO:teuthology.orchestra.run.gibba005.stdout: chdir = "" 2021-11-18T10:21:10.463 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-18T10:21:10.464 INFO:teuthology.orchestra.run.gibba005.stdout: auth supported = cephx 2021-11-18T10:21:10.464 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.464 INFO:teuthology.orchestra.run.gibba005.stdout: filestore xattr use omap = true 2021-11-18T10:21:10.464 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.465 INFO:teuthology.orchestra.run.gibba005.stdout: mon clock drift allowed = 1.000 2021-11-18T10:21:10.465 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.465 INFO:teuthology.orchestra.run.gibba005.stdout: osd crush chooseleaf type = 0 2021-11-18T10:21:10.465 INFO:teuthology.orchestra.run.gibba005.stdout: auth debug = true 2021-11-18T10:21:10.465 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.466 INFO:teuthology.orchestra.run.gibba005.stdout: ms die on old message = true 2021-11-18T10:21:10.466 INFO:teuthology.orchestra.run.gibba005.stdout: ms die on bug = true 2021-11-18T10:21:10.466 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.466 INFO:teuthology.orchestra.run.gibba005.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-18T10:21:10.467 INFO:teuthology.orchestra.run.gibba005.stdout: mon pg warn max object skew = 0 2021-11-18T10:21:10.467 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.467 INFO:teuthology.orchestra.run.gibba005.stdout: # disable pg_autoscaler by default for new pools 2021-11-18T10:21:10.467 INFO:teuthology.orchestra.run.gibba005.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-18T10:21:10.468 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.468 INFO:teuthology.orchestra.run.gibba005.stdout: osd pool default size = 2 2021-11-18T10:21:10.468 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.468 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd allow primary affinity = true 2021-11-18T10:21:10.469 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd allow pg remap = true 2021-11-18T10:21:10.469 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on legacy crush tunables = false 2021-11-18T10:21:10.469 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on crush straw calc version zero = false 2021-11-18T10:21:10.469 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on no sortbitwise = false 2021-11-18T10:21:10.469 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on osd down out interval zero = false 2021-11-18T10:21:10.470 INFO:teuthology.orchestra.run.gibba005.stdout: mon warn on too few osds = false 2021-11-18T10:21:10.470 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-18T10:21:10.470 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-18T10:21:10.470 INFO:teuthology.orchestra.run.gibba005.stdout: mon_allow_pool_size_one = true 2021-11-18T10:21:10.471 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.471 INFO:teuthology.orchestra.run.gibba005.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-11-18T10:21:10.471 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.471 INFO:teuthology.orchestra.run.gibba005.stdout: osd default data pool replay window = 5 2021-11-18T10:21:10.471 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.472 INFO:teuthology.orchestra.run.gibba005.stdout: mon allow pool delete = true 2021-11-18T10:21:10.472 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.472 INFO:teuthology.orchestra.run.gibba005.stdout: mon cluster log file level = debug 2021-11-18T10:21:10.472 INFO:teuthology.orchestra.run.gibba005.stdout: debug asserts on shutdown = true 2021-11-18T10:21:10.473 INFO:teuthology.orchestra.run.gibba005.stdout: mon health detail to clog = false 2021-11-18T10:21:10.473 INFO:teuthology.orchestra.run.gibba005.stdout: mon host = 172.21.2.119 2021-11-18T10:21:10.473 INFO:teuthology.orchestra.run.gibba005.stdout: mon client directed command retry = 5 2021-11-18T10:21:10.473 INFO:teuthology.orchestra.run.gibba005.stdout: ms inject socket failures = 5000 2021-11-18T10:21:10.473 INFO:teuthology.orchestra.run.gibba005.stdout: fsid = 0e3c81ae-f64c-415d-9409-6e21fdce6c71 2021-11-18T10:21:10.474 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.474 INFO:teuthology.orchestra.run.gibba005.stdout:[osd] 2021-11-18T10:21:10.474 INFO:teuthology.orchestra.run.gibba005.stdout: osd journal size = 100 2021-11-18T10:21:10.474 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.475 INFO:teuthology.orchestra.run.gibba005.stdout: osd scrub load threshold = 5.0 2021-11-18T10:21:10.475 INFO:teuthology.orchestra.run.gibba005.stdout: osd scrub max interval = 600 2021-11-18T10:21:10.475 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.475 INFO:teuthology.orchestra.run.gibba005.stdout: osd recover clone overlap = true 2021-11-18T10:21:10.475 INFO:teuthology.orchestra.run.gibba005.stdout: osd recovery max chunk = 1048576 2021-11-18T10:21:10.476 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.476 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug shutdown = true 2021-11-18T10:21:10.476 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug op order = true 2021-11-18T10:21:10.476 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug verify stray on activate = true 2021-11-18T10:21:10.477 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.477 INFO:teuthology.orchestra.run.gibba005.stdout: osd open classes on start = true 2021-11-18T10:21:10.477 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug pg log writeout = true 2021-11-18T10:21:10.477 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.477 INFO:teuthology.orchestra.run.gibba005.stdout: osd deep scrub update digest min age = 30 2021-11-18T10:21:10.478 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.478 INFO:teuthology.orchestra.run.gibba005.stdout: osd map max advance = 10 2021-11-18T10:21:10.478 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.478 INFO:teuthology.orchestra.run.gibba005.stdout: journal zero on create = true 2021-11-18T10:21:10.479 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.479 INFO:teuthology.orchestra.run.gibba005.stdout: filestore ondisk finisher threads = 3 2021-11-18T10:21:10.479 INFO:teuthology.orchestra.run.gibba005.stdout: filestore apply finisher threads = 3 2021-11-18T10:21:10.479 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.479 INFO:teuthology.orchestra.run.gibba005.stdout: bdev debug aio = true 2021-11-18T10:21:10.480 INFO:teuthology.orchestra.run.gibba005.stdout: osd debug misdirected ops = true 2021-11-18T10:21:10.480 INFO:teuthology.orchestra.run.gibba005.stdout: bluefs allocator = hybrid 2021-11-18T10:21:10.480 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore allocator = hybrid 2021-11-18T10:21:10.480 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore block size = 96636764160 2021-11-18T10:21:10.481 INFO:teuthology.orchestra.run.gibba005.stdout: bluestore fsck on mount = True 2021-11-18T10:21:10.481 INFO:teuthology.orchestra.run.gibba005.stdout: debug bluefs = 1/20 2021-11-18T10:21:10.481 INFO:teuthology.orchestra.run.gibba005.stdout: debug bluestore = 1/20 2021-11-18T10:21:10.481 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-18T10:21:10.481 INFO:teuthology.orchestra.run.gibba005.stdout: debug osd = 20 2021-11-18T10:21:10.482 INFO:teuthology.orchestra.run.gibba005.stdout: debug rocksdb = 4/10 2021-11-18T10:21:10.482 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd backfillfull_ratio = 0.85 2021-11-18T10:21:10.482 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd full ratio = 0.9 2021-11-18T10:21:10.483 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd nearfull ratio = 0.8 2021-11-18T10:21:10.483 INFO:teuthology.orchestra.run.gibba005.stdout: osd failsafe full ratio = 0.95 2021-11-18T10:21:10.484 INFO:teuthology.orchestra.run.gibba005.stdout: osd objectstore = bluestore 2021-11-18T10:21:10.484 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.484 INFO:teuthology.orchestra.run.gibba005.stdout:[mgr] 2021-11-18T10:21:10.484 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-18T10:21:10.484 INFO:teuthology.orchestra.run.gibba005.stdout: debug mgr = 20 2021-11-18T10:21:10.485 INFO:teuthology.orchestra.run.gibba005.stdout: debug mon = 20 2021-11-18T10:21:10.485 INFO:teuthology.orchestra.run.gibba005.stdout: debug auth = 20 2021-11-18T10:21:10.485 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min pgs per osd = 4 2021-11-18T10:21:10.485 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min bytes per osd = 10 2021-11-18T10:21:10.486 INFO:teuthology.orchestra.run.gibba005.stdout: mgr/telemetry/nag = false 2021-11-18T10:21:10.486 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.486 INFO:teuthology.orchestra.run.gibba005.stdout:[mon] 2021-11-18T10:21:10.486 INFO:teuthology.orchestra.run.gibba005.stdout: debug ms = 1 2021-11-18T10:21:10.487 INFO:teuthology.orchestra.run.gibba005.stdout: debug mon = 20 2021-11-18T10:21:10.487 INFO:teuthology.orchestra.run.gibba005.stdout: debug paxos = 20 2021-11-18T10:21:10.487 INFO:teuthology.orchestra.run.gibba005.stdout: debug auth = 20 2021-11-18T10:21:10.488 INFO:teuthology.orchestra.run.gibba005.stdout: mon data avail warn = 5 2021-11-18T10:21:10.489 INFO:teuthology.orchestra.run.gibba005.stdout: mon mgr mkfs grace = 240 2021-11-18T10:21:10.489 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min pgs per osd = 4 2021-11-18T10:21:10.490 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd reporter subtree level = osd 2021-11-18T10:21:10.490 INFO:teuthology.orchestra.run.gibba005.stdout: mon osd prime pg temp = true 2021-11-18T10:21:10.490 INFO:teuthology.orchestra.run.gibba005.stdout: mon reweight min bytes per osd = 10 2021-11-18T10:21:10.490 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.491 INFO:teuthology.orchestra.run.gibba005.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-18T10:21:10.491 INFO:teuthology.orchestra.run.gibba005.stdout: auth mon ticket ttl = 660 # 11m 2021-11-18T10:21:10.491 INFO:teuthology.orchestra.run.gibba005.stdout: auth service ticket ttl = 240 # 4m 2021-11-18T10:21:10.491 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.491 INFO:teuthology.orchestra.run.gibba005.stdout: # don't complain about insecure global_id in the test suite 2021-11-18T10:21:10.492 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-18T10:21:10.492 INFO:teuthology.orchestra.run.gibba005.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-18T10:21:10.492 INFO:teuthology.orchestra.run.gibba005.stdout: 2021-11-18T10:21:10.492 INFO:teuthology.orchestra.run.gibba005.stdout:[client] 2021-11-18T10:21:10.493 INFO:teuthology.orchestra.run.gibba005.stdout: rgw cache enabled = true 2021-11-18T10:21:10.493 INFO:teuthology.orchestra.run.gibba005.stdout: rgw enable ops log = true 2021-11-18T10:21:10.493 INFO:teuthology.orchestra.run.gibba005.stdout: rgw enable usage log = true 2021-11-18T10:21:10.493 INFO:teuthology.orchestra.run.gibba005.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-18T10:21:10.493 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-18T10:21:10.494 INFO:teuthology.orchestra.run.gibba005.stdout: debug rbd = 20 2021-11-18T10:21:10.494 INFO:teuthology.orchestra.run.gibba005.stdout: debug rbd_mirror = 15 2021-11-18T10:21:10.494 INFO:teuthology.orchestra.run.gibba005.stdout: log to stderr = False 2021-11-18T10:21:10.494 INFO:teuthology.orchestra.run.gibba005.stdout: rbd default features = 125 2021-11-18T10:21:10.495 INFO:teuthology.orchestra.run.gibba005.stdout: rbd mirror image policy type = simple 2021-11-18T10:21:10.495 INFO:teuthology.orchestra.run.gibba005.stdout:[mon.a] 2021-11-18T10:21:10.495 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.0] 2021-11-18T10:21:10.495 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.495 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.496 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.1] 2021-11-18T10:21:10.496 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.496 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.496 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.2] 2021-11-18T10:21:10.496 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.497 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.497 INFO:teuthology.orchestra.run.gibba005.stdout:[client.mirror.3] 2021-11-18T10:21:10.497 INFO:teuthology.orchestra.run.gibba005.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.497 INFO:teuthology.orchestra.run.gibba005.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.498 INFO:teuthology.orchestra.run.gibba019.stdout:[global] 2021-11-18T10:21:10.499 INFO:teuthology.orchestra.run.gibba019.stdout: chdir = "" 2021-11-18T10:21:10.499 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2021-11-18T10:21:10.499 INFO:teuthology.orchestra.run.gibba019.stdout: auth supported = cephx 2021-11-18T10:21:10.499 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.500 INFO:teuthology.orchestra.run.gibba019.stdout: filestore xattr use omap = true 2021-11-18T10:21:10.500 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.500 INFO:teuthology.orchestra.run.gibba019.stdout: mon clock drift allowed = 1.000 2021-11-18T10:21:10.500 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.501 INFO:teuthology.orchestra.run.gibba019.stdout: osd crush chooseleaf type = 0 2021-11-18T10:21:10.501 INFO:teuthology.orchestra.run.gibba019.stdout: auth debug = true 2021-11-18T10:21:10.501 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.501 INFO:teuthology.orchestra.run.gibba019.stdout: ms die on old message = true 2021-11-18T10:21:10.501 INFO:teuthology.orchestra.run.gibba019.stdout: ms die on bug = true 2021-11-18T10:21:10.502 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.502 INFO:teuthology.orchestra.run.gibba019.stdout: mon max pg per osd = 10000 # >= luminous 2021-11-18T10:21:10.502 INFO:teuthology.orchestra.run.gibba019.stdout: mon pg warn max object skew = 0 2021-11-18T10:21:10.502 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.502 INFO:teuthology.orchestra.run.gibba019.stdout: # disable pg_autoscaler by default for new pools 2021-11-18T10:21:10.503 INFO:teuthology.orchestra.run.gibba019.stdout: osd_pool_default_pg_autoscale_mode = off 2021-11-18T10:21:10.503 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.503 INFO:teuthology.orchestra.run.gibba019.stdout: osd pool default size = 2 2021-11-18T10:21:10.503 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.504 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd allow primary affinity = true 2021-11-18T10:21:10.504 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd allow pg remap = true 2021-11-18T10:21:10.504 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on legacy crush tunables = false 2021-11-18T10:21:10.504 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on crush straw calc version zero = false 2021-11-18T10:21:10.504 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on no sortbitwise = false 2021-11-18T10:21:10.505 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on osd down out interval zero = false 2021-11-18T10:21:10.505 INFO:teuthology.orchestra.run.gibba019.stdout: mon warn on too few osds = false 2021-11-18T10:21:10.505 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2021-11-18T10:21:10.505 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_pool_no_redundancy = false 2021-11-18T10:21:10.506 INFO:teuthology.orchestra.run.gibba019.stdout: mon_allow_pool_size_one = true 2021-11-18T10:21:10.506 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.506 INFO:teuthology.orchestra.run.gibba019.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2021-11-18T10:21:10.506 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.506 INFO:teuthology.orchestra.run.gibba019.stdout: osd default data pool replay window = 5 2021-11-18T10:21:10.507 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.507 INFO:teuthology.orchestra.run.gibba019.stdout: mon allow pool delete = true 2021-11-18T10:21:10.507 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.507 INFO:teuthology.orchestra.run.gibba019.stdout: mon cluster log file level = debug 2021-11-18T10:21:10.508 INFO:teuthology.orchestra.run.gibba019.stdout: debug asserts on shutdown = true 2021-11-18T10:21:10.508 INFO:teuthology.orchestra.run.gibba019.stdout: mon health detail to clog = false 2021-11-18T10:21:10.508 INFO:teuthology.orchestra.run.gibba019.stdout: mon host = 172.21.2.119 2021-11-18T10:21:10.508 INFO:teuthology.orchestra.run.gibba019.stdout: mon client directed command retry = 5 2021-11-18T10:21:10.508 INFO:teuthology.orchestra.run.gibba019.stdout: ms inject socket failures = 5000 2021-11-18T10:21:10.509 INFO:teuthology.orchestra.run.gibba019.stdout: fsid = 0e3c81ae-f64c-415d-9409-6e21fdce6c71 2021-11-18T10:21:10.509 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.509 INFO:teuthology.orchestra.run.gibba019.stdout:[osd] 2021-11-18T10:21:10.509 INFO:teuthology.orchestra.run.gibba019.stdout: osd journal size = 100 2021-11-18T10:21:10.509 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.510 INFO:teuthology.orchestra.run.gibba019.stdout: osd scrub load threshold = 5.0 2021-11-18T10:21:10.510 INFO:teuthology.orchestra.run.gibba019.stdout: osd scrub max interval = 600 2021-11-18T10:21:10.510 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.510 INFO:teuthology.orchestra.run.gibba019.stdout: osd recover clone overlap = true 2021-11-18T10:21:10.511 INFO:teuthology.orchestra.run.gibba019.stdout: osd recovery max chunk = 1048576 2021-11-18T10:21:10.511 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.511 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug shutdown = true 2021-11-18T10:21:10.511 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug op order = true 2021-11-18T10:21:10.511 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug verify stray on activate = true 2021-11-18T10:21:10.512 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.512 INFO:teuthology.orchestra.run.gibba019.stdout: osd open classes on start = true 2021-11-18T10:21:10.512 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug pg log writeout = true 2021-11-18T10:21:10.512 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.513 INFO:teuthology.orchestra.run.gibba019.stdout: osd deep scrub update digest min age = 30 2021-11-18T10:21:10.513 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.513 INFO:teuthology.orchestra.run.gibba019.stdout: osd map max advance = 10 2021-11-18T10:21:10.513 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.513 INFO:teuthology.orchestra.run.gibba019.stdout: journal zero on create = true 2021-11-18T10:21:10.514 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.514 INFO:teuthology.orchestra.run.gibba019.stdout: filestore ondisk finisher threads = 3 2021-11-18T10:21:10.514 INFO:teuthology.orchestra.run.gibba019.stdout: filestore apply finisher threads = 3 2021-11-18T10:21:10.514 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.514 INFO:teuthology.orchestra.run.gibba019.stdout: bdev debug aio = true 2021-11-18T10:21:10.515 INFO:teuthology.orchestra.run.gibba019.stdout: osd debug misdirected ops = true 2021-11-18T10:21:10.515 INFO:teuthology.orchestra.run.gibba019.stdout: bluefs allocator = hybrid 2021-11-18T10:21:10.515 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore allocator = hybrid 2021-11-18T10:21:10.515 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore block size = 96636764160 2021-11-18T10:21:10.516 INFO:teuthology.orchestra.run.gibba019.stdout: bluestore fsck on mount = True 2021-11-18T10:21:10.516 INFO:teuthology.orchestra.run.gibba019.stdout: debug bluefs = 1/20 2021-11-18T10:21:10.516 INFO:teuthology.orchestra.run.gibba019.stdout: debug bluestore = 1/20 2021-11-18T10:21:10.516 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-18T10:21:10.516 INFO:teuthology.orchestra.run.gibba019.stdout: debug osd = 20 2021-11-18T10:21:10.517 INFO:teuthology.orchestra.run.gibba019.stdout: debug rocksdb = 4/10 2021-11-18T10:21:10.517 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd backfillfull_ratio = 0.85 2021-11-18T10:21:10.517 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd full ratio = 0.9 2021-11-18T10:21:10.517 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd nearfull ratio = 0.8 2021-11-18T10:21:10.517 INFO:teuthology.orchestra.run.gibba019.stdout: osd failsafe full ratio = 0.95 2021-11-18T10:21:10.518 INFO:teuthology.orchestra.run.gibba019.stdout: osd objectstore = bluestore 2021-11-18T10:21:10.518 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.518 INFO:teuthology.orchestra.run.gibba019.stdout:[mgr] 2021-11-18T10:21:10.518 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-18T10:21:10.519 INFO:teuthology.orchestra.run.gibba019.stdout: debug mgr = 20 2021-11-18T10:21:10.519 INFO:teuthology.orchestra.run.gibba019.stdout: debug mon = 20 2021-11-18T10:21:10.519 INFO:teuthology.orchestra.run.gibba019.stdout: debug auth = 20 2021-11-18T10:21:10.519 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min pgs per osd = 4 2021-11-18T10:21:10.519 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min bytes per osd = 10 2021-11-18T10:21:10.520 INFO:teuthology.orchestra.run.gibba019.stdout: mgr/telemetry/nag = false 2021-11-18T10:21:10.520 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.520 INFO:teuthology.orchestra.run.gibba019.stdout:[mon] 2021-11-18T10:21:10.520 INFO:teuthology.orchestra.run.gibba019.stdout: debug ms = 1 2021-11-18T10:21:10.520 INFO:teuthology.orchestra.run.gibba019.stdout: debug mon = 20 2021-11-18T10:21:10.521 INFO:teuthology.orchestra.run.gibba019.stdout: debug paxos = 20 2021-11-18T10:21:10.521 INFO:teuthology.orchestra.run.gibba019.stdout: debug auth = 20 2021-11-18T10:21:10.521 INFO:teuthology.orchestra.run.gibba019.stdout: mon data avail warn = 5 2021-11-18T10:21:10.521 INFO:teuthology.orchestra.run.gibba019.stdout: mon mgr mkfs grace = 240 2021-11-18T10:21:10.522 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min pgs per osd = 4 2021-11-18T10:21:10.522 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd reporter subtree level = osd 2021-11-18T10:21:10.522 INFO:teuthology.orchestra.run.gibba019.stdout: mon osd prime pg temp = true 2021-11-18T10:21:10.522 INFO:teuthology.orchestra.run.gibba019.stdout: mon reweight min bytes per osd = 10 2021-11-18T10:21:10.522 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.523 INFO:teuthology.orchestra.run.gibba019.stdout: # rotate auth tickets quickly to exercise renewal paths 2021-11-18T10:21:10.523 INFO:teuthology.orchestra.run.gibba019.stdout: auth mon ticket ttl = 660 # 11m 2021-11-18T10:21:10.523 INFO:teuthology.orchestra.run.gibba019.stdout: auth service ticket ttl = 240 # 4m 2021-11-18T10:21:10.523 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.524 INFO:teuthology.orchestra.run.gibba019.stdout: # don't complain about insecure global_id in the test suite 2021-11-18T10:21:10.524 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_insecure_global_id_reclaim = false 2021-11-18T10:21:10.524 INFO:teuthology.orchestra.run.gibba019.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2021-11-18T10:21:10.524 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:10.524 INFO:teuthology.orchestra.run.gibba019.stdout:[client] 2021-11-18T10:21:10.525 INFO:teuthology.orchestra.run.gibba019.stdout: rgw cache enabled = true 2021-11-18T10:21:10.525 INFO:teuthology.orchestra.run.gibba019.stdout: rgw enable ops log = true 2021-11-18T10:21:10.525 INFO:teuthology.orchestra.run.gibba019.stdout: rgw enable usage log = true 2021-11-18T10:21:10.525 INFO:teuthology.orchestra.run.gibba019.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2021-11-18T10:21:10.525 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2021-11-18T10:21:10.526 INFO:teuthology.orchestra.run.gibba019.stdout: debug rbd = 20 2021-11-18T10:21:10.526 INFO:teuthology.orchestra.run.gibba019.stdout: debug rbd_mirror = 15 2021-11-18T10:21:10.526 INFO:teuthology.orchestra.run.gibba019.stdout: log to stderr = False 2021-11-18T10:21:10.526 INFO:teuthology.orchestra.run.gibba019.stdout: rbd default features = 125 2021-11-18T10:21:10.527 INFO:teuthology.orchestra.run.gibba019.stdout: rbd mirror image policy type = simple 2021-11-18T10:21:10.527 INFO:teuthology.orchestra.run.gibba019.stdout:[mon.a] 2021-11-18T10:21:10.527 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.0] 2021-11-18T10:21:10.527 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.527 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.528 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.1] 2021-11-18T10:21:10.528 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.528 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.528 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.2] 2021-11-18T10:21:10.529 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.529 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.529 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.3] 2021-11-18T10:21:10.529 INFO:teuthology.orchestra.run.gibba019.stdout: admin socket = /var/run/ceph/rbd-mirror.$cluster-$name.asok 2021-11-18T10:21:10.529 INFO:teuthology.orchestra.run.gibba019.stdout: pid file = /var/run/ceph/rbd-mirror.$cluster-$name.pid 2021-11-18T10:21:10.531 INFO:tasks.ceph:Creating admin key on cluster2.mon.a... 2021-11-18T10:21:10.532 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/cluster2.keyring 2021-11-18T10:21:10.611 INFO:tasks.ceph:Copying monmap to all nodes... 2021-11-18T10:21:10.612 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:10.612 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster2.keyring of=/dev/stdout 2021-11-18T10:21:10.663 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:10.664 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/home/ubuntu/cephtest/cluster2.monmap of=/dev/stdout 2021-11-18T10:21:10.716 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba005.front.sepia.ceph.com 2021-11-18T10:21:10.717 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:21:10.717 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd of=/etc/ceph/cluster2.keyring 2021-11-18T10:21:10.718 DEBUG:teuthology.orchestra.run.gibba005:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2021-11-18T10:21:10.745 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:21:10.745 DEBUG:teuthology.orchestra.run.gibba005:> dd of=/home/ubuntu/cephtest/cluster2.monmap 2021-11-18T10:21:10.797 INFO:tasks.ceph:Sending monmap to node ubuntu@gibba019.front.sepia.ceph.com 2021-11-18T10:21:10.798 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:10.798 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd of=/etc/ceph/cluster2.keyring 2021-11-18T10:21:10.799 DEBUG:teuthology.orchestra.run.gibba019:> sudo chmod 0644 /etc/ceph/cluster2.keyring 2021-11-18T10:21:10.826 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:10.826 DEBUG:teuthology.orchestra.run.gibba019:> dd of=/home/ubuntu/cephtest/cluster2.monmap 2021-11-18T10:21:10.877 INFO:tasks.ceph:Setting up mon nodes... 2021-11-18T10:21:10.878 INFO:tasks.ceph:Setting up mgr nodes... 2021-11-18T10:21:10.878 DEBUG:teuthology.orchestra.run.gibba005:> sudo mkdir -p /var/lib/ceph/mgr/cluster2-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/cluster2-x/keyring 2021-11-18T10:21:10.915 INFO:teuthology.orchestra.run.gibba005.stdout:creating /var/lib/ceph/mgr/cluster2-x/keyring 2021-11-18T10:21:10.916 INFO:tasks.ceph:Setting up mds nodes... 2021-11-18T10:21:10.917 INFO:tasks.ceph_client:Setting up client nodes... 2021-11-18T10:21:10.917 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/cluster2.client.0.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.0.keyring 2021-11-18T10:21:10.987 INFO:teuthology.orchestra.run.gibba005.stdout:creating /etc/ceph/cluster2.client.0.keyring 2021-11-18T10:21:10.996 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror /etc/ceph/cluster2.client.mirror.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.keyring 2021-11-18T10:21:11.026 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster2.client.mirror.keyring 2021-11-18T10:21:11.036 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.0 /etc/ceph/cluster2.client.mirror.0.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.0.keyring 2021-11-18T10:21:11.106 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster2.client.mirror.0.keyring 2021-11-18T10:21:11.116 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.1 /etc/ceph/cluster2.client.mirror.1.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.1.keyring 2021-11-18T10:21:11.186 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster2.client.mirror.1.keyring 2021-11-18T10:21:11.378 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.2 /etc/ceph/cluster2.client.mirror.2.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.2.keyring 2021-11-18T10:21:11.448 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster2.client.mirror.2.keyring 2021-11-18T10:21:11.458 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.3 /etc/ceph/cluster2.client.mirror.3.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.3.keyring 2021-11-18T10:21:11.528 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster2.client.mirror.3.keyring 2021-11-18T10:21:11.537 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.4 /etc/ceph/cluster2.client.mirror.4.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.4.keyring 2021-11-18T10:21:11.607 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster2.client.mirror.4.keyring 2021-11-18T10:21:11.616 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.5 /etc/ceph/cluster2.client.mirror.5.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.5.keyring 2021-11-18T10:21:11.684 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster2.client.mirror.5.keyring 2021-11-18T10:21:11.693 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.mirror.6 /etc/ceph/cluster2.client.mirror.6.keyring && sudo chmod 0644 /etc/ceph/cluster2.client.mirror.6.keyring 2021-11-18T10:21:11.763 INFO:teuthology.orchestra.run.gibba019.stdout:creating /etc/ceph/cluster2.client.mirror.6.keyring 2021-11-18T10:21:11.773 INFO:tasks.ceph:Running mkfs on osd nodes... 2021-11-18T10:21:11.773 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@gibba005.front.sepia.ceph.com'): {'cluster1.osd.0': '/dev/vg_nvme/lv_1', 'cluster1.osd.1': '/dev/vg_nvme/lv_2', 'cluster1.osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@gibba019.front.sepia.ceph.com'): {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'}} 2021-11-18T10:21:11.774 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/osd/cluster2-0 2021-11-18T10:21:11.833 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-18T10:21:11.833 INFO:tasks.ceph:role: cluster2.osd.0 2021-11-18T10:21:11.834 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@gibba019.front.sepia.ceph.com 2021-11-18T10:21:11.834 DEBUG:teuthology.orchestra.run.gibba019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2021-11-18T10:21:11.892 INFO:teuthology.orchestra.run.gibba019.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5505024 blks 2021-11-18T10:21:11.892 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-18T10:21:11.893 INFO:teuthology.orchestra.run.gibba019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-18T10:21:11.893 INFO:teuthology.orchestra.run.gibba019.stdout: = reflink=1 2021-11-18T10:21:11.893 INFO:teuthology.orchestra.run.gibba019.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-18T10:21:11.893 INFO:teuthology.orchestra.run.gibba019.stdout: = sunit=0 swidth=0 blks 2021-11-18T10:21:11.894 INFO:teuthology.orchestra.run.gibba019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-18T10:21:11.894 INFO:teuthology.orchestra.run.gibba019.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-18T10:21:11.894 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-18T10:21:11.894 INFO:teuthology.orchestra.run.gibba019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-18T10:21:11.915 INFO:teuthology.orchestra.run.gibba019.stdout:Discarding blocks...Done. 2021-11-18T10:21:11.917 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@gibba019.front.sepia.ceph.com -o noatime 2021-11-18T10:21:11.917 DEBUG:teuthology.orchestra.run.gibba019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/cluster2-0 2021-11-18T10:21:11.989 DEBUG:teuthology.orchestra.run.gibba019:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-0 2021-11-18T10:21:12.052 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/osd/cluster2-1 2021-11-18T10:21:12.111 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-18T10:21:12.112 INFO:tasks.ceph:role: cluster2.osd.1 2021-11-18T10:21:12.112 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@gibba019.front.sepia.ceph.com 2021-11-18T10:21:12.112 DEBUG:teuthology.orchestra.run.gibba019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2021-11-18T10:21:12.170 INFO:teuthology.orchestra.run.gibba019.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5505024 blks 2021-11-18T10:21:12.170 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-18T10:21:12.170 INFO:teuthology.orchestra.run.gibba019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-18T10:21:12.171 INFO:teuthology.orchestra.run.gibba019.stdout: = reflink=1 2021-11-18T10:21:12.171 INFO:teuthology.orchestra.run.gibba019.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-18T10:21:12.171 INFO:teuthology.orchestra.run.gibba019.stdout: = sunit=0 swidth=0 blks 2021-11-18T10:21:12.171 INFO:teuthology.orchestra.run.gibba019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-18T10:21:12.172 INFO:teuthology.orchestra.run.gibba019.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-18T10:21:12.172 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-18T10:21:12.172 INFO:teuthology.orchestra.run.gibba019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-18T10:21:12.193 INFO:teuthology.orchestra.run.gibba019.stdout:Discarding blocks...Done. 2021-11-18T10:21:12.194 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@gibba019.front.sepia.ceph.com -o noatime 2021-11-18T10:21:12.195 DEBUG:teuthology.orchestra.run.gibba019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/cluster2-1 2021-11-18T10:21:12.265 DEBUG:teuthology.orchestra.run.gibba019:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-1 2021-11-18T10:21:12.328 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/osd/cluster2-2 2021-11-18T10:21:12.388 INFO:tasks.ceph:roles_to_devs: {'cluster2.osd.0': '/dev/vg_nvme/lv_1', 'cluster2.osd.1': '/dev/vg_nvme/lv_2', 'cluster2.osd.2': '/dev/vg_nvme/lv_3'} 2021-11-18T10:21:12.389 INFO:tasks.ceph:role: cluster2.osd.2 2021-11-18T10:21:12.389 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@gibba019.front.sepia.ceph.com 2021-11-18T10:21:12.389 DEBUG:teuthology.orchestra.run.gibba019:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2021-11-18T10:21:12.448 INFO:teuthology.orchestra.run.gibba019.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5505024 blks 2021-11-18T10:21:12.448 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 attr=2, projid32bit=1 2021-11-18T10:21:12.448 INFO:teuthology.orchestra.run.gibba019.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2021-11-18T10:21:12.449 INFO:teuthology.orchestra.run.gibba019.stdout: = reflink=1 2021-11-18T10:21:12.449 INFO:teuthology.orchestra.run.gibba019.stdout:data = bsize=4096 blocks=22020096, imaxpct=25 2021-11-18T10:21:12.449 INFO:teuthology.orchestra.run.gibba019.stdout: = sunit=0 swidth=0 blks 2021-11-18T10:21:12.449 INFO:teuthology.orchestra.run.gibba019.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2021-11-18T10:21:12.449 INFO:teuthology.orchestra.run.gibba019.stdout:log =internal log bsize=4096 blocks=10752, version=2 2021-11-18T10:21:12.450 INFO:teuthology.orchestra.run.gibba019.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2021-11-18T10:21:12.450 INFO:teuthology.orchestra.run.gibba019.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2021-11-18T10:21:12.472 INFO:teuthology.orchestra.run.gibba019.stdout:Discarding blocks...Done. 2021-11-18T10:21:12.473 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@gibba019.front.sepia.ceph.com -o noatime 2021-11-18T10:21:12.474 DEBUG:teuthology.orchestra.run.gibba019:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/cluster2-2 2021-11-18T10:21:12.544 DEBUG:teuthology.orchestra.run.gibba019:> sudo /sbin/restorecon /var/lib/ceph/osd/cluster2-2 2021-11-18T10:21:12.607 DEBUG:teuthology.orchestra.run.gibba019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/cluster2.monmap 2021-11-18T10:21:12.690 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:12.691+0000 7fcbf6e070c0 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-0/keyring: can't open /var/lib/ceph/osd/cluster2-0/keyring: (2) No such file or directory 2021-11-18T10:21:12.690 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:12.691+0000 7fcbf6e070c0 -1 created new key in keyring /var/lib/ceph/osd/cluster2-0/keyring 2021-11-18T10:21:12.690 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:12.691+0000 7fcbf6e070c0 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2021-11-18T10:21:12.691 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:12.691+0000 7fcbf6e070c0 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2021-11-18T10:21:12.691 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:12.691+0000 7fcbf6e070c0 -1 bluestore(/var/lib/ceph/osd/cluster2-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-0/block: (2) No such file or directory 2021-11-18T10:21:12.691 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:12.691+0000 7fcbf6e070c0 -1 bluestore(/var/lib/ceph/osd/cluster2-0) _read_fsid unparsable uuid 2021-11-18T10:21:15.548 DEBUG:teuthology.orchestra.run.gibba019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-0 2021-11-18T10:21:15.609 DEBUG:teuthology.orchestra.run.gibba019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/cluster2.monmap 2021-11-18T10:21:15.679 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:15.680+0000 7f669c41e0c0 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-1/keyring: can't open /var/lib/ceph/osd/cluster2-1/keyring: (2) No such file or directory 2021-11-18T10:21:15.679 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:15.680+0000 7f669c41e0c0 -1 created new key in keyring /var/lib/ceph/osd/cluster2-1/keyring 2021-11-18T10:21:15.680 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:15.680+0000 7f669c41e0c0 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2021-11-18T10:21:15.680 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:15.680+0000 7f669c41e0c0 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2021-11-18T10:21:15.680 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:15.680+0000 7f669c41e0c0 -1 bluestore(/var/lib/ceph/osd/cluster2-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-1/block: (2) No such file or directory 2021-11-18T10:21:15.681 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:15.680+0000 7f669c41e0c0 -1 bluestore(/var/lib/ceph/osd/cluster2-1) _read_fsid unparsable uuid 2021-11-18T10:21:18.540 DEBUG:teuthology.orchestra.run.gibba019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-1 2021-11-18T10:21:18.599 DEBUG:teuthology.orchestra.run.gibba019:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster cluster2 --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/cluster2.monmap 2021-11-18T10:21:18.670 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:18.671+0000 7f0e370b20c0 -1 auth: error reading file: /var/lib/ceph/osd/cluster2-2/keyring: can't open /var/lib/ceph/osd/cluster2-2/keyring: (2) No such file or directory 2021-11-18T10:21:18.671 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:18.671+0000 7f0e370b20c0 -1 created new key in keyring /var/lib/ceph/osd/cluster2-2/keyring 2021-11-18T10:21:18.671 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:18.671+0000 7f0e370b20c0 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2021-11-18T10:21:18.671 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:18.671+0000 7f0e370b20c0 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2021-11-18T10:21:18.671 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:18.671+0000 7f0e370b20c0 -1 bluestore(/var/lib/ceph/osd/cluster2-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/cluster2-2/block: (2) No such file or directory 2021-11-18T10:21:18.672 INFO:teuthology.orchestra.run.gibba019.stderr:2021-11-18T10:21:18.672+0000 7f0e370b20c0 -1 bluestore(/var/lib/ceph/osd/cluster2-2) _read_fsid unparsable uuid 2021-11-18T10:21:21.548 DEBUG:teuthology.orchestra.run.gibba019:> sudo chown -R ceph:ceph /var/lib/ceph/osd/cluster2-2 2021-11-18T10:21:21.608 INFO:tasks.ceph:Reading keys from all nodes... 2021-11-18T10:21:21.609 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:21:21.609 DEBUG:teuthology.orchestra.run.gibba005:> sudo dd if=/var/lib/ceph/mgr/cluster2-x/keyring of=/dev/stdout 2021-11-18T10:21:21.630 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:21.630 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd if=/var/lib/ceph/osd/cluster2-0/keyring of=/dev/stdout 2021-11-18T10:21:21.667 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:21.667 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd if=/var/lib/ceph/osd/cluster2-1/keyring of=/dev/stdout 2021-11-18T10:21:21.727 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:21.727 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd if=/var/lib/ceph/osd/cluster2-2/keyring of=/dev/stdout 2021-11-18T10:21:21.784 DEBUG:teuthology.orchestra.run.gibba005:> set -ex 2021-11-18T10:21:21.785 DEBUG:teuthology.orchestra.run.gibba005:> dd if=/etc/ceph/cluster2.client.0.keyring of=/dev/stdout 2021-11-18T10:21:21.798 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:21.798 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster2.client.mirror.keyring of=/dev/stdout 2021-11-18T10:21:21.837 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:21.837 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster2.client.mirror.0.keyring of=/dev/stdout 2021-11-18T10:21:21.889 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:21.889 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster2.client.mirror.1.keyring of=/dev/stdout 2021-11-18T10:21:21.941 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:21.941 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster2.client.mirror.2.keyring of=/dev/stdout 2021-11-18T10:21:21.993 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:21.993 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster2.client.mirror.3.keyring of=/dev/stdout 2021-11-18T10:21:22.045 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:22.045 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster2.client.mirror.4.keyring of=/dev/stdout 2021-11-18T10:21:22.097 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:22.097 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster2.client.mirror.5.keyring of=/dev/stdout 2021-11-18T10:21:22.149 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:22.149 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/etc/ceph/cluster2.client.mirror.6.keyring of=/dev/stdout 2021-11-18T10:21:22.201 INFO:tasks.ceph:Adding keys to all mons... 2021-11-18T10:21:22.201 DEBUG:teuthology.orchestra.run.gibba019:> sudo tee -a /etc/ceph/cluster2.keyring 2021-11-18T10:21:22.259 INFO:teuthology.orchestra.run.gibba019.stdout:[mgr.x] 2021-11-18T10:21:22.259 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAWKZZh/mKzNhAA1Sev9rqIBZSRGiFtr5dwug== 2021-11-18T10:21:22.259 INFO:teuthology.orchestra.run.gibba019.stdout:[osd.0] 2021-11-18T10:21:22.260 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAYKZZhLB1FKRAAM2GeDKdVTADLAf9S1EwBWg== 2021-11-18T10:21:22.260 INFO:teuthology.orchestra.run.gibba019.stdout:[osd.1] 2021-11-18T10:21:22.260 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAbKZZhQSWeKBAA7VSrN8vuukKXc3/Iy+XJIg== 2021-11-18T10:21:22.260 INFO:teuthology.orchestra.run.gibba019.stdout:[osd.2] 2021-11-18T10:21:22.260 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAeKZZhfZsZKBAAYsB2LAuXMfni84v34Y1Rvg== 2021-11-18T10:21:22.261 INFO:teuthology.orchestra.run.gibba019.stdout:[client.0] 2021-11-18T10:21:22.261 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAWKZZhl5MAOxAAlTGwaQti5VlyusnwIyxZsw== 2021-11-18T10:21:22.261 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror] 2021-11-18T10:21:22.261 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAXKZZhECuzARAAKKHwGkW7wfdzIstXaeizyA== 2021-11-18T10:21:22.262 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.0] 2021-11-18T10:21:22.262 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAXKZZhw554BhAAsjGsM1uCHWFSKio4ogQ5Iw== 2021-11-18T10:21:22.262 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.1] 2021-11-18T10:21:22.262 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAXKZZhSDA3CxAAcPYkzHTmuXRWNCyKPCOlCw== 2021-11-18T10:21:22.262 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.2] 2021-11-18T10:21:22.263 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAXKZZhwTXlGhAAGNKgxZfrZuq18NBScQ4HVw== 2021-11-18T10:21:22.263 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.3] 2021-11-18T10:21:22.263 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAXKZZhWdOdHxAAapiZJhAquG6rLOZpDEtdVQ== 2021-11-18T10:21:22.263 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.4] 2021-11-18T10:21:22.264 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAXKZZhpelVJBAAUZz+hIMboxnyGYqJoVDr+A== 2021-11-18T10:21:22.264 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.5] 2021-11-18T10:21:22.264 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAXKZZhTF3vKBAAohSMVH3t9KXZs6QV6OgPdQ== 2021-11-18T10:21:22.264 INFO:teuthology.orchestra.run.gibba019.stdout:[client.mirror.6] 2021-11-18T10:21:22.264 INFO:teuthology.orchestra.run.gibba019.stdout: key = AQAXKZZhQyioLRAAPqDrPNujJM64Z/kjFKRuLA== 2021-11-18T10:21:22.265 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2021-11-18T10:21:22.341 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-11-18T10:21:22.418 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-11-18T10:21:22.495 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2021-11-18T10:21:22.572 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:21:22.649 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:21:22.728 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:21:22.806 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:21:22.883 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:21:22.962 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:21:23.041 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.4 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:21:23.121 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.5 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:21:23.199 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/cluster2.keyring --name=client.mirror.6 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2021-11-18T10:21:23.277 INFO:tasks.ceph:Running mkfs on mon nodes... 2021-11-18T10:21:23.278 DEBUG:teuthology.orchestra.run.gibba019:> sudo mkdir -p /var/lib/ceph/mon/cluster2-a 2021-11-18T10:21:23.338 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster cluster2 --mkfs -i a --monmap /home/ubuntu/cephtest/cluster2.monmap --keyring /etc/ceph/cluster2.keyring 2021-11-18T10:21:23.419 DEBUG:teuthology.orchestra.run.gibba019:> sudo chown -R ceph:ceph /var/lib/ceph/mon/cluster2-a 2021-11-18T10:21:23.479 DEBUG:teuthology.orchestra.run.gibba019:> rm -- /home/ubuntu/cephtest/cluster2.monmap 2021-11-18T10:21:23.531 INFO:tasks.ceph:Starting mon daemons in cluster cluster2... 2021-11-18T10:21:23.532 INFO:tasks.ceph.cluster2.mon.a:Restarting daemon 2021-11-18T10:21:23.533 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster cluster2 -i a 2021-11-18T10:21:23.575 INFO:tasks.ceph.cluster2.mon.a:Started 2021-11-18T10:21:23.575 INFO:tasks.ceph:Starting mgr daemons in cluster cluster2... 2021-11-18T10:21:23.576 INFO:tasks.ceph.cluster2.mgr.x:Restarting daemon 2021-11-18T10:21:23.576 DEBUG:teuthology.orchestra.run.gibba005:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster cluster2 -i x 2021-11-18T10:21:23.579 INFO:tasks.ceph.cluster2.mgr.x:Started 2021-11-18T10:21:23.580 INFO:tasks.ceph:Setting crush tunables to default 2021-11-18T10:21:23.580 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster cluster2 osd crush tunables default 2021-11-18T10:21:23.731 INFO:teuthology.orchestra.run.gibba019.stderr:adjusted tunables profile to default 2021-11-18T10:21:23.738 INFO:tasks.ceph:Starting osd daemons in cluster cluster2... 2021-11-18T10:21:23.739 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:23.739 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd if=/var/lib/ceph/osd/cluster2-0/fsid of=/dev/stdout 2021-11-18T10:21:23.758 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:23.758 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd if=/var/lib/ceph/osd/cluster2-1/fsid of=/dev/stdout 2021-11-18T10:21:23.816 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:21:23.817 DEBUG:teuthology.orchestra.run.gibba019:> sudo dd if=/var/lib/ceph/osd/cluster2-2/fsid of=/dev/stdout 2021-11-18T10:21:23.875 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster cluster2 osd new 9eb2e320-a089-4a9b-b86f-b4dbc763c222 0 2021-11-18T10:21:24.067 INFO:teuthology.orchestra.run.gibba019.stdout:0 2021-11-18T10:21:24.077 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster cluster2 osd new e19de683-d9f4-4d9f-848e-7369fa01e505 1 2021-11-18T10:21:24.228 INFO:teuthology.orchestra.run.gibba019.stdout:1 2021-11-18T10:21:24.238 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster cluster2 osd new c4282d6a-f813-4095-a1be-a1f4728e2cf7 2 2021-11-18T10:21:24.387 INFO:teuthology.orchestra.run.gibba019.stdout:2 2021-11-18T10:21:24.396 INFO:tasks.ceph.cluster2.osd.0:Restarting daemon 2021-11-18T10:21:24.396 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 0 2021-11-18T10:21:24.399 INFO:tasks.ceph.cluster2.osd.0:Started 2021-11-18T10:21:24.399 INFO:tasks.ceph.cluster2.osd.1:Restarting daemon 2021-11-18T10:21:24.400 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 1 2021-11-18T10:21:24.402 INFO:tasks.ceph.cluster2.osd.1:Started 2021-11-18T10:21:24.402 INFO:tasks.ceph.cluster2.osd.2:Restarting daemon 2021-11-18T10:21:24.403 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster cluster2 -i 2 2021-11-18T10:21:24.405 INFO:tasks.ceph.cluster2.osd.2:Started 2021-11-18T10:21:24.405 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2021-11-18T10:21:24.552 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:24.552 INFO:teuthology.orchestra.run.gibba019.stdout:{"epoch":5,"fsid":"0e3c81ae-f64c-415d-9409-6e21fdce6c71","created":"2021-11-18T10:21:23.664036+0000","modified":"2021-11-18T10:21:24.388113+0000","last_up_change":"0.000000","last_in_change":"2021-11-18T10:21:24.388113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9eb2e320-a089-4a9b-b86f-b4dbc763c222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e19de683-d9f4-4d9f-848e-7369fa01e505","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c4282d6a-f813-4095-a1be-a1f4728e2cf7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-18T10:21:24.561 INFO:tasks.ceph.ceph_manager.cluster2:[] 2021-11-18T10:21:24.561 INFO:tasks.ceph:Waiting for OSDs to come up 2021-11-18T10:21:24.864 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2021-11-18T10:21:24.975 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:21:24.976+0000 7fc5e76b30c0 -1 Falling back to public interface 2021-11-18T10:21:24.980 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:21:24.981+0000 7f46eb50c0c0 -1 Falling back to public interface 2021-11-18T10:21:24.990 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:21:24.991+0000 7f789bd5a0c0 -1 Falling back to public interface 2021-11-18T10:21:25.145 INFO:teuthology.misc.health.gibba019.stderr:2021-11-18T10:21:25.147+0000 7f6ffe4a2700 0 --2- 172.21.2.119:0/974331600 >> v2:172.21.2.119:3300/0 conn(0x7f6ff80b61b0 0x7f6ff80a2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2021-11-18T10:21:25.200 INFO:teuthology.misc.health.gibba019.stdout: 2021-11-18T10:21:25.200 INFO:teuthology.misc.health.gibba019.stdout:{"epoch":5,"fsid":"0e3c81ae-f64c-415d-9409-6e21fdce6c71","created":"2021-11-18T10:21:23.664036+0000","modified":"2021-11-18T10:21:24.388113+0000","last_up_change":"0.000000","last_in_change":"2021-11-18T10:21:24.388113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9eb2e320-a089-4a9b-b86f-b4dbc763c222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e19de683-d9f4-4d9f-848e-7369fa01e505","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c4282d6a-f813-4095-a1be-a1f4728e2cf7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-18T10:21:25.208 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-11-18T10:21:28.430 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:21:28.431+0000 7fc5e76b30c0 -1 osd.1 0 log_to_monitors {default=true} 2021-11-18T10:21:28.464 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:21:28.465+0000 7f46eb50c0c0 -1 osd.0 0 log_to_monitors {default=true} 2021-11-18T10:21:28.512 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:21:28.513+0000 7f789bd5a0c0 -1 osd.2 0 log_to_monitors {default=true} 2021-11-18T10:21:30.961 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:21:30.962+0000 7f46e1eca700 -1 osd.0 0 waiting for initial osdmap 2021-11-18T10:21:30.963 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:21:30.964+0000 7f46da85d700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-18T10:21:30.964 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:21:30.966+0000 7fc5de071700 -1 osd.1 0 waiting for initial osdmap 2021-11-18T10:21:30.966 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:21:30.968+0000 7fc5d6a04700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-18T10:21:30.970 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:21:30.971+0000 7f7892718700 -1 osd.2 0 waiting for initial osdmap 2021-11-18T10:21:30.972 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:21:30.973+0000 7f788b0ab700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2021-11-18T10:21:31.512 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2021-11-18T10:21:31.726 INFO:teuthology.misc.health.gibba019.stdout: 2021-11-18T10:21:31.726 INFO:teuthology.misc.health.gibba019.stdout:{"epoch":7,"fsid":"0e3c81ae-f64c-415d-9409-6e21fdce6c71","created":"2021-11-18T10:21:23.664036+0000","modified":"2021-11-18T10:21:30.009550+0000","last_up_change":"0.000000","last_in_change":"2021-11-18T10:21:24.388113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9eb2e320-a089-4a9b-b86f-b4dbc763c222","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"e19de683-d9f4-4d9f-848e-7369fa01e505","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c4282d6a-f813-4095-a1be-a1f4728e2cf7","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-18T10:21:31.735 DEBUG:teuthology.misc:0 of 3 OSDs are up 2021-11-18T10:21:38.040 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster cluster2 osd dump --format=json 2021-11-18T10:21:38.251 INFO:teuthology.misc.health.gibba019.stdout: 2021-11-18T10:21:38.252 INFO:teuthology.misc.health.gibba019.stdout:{"epoch":12,"fsid":"0e3c81ae-f64c-415d-9409-6e21fdce6c71","created":"2021-11-18T10:21:23.664036+0000","modified":"2021-11-18T10:21:36.028162+0000","last_up_change":"2021-11-18T10:21:31.971477+0000","last_in_change":"2021-11-18T10:21:24.388113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-11-18T10:21:33.191802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"9eb2e320-a089-4a9b-b86f-b4dbc763c222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":33564},{"type":"v1","addr":"172.21.2.119:6809","nonce":33564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":33564},{"type":"v1","addr":"172.21.2.119:6811","nonce":33564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":33564},{"type":"v1","addr":"172.21.2.119:6815","nonce":33564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":33564},{"type":"v1","addr":"172.21.2.119:6813","nonce":33564}]},"public_addr":"172.21.2.119:6809/33564","cluster_addr":"172.21.2.119:6811/33564","heartbeat_back_addr":"172.21.2.119:6815/33564","heartbeat_front_addr":"172.21.2.119:6813/33564","state":["exists","up"]},{"osd":1,"uuid":"e19de683-d9f4-4d9f-848e-7369fa01e505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6800","nonce":33565},{"type":"v1","addr":"172.21.2.119:6801","nonce":33565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":33565},{"type":"v1","addr":"172.21.2.119:6803","nonce":33565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":33565},{"type":"v1","addr":"172.21.2.119:6807","nonce":33565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":33565},{"type":"v1","addr":"172.21.2.119:6805","nonce":33565}]},"public_addr":"172.21.2.119:6801/33565","cluster_addr":"172.21.2.119:6803/33565","heartbeat_back_addr":"172.21.2.119:6807/33565","heartbeat_front_addr":"172.21.2.119:6805/33565","state":["exists","up"]},{"osd":2,"uuid":"c4282d6a-f813-4095-a1be-a1f4728e2cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":33566},{"type":"v1","addr":"172.21.2.119:6817","nonce":33566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6818","nonce":33566},{"type":"v1","addr":"172.21.2.119:6819","nonce":33566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":33566},{"type":"v1","addr":"172.21.2.119:6823","nonce":33566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6820","nonce":33566},{"type":"v1","addr":"172.21.2.119:6821","nonce":33566}]},"public_addr":"172.21.2.119:6817/33566","cluster_addr":"172.21.2.119:6819/33566","heartbeat_back_addr":"172.21.2.119:6823/33566","heartbeat_front_addr":"172.21.2.119:6821/33566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:29.467695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:29.413456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:29.508675+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-18T10:21:38.260 DEBUG:teuthology.misc:3 of 3 OSDs are up 2021-11-18T10:21:38.260 INFO:tasks.ceph:Creating RBD pool 2021-11-18T10:21:38.261 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster cluster2 osd pool create rbd 8 2021-11-18T10:21:39.039 INFO:teuthology.orchestra.run.gibba019.stderr:pool 'rbd' created 2021-11-18T10:21:39.047 DEBUG:teuthology.orchestra.run.gibba019:> sudo ceph --cluster cluster2 osd pool application enable rbd rbd --yes-i-really-mean-it 2021-11-18T10:21:40.041 INFO:teuthology.orchestra.run.gibba019.stderr:enabled application 'rbd' on pool 'rbd' 2021-11-18T10:21:40.049 INFO:tasks.ceph:Starting mds daemons in cluster cluster2... 2021-11-18T10:21:40.050 INFO:tasks.ceph:Waiting until cluster2 daemons up and pgs clean... 2021-11-18T10:21:40.050 INFO:tasks.ceph.ceph_manager.cluster2:waiting for mgr available 2021-11-18T10:21:40.051 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 mgr dump --format=json 2021-11-18T10:21:40.051 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2021-11-18T10:21:40.305 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:40.314 INFO:teuthology.orchestra.run.gibba019.stdout:{"epoch":5,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.105:6826","nonce":39117},{"type":"v1","addr":"172.21.2.105:6827","nonce":39117}]},"active_addr":"172.21.2.105:6827/39117","active_change":"2021-11-18T10:21:26.951705+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Registry to which we should normalize unqualified image names","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"autoscale_profile":{"name":"autoscale_profile","type":"str","level":"advanced","flags":1,"default_value":"scale-down","min":"","max":"","enum_allowed":[],"desc":"pg_autoscale profiler","long_desc":"Determines the behavior of the autoscaler algorithm, `scale-down means start out with full pgs and scalesdown when there is pressure`scale-up` means that it starts out with minmum pgs and scales up when there is pressure","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share perf counter metrics summed across the whole cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.2.105:0","nonce":4167838044}]},{"addrvec":[{"type":"v2","addr":"172.21.2.105:0","nonce":751394736}]},{"addrvec":[{"type":"v2","addr":"172.21.2.105:0","nonce":1689663914}]},{"addrvec":[{"type":"v2","addr":"172.21.2.105:0","nonce":525407909}]}]}} 2021-11-18T10:21:40.317 INFO:tasks.ceph.ceph_manager.cluster2:mgr available! 2021-11-18T10:21:40.317 INFO:tasks.ceph.ceph_manager.cluster2:waiting for all up 2021-11-18T10:21:40.318 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2021-11-18T10:21:40.535 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:40.536 INFO:teuthology.orchestra.run.gibba019.stdout:{"epoch":14,"fsid":"0e3c81ae-f64c-415d-9409-6e21fdce6c71","created":"2021-11-18T10:21:23.664036+0000","modified":"2021-11-18T10:21:40.038808+0000","last_up_change":"2021-11-18T10:21:31.971477+0000","last_in_change":"2021-11-18T10:21:24.388113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-11-18T10:21:33.191802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-18T10:21:38.485376+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9eb2e320-a089-4a9b-b86f-b4dbc763c222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":33564},{"type":"v1","addr":"172.21.2.119:6809","nonce":33564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":33564},{"type":"v1","addr":"172.21.2.119:6811","nonce":33564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":33564},{"type":"v1","addr":"172.21.2.119:6815","nonce":33564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":33564},{"type":"v1","addr":"172.21.2.119:6813","nonce":33564}]},"public_addr":"172.21.2.119:6809/33564","cluster_addr":"172.21.2.119:6811/33564","heartbeat_back_addr":"172.21.2.119:6815/33564","heartbeat_front_addr":"172.21.2.119:6813/33564","state":["exists","up"]},{"osd":1,"uuid":"e19de683-d9f4-4d9f-848e-7369fa01e505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6800","nonce":33565},{"type":"v1","addr":"172.21.2.119:6801","nonce":33565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":33565},{"type":"v1","addr":"172.21.2.119:6803","nonce":33565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":33565},{"type":"v1","addr":"172.21.2.119:6807","nonce":33565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":33565},{"type":"v1","addr":"172.21.2.119:6805","nonce":33565}]},"public_addr":"172.21.2.119:6801/33565","cluster_addr":"172.21.2.119:6803/33565","heartbeat_back_addr":"172.21.2.119:6807/33565","heartbeat_front_addr":"172.21.2.119:6805/33565","state":["exists","up"]},{"osd":2,"uuid":"c4282d6a-f813-4095-a1be-a1f4728e2cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":33566},{"type":"v1","addr":"172.21.2.119:6817","nonce":33566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6818","nonce":33566},{"type":"v1","addr":"172.21.2.119:6819","nonce":33566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":33566},{"type":"v1","addr":"172.21.2.119:6823","nonce":33566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6820","nonce":33566},{"type":"v1","addr":"172.21.2.119:6821","nonce":33566}]},"public_addr":"172.21.2.119:6817/33566","cluster_addr":"172.21.2.119:6819/33566","heartbeat_back_addr":"172.21.2.119:6823/33566","heartbeat_front_addr":"172.21.2.119:6821/33566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:29.467695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:29.413456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:29.508675+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-18T10:21:40.545 INFO:tasks.ceph.ceph_manager.cluster2:all up! 2021-11-18T10:21:40.546 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd dump --format=json 2021-11-18T10:21:40.766 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:40.766 INFO:teuthology.orchestra.run.gibba019.stdout:{"epoch":14,"fsid":"0e3c81ae-f64c-415d-9409-6e21fdce6c71","created":"2021-11-18T10:21:23.664036+0000","modified":"2021-11-18T10:21:40.038808+0000","last_up_change":"2021-11-18T10:21:31.971477+0000","last_in_change":"2021-11-18T10:21:24.388113+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2021-11-18T10:21:33.191802+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-11-18T10:21:38.485376+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9eb2e320-a089-4a9b-b86f-b4dbc763c222","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6808","nonce":33564},{"type":"v1","addr":"172.21.2.119:6809","nonce":33564}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6810","nonce":33564},{"type":"v1","addr":"172.21.2.119:6811","nonce":33564}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6814","nonce":33564},{"type":"v1","addr":"172.21.2.119:6815","nonce":33564}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6812","nonce":33564},{"type":"v1","addr":"172.21.2.119:6813","nonce":33564}]},"public_addr":"172.21.2.119:6809/33564","cluster_addr":"172.21.2.119:6811/33564","heartbeat_back_addr":"172.21.2.119:6815/33564","heartbeat_front_addr":"172.21.2.119:6813/33564","state":["exists","up"]},{"osd":1,"uuid":"e19de683-d9f4-4d9f-848e-7369fa01e505","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6800","nonce":33565},{"type":"v1","addr":"172.21.2.119:6801","nonce":33565}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6802","nonce":33565},{"type":"v1","addr":"172.21.2.119:6803","nonce":33565}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6806","nonce":33565},{"type":"v1","addr":"172.21.2.119:6807","nonce":33565}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6804","nonce":33565},{"type":"v1","addr":"172.21.2.119:6805","nonce":33565}]},"public_addr":"172.21.2.119:6801/33565","cluster_addr":"172.21.2.119:6803/33565","heartbeat_back_addr":"172.21.2.119:6807/33565","heartbeat_front_addr":"172.21.2.119:6805/33565","state":["exists","up"]},{"osd":2,"uuid":"c4282d6a-f813-4095-a1be-a1f4728e2cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6816","nonce":33566},{"type":"v1","addr":"172.21.2.119:6817","nonce":33566}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6818","nonce":33566},{"type":"v1","addr":"172.21.2.119:6819","nonce":33566}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6822","nonce":33566},{"type":"v1","addr":"172.21.2.119:6823","nonce":33566}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.2.119:6820","nonce":33566},{"type":"v1","addr":"172.21.2.119:6821","nonce":33566}]},"public_addr":"172.21.2.119:6817/33566","cluster_addr":"172.21.2.119:6819/33566","heartbeat_back_addr":"172.21.2.119:6823/33566","heartbeat_front_addr":"172.21.2.119:6821/33566","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:29.467695+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:29.413456+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-11-18T10:21:29.508675+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-11-18T10:21:40.777 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.0 flush_pg_stats 2021-11-18T10:21:40.891 INFO:teuthology.orchestra.run.gibba019.stdout:34359738373 2021-11-18T10:21:40.892 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.1 flush_pg_stats 2021-11-18T10:21:41.007 INFO:teuthology.orchestra.run.gibba019.stdout:34359738372 2021-11-18T10:21:41.007 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 tell osd.2 flush_pg_stats 2021-11-18T10:21:41.124 INFO:teuthology.orchestra.run.gibba019.stdout:34359738373 2021-11-18T10:21:41.125 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.0 2021-11-18T10:21:41.350 INFO:teuthology.orchestra.run.gibba019.stdout:34359738373 2021-11-18T10:21:41.360 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738373 got 34359738373 for osd.0 2021-11-18T10:21:41.361 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.1 2021-11-18T10:21:41.590 INFO:teuthology.orchestra.run.gibba019.stdout:34359738371 2021-11-18T10:21:41.601 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738372 got 34359738371 for osd.1 2021-11-18T10:21:42.602 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.1 2021-11-18T10:21:42.821 INFO:teuthology.orchestra.run.gibba019.stdout:34359738371 2021-11-18T10:21:42.831 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738372 got 34359738371 for osd.1 2021-11-18T10:21:43.832 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.1 2021-11-18T10:21:44.052 INFO:teuthology.orchestra.run.gibba019.stdout:34359738373 2021-11-18T10:21:44.062 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738372 got 34359738373 for osd.1 2021-11-18T10:21:44.062 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 osd last-stat-seq osd.2 2021-11-18T10:21:44.282 INFO:teuthology.orchestra.run.gibba019.stdout:34359738374 2021-11-18T10:21:44.291 INFO:tasks.ceph.ceph_manager.cluster2:need seq 34359738373 got 34359738374 for osd.2 2021-11-18T10:21:44.292 INFO:tasks.ceph.ceph_manager.cluster2:waiting for clean 2021-11-18T10:21:44.292 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2021-11-18T10:21:44.505 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:44.506 INFO:teuthology.orchestra.run.gibba019.stderr:dumped all 2021-11-18T10:21:44.514 INFO:teuthology.orchestra.run.gibba019.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2021-11-18T10:21:42.959158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":37152,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":35584,"kb_avail":283078368,"statfs":{"total":289910292480,"available":289872248832,"internally_reserved":0,"allocated":1581056,"data_stored":1291274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":36438016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000722"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.044907+0000","last_change":"2021-11-18T10:21:40.044166+0000","last_active":"2021-11-18T10:21:40.044907+0000","last_peered":"2021-11-18T10:21:40.044907+0000","last_clean":"2021-11-18T10:21:40.044907+0000","last_became_active":"2021-11-18T10:21:40.044004+0000","last_became_peered":"2021-11-18T10:21:40.044004+0000","last_unstale":"2021-11-18T10:21:40.044907+0000","last_undegraded":"2021-11-18T10:21:40.044907+0000","last_fullsized":"2021-11-18T10:21:40.044907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T12:34:04.136288+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.045014+0000","last_change":"2021-11-18T10:21:40.044281+0000","last_active":"2021-11-18T10:21:40.045014+0000","last_peered":"2021-11-18T10:21:40.045014+0000","last_clean":"2021-11-18T10:21:40.045014+0000","last_became_active":"2021-11-18T10:21:40.044081+0000","last_became_peered":"2021-11-18T10:21:40.044081+0000","last_unstale":"2021-11-18T10:21:40.045014+0000","last_undegraded":"2021-11-18T10:21:40.045014+0000","last_fullsized":"2021-11-18T10:21:40.045014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:18:27.904685+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.045673+0000","last_change":"2021-11-18T10:21:40.045052+0000","last_active":"2021-11-18T10:21:40.045673+0000","last_peered":"2021-11-18T10:21:40.045673+0000","last_clean":"2021-11-18T10:21:40.045673+0000","last_became_active":"2021-11-18T10:21:40.044859+0000","last_became_peered":"2021-11-18T10:21:40.044859+0000","last_unstale":"2021-11-18T10:21:40.045673+0000","last_undegraded":"2021-11-18T10:21:40.045673+0000","last_fullsized":"2021-11-18T10:21:40.045673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T15:27:11.195161+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.044794+0000","last_change":"2021-11-18T10:21:40.044288+0000","last_active":"2021-11-18T10:21:40.044794+0000","last_peered":"2021-11-18T10:21:40.044794+0000","last_clean":"2021-11-18T10:21:40.044794+0000","last_became_active":"2021-11-18T10:21:40.044060+0000","last_became_peered":"2021-11-18T10:21:40.044060+0000","last_unstale":"2021-11-18T10:21:40.044794+0000","last_undegraded":"2021-11-18T10:21:40.044794+0000","last_fullsized":"2021-11-18T10:21:40.044794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:49:21.306280+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":139,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.043084+0000","last_change":"2021-11-18T10:21:35.410830+0000","last_active":"2021-11-18T10:21:40.043084+0000","last_peered":"2021-11-18T10:21:40.043084+0000","last_clean":"2021-11-18T10:21:40.043084+0000","last_became_active":"2021-11-18T10:21:35.409874+0000","last_became_peered":"2021-11-18T10:21:35.409874+0000","last_unstale":"2021-11-18T10:21:40.043084+0000","last_undegraded":"2021-11-18T10:21:40.043084+0000","last_fullsized":"2021-11-18T10:21:40.043084+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:34.022748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:34.022748+0000","last_clean_scrub_stamp":"2021-11-18T10:21:34.022748+0000","log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:49:21.906630+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.044873+0000","last_change":"2021-11-18T10:21:40.044009+0000","last_active":"2021-11-18T10:21:40.044873+0000","last_peered":"2021-11-18T10:21:40.044873+0000","last_clean":"2021-11-18T10:21:40.044873+0000","last_became_active":"2021-11-18T10:21:40.043813+0000","last_became_peered":"2021-11-18T10:21:40.043813+0000","last_unstale":"2021-11-18T10:21:40.044873+0000","last_undegraded":"2021-11-18T10:21:40.044873+0000","last_fullsized":"2021-11-18T10:21:40.044873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T10:28:33.431547+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.045134+0000","last_change":"2021-11-18T10:21:40.044456+0000","last_active":"2021-11-18T10:21:40.045134+0000","last_peered":"2021-11-18T10:21:40.045134+0000","last_clean":"2021-11-18T10:21:40.045134+0000","last_became_active":"2021-11-18T10:21:40.044049+0000","last_became_peered":"2021-11-18T10:21:40.044049+0000","last_unstale":"2021-11-18T10:21:40.045134+0000","last_undegraded":"2021-11-18T10:21:40.045134+0000","last_fullsized":"2021-11-18T10:21:40.045134+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T14:25:37.483933+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.045289+0000","last_change":"2021-11-18T10:21:40.044550+0000","last_active":"2021-11-18T10:21:40.045289+0000","last_peered":"2021-11-18T10:21:40.045289+0000","last_clean":"2021-11-18T10:21:40.045289+0000","last_became_active":"2021-11-18T10:21:40.044330+0000","last_became_peered":"2021-11-18T10:21:40.044330+0000","last_unstale":"2021-11-18T10:21:40.045289+0000","last_undegraded":"2021-11-18T10:21:40.045289+0000","last_fullsized":"2021-11-18T10:21:40.045289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T18:20:33.814642+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.044998+0000","last_change":"2021-11-18T10:21:40.044245+0000","last_active":"2021-11-18T10:21:40.044998+0000","last_peered":"2021-11-18T10:21:40.044998+0000","last_clean":"2021-11-18T10:21:40.044998+0000","last_became_active":"2021-11-18T10:21:40.044049+0000","last_became_peered":"2021-11-18T10:21:40.044049+0000","last_unstale":"2021-11-18T10:21:40.044998+0000","last_undegraded":"2021-11-18T10:21:40.044998+0000","last_fullsized":"2021-11-18T10:21:40.044998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T21:58:55.527993+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11720,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":11584,"kb_avail":94360120,"statfs":{"total":96636764160,"available":96624762880,"internally_reserved":0,"allocated":131072,"data_stored":36846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11862016},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12684,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359156,"statfs":{"total":96636764160,"available":96623775744,"internally_reserved":0,"allocated":724992,"data_stored":627214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12748,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359092,"statfs":{"total":96636764160,"available":96623710208,"internally_reserved":0,"allocated":724992,"data_stored":627214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-11-18T10:21:44.515 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 pg dump --format=json 2021-11-18T10:21:44.729 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:44.731 INFO:teuthology.orchestra.run.gibba019.stderr:dumped all 2021-11-18T10:21:44.738 INFO:teuthology.orchestra.run.gibba019.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2021-11-18T10:21:42.959158+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":15,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":37152,"kb_used_data":1544,"kb_used_omap":0,"kb_used_meta":35584,"kb_avail":283078368,"statfs":{"total":289910292480,"available":289872248832,"internally_reserved":0,"allocated":1581056,"data_stored":1291274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":36438016},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000722"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.044907+0000","last_change":"2021-11-18T10:21:40.044166+0000","last_active":"2021-11-18T10:21:40.044907+0000","last_peered":"2021-11-18T10:21:40.044907+0000","last_clean":"2021-11-18T10:21:40.044907+0000","last_became_active":"2021-11-18T10:21:40.044004+0000","last_became_peered":"2021-11-18T10:21:40.044004+0000","last_unstale":"2021-11-18T10:21:40.044907+0000","last_undegraded":"2021-11-18T10:21:40.044907+0000","last_fullsized":"2021-11-18T10:21:40.044907+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T12:34:04.136288+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.045014+0000","last_change":"2021-11-18T10:21:40.044281+0000","last_active":"2021-11-18T10:21:40.045014+0000","last_peered":"2021-11-18T10:21:40.045014+0000","last_clean":"2021-11-18T10:21:40.045014+0000","last_became_active":"2021-11-18T10:21:40.044081+0000","last_became_peered":"2021-11-18T10:21:40.044081+0000","last_unstale":"2021-11-18T10:21:40.045014+0000","last_undegraded":"2021-11-18T10:21:40.045014+0000","last_fullsized":"2021-11-18T10:21:40.045014+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:18:27.904685+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.045673+0000","last_change":"2021-11-18T10:21:40.045052+0000","last_active":"2021-11-18T10:21:40.045673+0000","last_peered":"2021-11-18T10:21:40.045673+0000","last_clean":"2021-11-18T10:21:40.045673+0000","last_became_active":"2021-11-18T10:21:40.044859+0000","last_became_peered":"2021-11-18T10:21:40.044859+0000","last_unstale":"2021-11-18T10:21:40.045673+0000","last_undegraded":"2021-11-18T10:21:40.045673+0000","last_fullsized":"2021-11-18T10:21:40.045673+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T15:27:11.195161+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.044794+0000","last_change":"2021-11-18T10:21:40.044288+0000","last_active":"2021-11-18T10:21:40.044794+0000","last_peered":"2021-11-18T10:21:40.044794+0000","last_clean":"2021-11-18T10:21:40.044794+0000","last_became_active":"2021-11-18T10:21:40.044060+0000","last_became_peered":"2021-11-18T10:21:40.044060+0000","last_unstale":"2021-11-18T10:21:40.044794+0000","last_undegraded":"2021-11-18T10:21:40.044794+0000","last_fullsized":"2021-11-18T10:21:40.044794+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:49:21.306280+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'97","reported_seq":139,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.043084+0000","last_change":"2021-11-18T10:21:35.410830+0000","last_active":"2021-11-18T10:21:40.043084+0000","last_peered":"2021-11-18T10:21:40.043084+0000","last_clean":"2021-11-18T10:21:40.043084+0000","last_became_active":"2021-11-18T10:21:35.409874+0000","last_became_peered":"2021-11-18T10:21:35.409874+0000","last_unstale":"2021-11-18T10:21:40.043084+0000","last_undegraded":"2021-11-18T10:21:40.043084+0000","last_fullsized":"2021-11-18T10:21:40.043084+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:34.022748+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:34.022748+0000","last_clean_scrub_stamp":"2021-11-18T10:21:34.022748+0000","log_size":97,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T11:49:21.906630+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.044873+0000","last_change":"2021-11-18T10:21:40.044009+0000","last_active":"2021-11-18T10:21:40.044873+0000","last_peered":"2021-11-18T10:21:40.044873+0000","last_clean":"2021-11-18T10:21:40.044873+0000","last_became_active":"2021-11-18T10:21:40.043813+0000","last_became_peered":"2021-11-18T10:21:40.043813+0000","last_unstale":"2021-11-18T10:21:40.044873+0000","last_undegraded":"2021-11-18T10:21:40.044873+0000","last_fullsized":"2021-11-18T10:21:40.044873+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T10:28:33.431547+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.045134+0000","last_change":"2021-11-18T10:21:40.044456+0000","last_active":"2021-11-18T10:21:40.045134+0000","last_peered":"2021-11-18T10:21:40.045134+0000","last_clean":"2021-11-18T10:21:40.045134+0000","last_became_active":"2021-11-18T10:21:40.044049+0000","last_became_peered":"2021-11-18T10:21:40.044049+0000","last_unstale":"2021-11-18T10:21:40.045134+0000","last_undegraded":"2021-11-18T10:21:40.045134+0000","last_fullsized":"2021-11-18T10:21:40.045134+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T14:25:37.483933+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.045289+0000","last_change":"2021-11-18T10:21:40.044550+0000","last_active":"2021-11-18T10:21:40.045289+0000","last_peered":"2021-11-18T10:21:40.045289+0000","last_clean":"2021-11-18T10:21:40.045289+0000","last_became_active":"2021-11-18T10:21:40.044330+0000","last_became_peered":"2021-11-18T10:21:40.044330+0000","last_unstale":"2021-11-18T10:21:40.045289+0000","last_undegraded":"2021-11-18T10:21:40.045289+0000","last_fullsized":"2021-11-18T10:21:40.045289+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T18:20:33.814642+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2021-11-18T10:21:40.044998+0000","last_change":"2021-11-18T10:21:40.044245+0000","last_active":"2021-11-18T10:21:40.044998+0000","last_peered":"2021-11-18T10:21:40.044998+0000","last_clean":"2021-11-18T10:21:40.044998+0000","last_became_active":"2021-11-18T10:21:40.044049+0000","last_became_peered":"2021-11-18T10:21:40.044049+0000","last_unstale":"2021-11-18T10:21:40.044998+0000","last_undegraded":"2021-11-18T10:21:40.044998+0000","last_fullsized":"2021-11-18T10:21:40.044998+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-11-18T10:21:39.036028+0000","last_clean_scrub_stamp":"2021-11-18T10:21:39.036028+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2021-11-19T21:58:55.527993+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":137,"num_write_kb":1894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738374,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11720,"kb_used_data":128,"kb_used_omap":0,"kb_used_meta":11584,"kb_avail":94360120,"statfs":{"total":96636764160,"available":96624762880,"internally_reserved":0,"allocated":131072,"data_stored":36846,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":11862016},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.315}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]},{"osd":0,"up_from":8,"seq":34359738374,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12684,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":11968,"kb_avail":94359156,"statfs":{"total":96636764160,"available":96623775744,"internally_reserved":0,"allocated":724992,"data_stored":627214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12255232},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12748,"kb_used_data":708,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359092,"statfs":{"total":96636764160,"available":96623710208,"internally_reserved":0,"allocated":724992,"data_stored":627214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.16200000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.217}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2021-11-18T10:21:44.740 INFO:tasks.ceph.ceph_manager.cluster2:clean! 2021-11-18T10:21:44.740 INFO:tasks.ceph:Waiting until ceph cluster cluster2 is healthy... 2021-11-18T10:21:44.740 INFO:tasks.ceph.ceph_manager.cluster2:wait_until_healthy 2021-11-18T10:21:44.741 DEBUG:teuthology.orchestra.run.gibba019:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster cluster2 health --format=json 2021-11-18T10:21:44.983 INFO:teuthology.orchestra.run.gibba019.stdout: 2021-11-18T10:21:44.983 INFO:teuthology.orchestra.run.gibba019.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-11-18T10:21:44.993 INFO:tasks.ceph.ceph_manager.cluster2:wait_until_healthy done 2021-11-18T10:21:44.994 INFO:teuthology.run_tasks:Running task exec... 2021-11-18T10:21:45.004 INFO:teuthology.task.exec:Executing custom commands... 2021-11-18T10:21:45.005 INFO:teuthology.task.exec:Running commands on role cluster1.client.mirror.0 host ubuntu@gibba019.front.sepia.ceph.com 2021-11-18T10:21:45.005 DEBUG:teuthology.orchestra.run.gibba019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror mon '"'"'profile rbd-mirror-peer'"'"' osd '"'"'profile rbd'"'"'' 2021-11-18T10:21:45.284 INFO:teuthology.orchestra.run.gibba019.stderr:updated caps for client.mirror 2021-11-18T10:21:45.293 DEBUG:teuthology.orchestra.run.gibba019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.0 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-18T10:21:45.574 INFO:teuthology.orchestra.run.gibba019.stderr:updated caps for client.mirror.0 2021-11-18T10:21:45.583 DEBUG:teuthology.orchestra.run.gibba019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.1 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-18T10:21:45.863 INFO:teuthology.orchestra.run.gibba019.stderr:updated caps for client.mirror.1 2021-11-18T10:21:45.872 DEBUG:teuthology.orchestra.run.gibba019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.2 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-18T10:21:46.151 INFO:teuthology.orchestra.run.gibba019.stderr:updated caps for client.mirror.2 2021-11-18T10:21:46.159 DEBUG:teuthology.orchestra.run.gibba019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster1 auth caps client.mirror.3 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-18T10:21:46.439 INFO:teuthology.orchestra.run.gibba019.stderr:updated caps for client.mirror.3 2021-11-18T10:21:46.447 DEBUG:teuthology.orchestra.run.gibba019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror mon '"'"'profile rbd-mirror-peer'"'"' osd '"'"'profile rbd'"'"'' 2021-11-18T10:21:46.721 INFO:teuthology.orchestra.run.gibba019.stderr:updated caps for client.mirror 2021-11-18T10:21:46.731 DEBUG:teuthology.orchestra.run.gibba019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.0 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-18T10:21:47.004 INFO:teuthology.orchestra.run.gibba019.stderr:updated caps for client.mirror.0 2021-11-18T10:21:47.013 DEBUG:teuthology.orchestra.run.gibba019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.1 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-18T10:21:47.289 INFO:teuthology.orchestra.run.gibba019.stderr:updated caps for client.mirror.1 2021-11-18T10:21:47.297 DEBUG:teuthology.orchestra.run.gibba019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.2 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-18T10:21:47.574 INFO:teuthology.orchestra.run.gibba019.stderr:updated caps for client.mirror.2 2021-11-18T10:21:47.582 DEBUG:teuthology.orchestra.run.gibba019:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph --cluster cluster2 auth caps client.mirror.3 mon '"'"'profile rbd-mirror'"'"' osd '"'"'profile rbd'"'"'' 2021-11-18T10:21:47.858 INFO:teuthology.orchestra.run.gibba019.stderr:updated caps for client.mirror.3 2021-11-18T10:21:47.867 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-18T10:21:47.883 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Restarting daemon 2021-11-18T10:21:47.884 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 2021-11-18T10:21:47.887 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Started 2021-11-18T10:21:47.887 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-18T10:21:47.917 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2021-11-18T10:21:47.918 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2021-11-18T10:21:47.920 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2021-11-18T10:21:47.921 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-18T10:21:47.951 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Restarting daemon 2021-11-18T10:21:47.952 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 2021-11-18T10:21:47.954 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Started 2021-11-18T10:21:47.955 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-18T10:21:47.987 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Restarting daemon 2021-11-18T10:21:47.987 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.3 2021-11-18T10:21:47.990 INFO:tasks.rbd_mirror.cluster1.client.mirror.3:Started 2021-11-18T10:21:47.990 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-18T10:21:48.026 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2021-11-18T10:21:48.026 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2021-11-18T10:21:48.029 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2021-11-18T10:21:48.029 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-18T10:21:48.056 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2021-11-18T10:21:48.056 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2021-11-18T10:21:48.058 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2021-11-18T10:21:48.059 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-18T10:21:48.087 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Restarting daemon 2021-11-18T10:21:48.088 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 2021-11-18T10:21:48.090 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Started 2021-11-18T10:21:48.090 INFO:teuthology.run_tasks:Running task rbd-mirror... 2021-11-18T10:21:48.120 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Restarting daemon 2021-11-18T10:21:48.120 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.3 2021-11-18T10:21:48.122 INFO:tasks.rbd_mirror.cluster2.client.mirror.3:Started 2021-11-18T10:21:48.123 INFO:teuthology.run_tasks:Running task rbd-mirror-thrash... 2021-11-18T10:21:48.155 INFO:tasks.rbd_mirror_thrash:rbd_mirror_thrash using random seed: 1637230908 2021-11-18T10:21:48.156 DEBUG:tasks.rbd_mirror_thrash:Yielding 2021-11-18T10:21:48.156 INFO:teuthology.run_tasks:Running task rbd-mirror-thrash... 2021-11-18T10:21:48.189 INFO:tasks.rbd_mirror_thrash:rbd_mirror_thrash using random seed: 1637230908 2021-11-18T10:21:48.189 DEBUG:tasks.rbd_mirror_thrash:Yielding 2021-11-18T10:21:48.189 INFO:teuthology.run_tasks:Running task workunit... 2021-11-18T10:21:48.224 INFO:tasks.workunit:Pulling workunits from ref 44cd7c7650ed2227d3597352b00bd2ef65f4388f 2021-11-18T10:21:48.225 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-11-18T10:21:48.225 DEBUG:teuthology.orchestra.run.gibba019:> stat -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2021-11-18T10:21:48.226 INFO:tasks.rbd_mirror_thrash:starting thrash for cluster cluster1 2021-11-18T10:21:48.227 INFO:tasks.rbd_mirror_thrash:waiting for 117 secs before thrashing 2021-11-18T10:21:48.227 INFO:tasks.rbd_mirror_thrash:starting thrash for cluster cluster2 2021-11-18T10:21:48.227 INFO:tasks.rbd_mirror_thrash:waiting for 64 secs before thrashing 2021-11-18T10:21:48.238 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:21:48.239 INFO:teuthology.orchestra.run.gibba019.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.cluster1.mirror': No such file or directory 2021-11-18T10:21:48.239 DEBUG:teuthology.orchestra.run.gibba019:> mkdir -- /home/ubuntu/cephtest/mnt.cluster1.mirror 2021-11-18T10:21:48.290 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.cluster1.mirror 2021-11-18T10:21:48.291 DEBUG:teuthology.orchestra.run.gibba019:> cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror && mkdir -- client.mirror 2021-11-18T10:21:48.343 INFO:tasks.workunit:timeout=6h 2021-11-18T10:21:48.343 INFO:tasks.workunit:cleanup=True 2021-11-18T10:21:48.344 DEBUG:teuthology.orchestra.run.gibba019:> rm -rf /home/ubuntu/cephtest/clone.cluster1.client.mirror && git clone https://github.com/ceph/ceph.git /home/ubuntu/cephtest/clone.cluster1.client.mirror && cd /home/ubuntu/cephtest/clone.cluster1.client.mirror && git checkout 44cd7c7650ed2227d3597352b00bd2ef65f4388f 2021-11-18T10:21:48.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Cloning into '/home/ubuntu/cephtest/clone.cluster1.client.mirror'... 2021-11-18T10:22:14.795 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Note: switching to '44cd7c7650ed2227d3597352b00bd2ef65f4388f'. 2021-11-18T10:22:14.796 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:22:14.796 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-11-18T10:22:14.796 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:changes and commit them, and you can discard any commits you make in this 2021-11-18T10:22:14.796 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:state without impacting any branches by switching back to a branch. 2021-11-18T10:22:14.796 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:22:14.797 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:If you want to create a new branch to retain commits you create, you may 2021-11-18T10:22:14.797 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:do so (now or later) by using -c with the switch command. Example: 2021-11-18T10:22:14.797 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:22:14.797 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: git switch -c 2021-11-18T10:22:14.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:22:14.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Or undo this operation with: 2021-11-18T10:22:14.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:22:14.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: git switch - 2021-11-18T10:22:14.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:22:14.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-11-18T10:22:14.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:22:14.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:HEAD is now at 44cd7c7650e Merge pull request #42046 from CongMinYin/align-entry-bit 2021-11-18T10:22:14.801 DEBUG:teuthology.orchestra.run.gibba019:> cd -- /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror 2021-11-18T10:22:14.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-11-18T10:22:14.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2021-11-18T10:22:14.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-11-18T10:22:15.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-11-18T10:22:15.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-11-18T10:22:15.489 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/direct_io' 2021-11-18T10:22:15.490 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2021-11-18T10:22:15.490 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-11-18T10:22:15.516 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/fs' 2021-11-18T10:22:15.518 DEBUG:teuthology.orchestra.run.gibba019:> set -ex 2021-11-18T10:22:15.518 DEBUG:teuthology.orchestra.run.gibba019:> dd if=/home/ubuntu/cephtest/workunits.list.cluster1.client.mirror of=/dev/stdout 2021-11-18T10:22:15.571 INFO:tasks.workunit:Running workunits matching rbd/rbd_mirror_stress.sh on cluster1.client.mirror... 2021-11-18T10:22:15.573 INFO:tasks.workunit:Running workunit rbd/rbd_mirror_stress.sh... 2021-11-18T10:22:15.573 DEBUG:teuthology.orchestra.run.gibba019:workunit test rbd/rbd_mirror_stress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && cd -- /home/ubuntu/cephtest/mnt.cluster1.mirror/client.mirror/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=44cd7c7650ed2227d3597352b00bd2ef65f4388f TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster cluster1" CEPH_ID="mirror" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror CEPH_MNT=/home/ubuntu/cephtest/mnt.cluster1.mirror CEPH_ARGS='' MIRROR_IMAGE_MODE=snapshot MIRROR_POOL_MODE=image RBD_IMAGE_FEATURES=layering,exclusive-lock RBD_MIRROR_INSTANCES=4 RBD_MIRROR_USE_EXISTING_CLUSTER=1 RBD_MIRROR_USE_RBD_MIRROR=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh 2021-11-18T10:22:15.626 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ IMAGE_COUNT=50 2021-11-18T10:22:15.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ export LOCKDEP=0 2021-11-18T10:22:15.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ LOCKDEP=0 2021-11-18T10:22:15.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh 2021-11-18T10:22:15.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ . /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_helpers.sh 2021-11-18T10:22:15.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ type xmlstarlet 2021-11-18T10:22:15.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ XMLSTARLET=xmlstarlet 2021-11-18T10:22:15.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ RBD_MIRROR_INSTANCES=4 2021-11-18T10:22:15.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ CLUSTER1=cluster1 2021-11-18T10:22:15.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ CLUSTER2=cluster2 2021-11-18T10:22:15.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ PEER_CLUSTER_SUFFIX= 2021-11-18T10:22:15.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ POOL=mirror 2021-11-18T10:22:15.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ PARENT_POOL=mirror_parent 2021-11-18T10:22:15.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ NS1=ns1 2021-11-18T10:22:15.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ NS2=ns2 2021-11-18T10:22:15.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ TEMPDIR= 2021-11-18T10:22:15.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ CEPH_ID=mirror 2021-11-18T10:22:15.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ RBD_IMAGE_FEATURES=layering,exclusive-lock 2021-11-18T10:22:15.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ MIRROR_USER_ID_PREFIX=mirror. 2021-11-18T10:22:15.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ MIRROR_POOL_MODE=image 2021-11-18T10:22:15.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ MIRROR_IMAGE_MODE=snapshot 2021-11-18T10:22:15.634 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ export 'CEPH_ARGS=--id mirror' 2021-11-18T10:22:15.634 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ CEPH_ARGS='--id mirror' 2021-11-18T10:22:15.634 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ LAST_MIRROR_INSTANCE=3 2021-11-18T10:22:15.634 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ dirname /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/rbd_mirror_stress.sh 2021-11-18T10:22:15.634 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ readlink -f /home/ubuntu/cephtest/clone.cluster1.client.mirror/qa/workunits/rbd/../../../src 2021-11-18T10:22:15.635 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ CEPH_ROOT=/home/ubuntu/cephtest/clone.cluster1.client.mirror/src 2021-11-18T10:22:15.635 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ CEPH_BIN=. 2021-11-18T10:22:15.635 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ CEPH_SRC=. 2021-11-18T10:22:15.635 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' -e CMakeCache.txt ']' 2021-11-18T10:22:15.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 -gt 0 ']' 2021-11-18T10:22:15.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ setup 2021-11-18T10:22:15.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local c 2021-11-18T10:22:15.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ trap 'cleanup $?' INT TERM EXIT 2021-11-18T10:22:15.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ setup_tempdir 2021-11-18T10:22:15.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:15.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mktemp -d 2021-11-18T10:22:15.639 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ TEMPDIR=/tmp/tmp.S6ytW1uNG1 2021-11-18T10:22:15.639 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -z 1 ']' 2021-11-18T10:22:15.639 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ setup_pools cluster1 cluster2 2021-11-18T10:22:15.639 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:22:15.640 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local remote_cluster=cluster2 2021-11-18T10:22:15.640 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mon_map_file 2021-11-18T10:22:15.640 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mon_addr 2021-11-18T10:22:15.640 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local admin_key_file 2021-11-18T10:22:15.640 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local uuid 2021-11-18T10:22:15.641 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:22:15.641 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ ceph --cluster cluster1 osd pool create mirror 64 64 2021-11-18T10:22:16.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:pool 'mirror' already exists 2021-11-18T10:22:16.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:22:16.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ ceph --cluster cluster1 osd pool create mirror_parent 64 64 2021-11-18T10:22:17.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:pool 'mirror_parent' already exists 2021-11-18T10:22:17.264 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:22:17.265 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 pool init mirror 2021-11-18T10:22:20.192 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:22:20.192 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 pool init mirror_parent 2021-11-18T10:22:23.198 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:23.199 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:22:23.199 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool enable --site-name cluster1 mirror image 2021-11-18T10:22:23.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool enable mirror_parent image 2021-11-18T10:22:23.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 namespace create mirror/ns1 2021-11-18T10:22:23.283 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 namespace create mirror/ns2 2021-11-18T10:22:23.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool enable mirror/ns1 image 2021-11-18T10:22:23.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool enable mirror/ns2 image 2021-11-18T10:22:23.362 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -z ']' 2021-11-18T10:22:23.362 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -z ']' 2021-11-18T10:22:23.362 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ peer_add cluster1 mirror cluster2 2021-11-18T10:22:23.362 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:22:23.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:23.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:22:23.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:23.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local client_cluster=cluster2 2021-11-18T10:22:23.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:23.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local remote_cluster=cluster2 2021-11-18T10:22:23.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local uuid_var_name 2021-11-18T10:22:23.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:23.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local error_code 2021-11-18T10:22:23.365 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local peer_uuid 2021-11-18T10:22:23.365 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 16 32 2021-11-18T10:22:23.365 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:22:23.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ rbd --cluster cluster1 mirror pool peer add mirror cluster2 2021-11-18T10:22:23.387 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ peer_uuid=0edf223a-3446-4e60-928f-a6beb92bec8d 2021-11-18T10:22:23.388 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=0 2021-11-18T10:22:23.388 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:22:23.388 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 0 -eq 17 ']' 2021-11-18T10:22:23.388 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 0 -eq 0 2021-11-18T10:22:23.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:23.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:22:23.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ peer_add cluster1 mirror_parent cluster2 2021-11-18T10:22:23.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:22:23.390 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:23.390 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror_parent 2021-11-18T10:22:23.390 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:23.390 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local client_cluster=cluster2 2021-11-18T10:22:23.390 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:23.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local remote_cluster=cluster2 2021-11-18T10:22:23.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local uuid_var_name 2021-11-18T10:22:23.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:23.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local error_code 2021-11-18T10:22:23.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local peer_uuid 2021-11-18T10:22:23.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 16 32 2021-11-18T10:22:23.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:22:23.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ rbd --cluster cluster1 mirror pool peer add mirror_parent cluster2 2021-11-18T10:22:23.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ peer_uuid=06e7ede9-9c62-4676-9da4-2d3026351ad0 2021-11-18T10:22:23.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=0 2021-11-18T10:22:23.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:22:23.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 0 -eq 17 ']' 2021-11-18T10:22:23.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 0 -eq 0 2021-11-18T10:22:23.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:23.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:22:23.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ setup_pools cluster2 cluster1 2021-11-18T10:22:23.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:22:23.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local remote_cluster=cluster1 2021-11-18T10:22:23.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mon_map_file 2021-11-18T10:22:23.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mon_addr 2021-11-18T10:22:23.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local admin_key_file 2021-11-18T10:22:23.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local uuid 2021-11-18T10:22:23.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:22:23.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ ceph --cluster cluster2 osd pool create mirror 64 64 2021-11-18T10:22:23.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:pool 'mirror' already exists 2021-11-18T10:22:23.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:22:23.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ ceph --cluster cluster2 osd pool create mirror_parent 64 64 2021-11-18T10:22:24.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:pool 'mirror_parent' already exists 2021-11-18T10:22:24.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:22:24.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 pool init mirror 2021-11-18T10:22:27.769 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:22:27.770 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 pool init mirror_parent 2021-11-18T10:22:30.776 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:30.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:22:30.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror pool enable --site-name cluster2 mirror image 2021-11-18T10:22:30.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror pool enable mirror_parent image 2021-11-18T10:22:30.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 namespace create mirror/ns1 2021-11-18T10:22:30.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 namespace create mirror/ns2 2021-11-18T10:22:30.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror pool enable mirror/ns1 image 2021-11-18T10:22:30.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror pool enable mirror/ns2 image 2021-11-18T10:22:30.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -z ']' 2021-11-18T10:22:30.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -z ']' 2021-11-18T10:22:30.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ peer_add cluster2 mirror cluster1 2021-11-18T10:22:30.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:22:30.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:30.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:22:30.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:30.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local client_cluster=cluster1 2021-11-18T10:22:30.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:30.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local remote_cluster=cluster1 2021-11-18T10:22:30.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local uuid_var_name 2021-11-18T10:22:30.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:30.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local error_code 2021-11-18T10:22:30.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local peer_uuid 2021-11-18T10:22:30.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 16 32 2021-11-18T10:22:30.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:22:30.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ rbd --cluster cluster2 mirror pool peer add mirror cluster1 2021-11-18T10:22:30.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ peer_uuid=b46c25fa-1e9e-4ead-ba92-e5ff02ab46d3 2021-11-18T10:22:30.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=0 2021-11-18T10:22:30.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:22:30.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 0 -eq 17 ']' 2021-11-18T10:22:30.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 0 -eq 0 2021-11-18T10:22:30.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:30.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:22:30.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ peer_add cluster2 mirror_parent cluster1 2021-11-18T10:22:30.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:22:30.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:30.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror_parent 2021-11-18T10:22:30.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:30.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local client_cluster=cluster1 2021-11-18T10:22:30.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:30.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local remote_cluster=cluster1 2021-11-18T10:22:30.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local uuid_var_name 2021-11-18T10:22:30.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:30.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local error_code 2021-11-18T10:22:30.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local peer_uuid 2021-11-18T10:22:30.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 16 32 2021-11-18T10:22:30.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:22:30.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ rbd --cluster cluster2 mirror pool peer add mirror_parent cluster1 2021-11-18T10:22:30.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ peer_uuid=53259178-fada-4f20-9a5f-2075628dc3ef 2021-11-18T10:22:30.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=0 2021-11-18T10:22:30.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:22:30.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 0 -eq 17 ']' 2021-11-18T10:22:30.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 0 -eq 0 2021-11-18T10:22:30.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:30.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:22:30.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:22:30.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ start_mirrors cluster1 2021-11-18T10:22:30.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:22:30.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ seq 0 3 2021-11-18T10:22:30.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:30.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ start_mirror cluster1:0 2021-11-18T10:22:30.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1:0 2021-11-18T10:22:30.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance 2021-11-18T10:22:30.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:22:30.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local val=cluster1:0 2021-11-18T10:22:30.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster_var_name=cluster 2021-11-18T10:22:30.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance_var_name=instance 2021-11-18T10:22:30.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cluster=cluster1 2021-11-18T10:22:30.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ instance=0 2021-11-18T10:22:30.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:30.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval cluster=cluster1 2021-11-18T10:22:30.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:30.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval instance=0 2021-11-18T10:22:30.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:22:30.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n 1 2021-11-18T10:22:30.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 2021-11-18T10:22:30.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:30.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ start_mirror cluster1:1 2021-11-18T10:22:30.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1:1 2021-11-18T10:22:30.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance 2021-11-18T10:22:31.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:22:31.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local val=cluster1:1 2021-11-18T10:22:31.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster_var_name=cluster 2021-11-18T10:22:31.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance_var_name=instance 2021-11-18T10:22:31.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cluster=cluster1 2021-11-18T10:22:31.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ instance=1 2021-11-18T10:22:31.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:31.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval cluster=cluster1 2021-11-18T10:22:31.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:31.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval instance=1 2021-11-18T10:22:31.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:22:31.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n 1 2021-11-18T10:22:31.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 2021-11-18T10:22:31.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:31.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ start_mirror cluster1:2 2021-11-18T10:22:31.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1:2 2021-11-18T10:22:31.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance 2021-11-18T10:22:31.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:22:31.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local val=cluster1:2 2021-11-18T10:22:31.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster_var_name=cluster 2021-11-18T10:22:31.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance_var_name=instance 2021-11-18T10:22:31.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cluster=cluster1 2021-11-18T10:22:31.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ instance=2 2021-11-18T10:22:31.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 2 = cluster1:2 ']' 2021-11-18T10:22:31.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval cluster=cluster1 2021-11-18T10:22:31.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:31.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval instance=2 2021-11-18T10:22:31.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:22:31.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n 1 2021-11-18T10:22:31.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 2021-11-18T10:22:31.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:31.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ start_mirror cluster1:3 2021-11-18T10:22:31.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1:3 2021-11-18T10:22:31.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance 2021-11-18T10:22:31.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:22:31.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local val=cluster1:3 2021-11-18T10:22:31.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster_var_name=cluster 2021-11-18T10:22:31.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance_var_name=instance 2021-11-18T10:22:31.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cluster=cluster1 2021-11-18T10:22:31.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ instance=3 2021-11-18T10:22:31.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 3 = cluster1:3 ']' 2021-11-18T10:22:31.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval cluster=cluster1 2021-11-18T10:22:31.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:31.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval instance=3 2021-11-18T10:22:31.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:22:31.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n 1 2021-11-18T10:22:31.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 2021-11-18T10:22:31.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ start_mirrors cluster2 2021-11-18T10:22:31.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:22:31.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ seq 0 3 2021-11-18T10:22:31.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:31.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ start_mirror cluster2:0 2021-11-18T10:22:31.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2:0 2021-11-18T10:22:31.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance 2021-11-18T10:22:31.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set_cluster_instance cluster2:0 cluster instance 2021-11-18T10:22:31.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local val=cluster2:0 2021-11-18T10:22:31.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster_var_name=cluster 2021-11-18T10:22:31.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance_var_name=instance 2021-11-18T10:22:31.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cluster=cluster2 2021-11-18T10:22:31.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ instance=0 2021-11-18T10:22:31.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 0 = cluster2:0 ']' 2021-11-18T10:22:31.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval cluster=cluster2 2021-11-18T10:22:31.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster2 2021-11-18T10:22:31.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval instance=0 2021-11-18T10:22:31.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:22:31.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n 1 2021-11-18T10:22:31.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 2021-11-18T10:22:31.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:31.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ start_mirror cluster2:1 2021-11-18T10:22:31.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2:1 2021-11-18T10:22:31.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance 2021-11-18T10:22:31.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set_cluster_instance cluster2:1 cluster instance 2021-11-18T10:22:31.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local val=cluster2:1 2021-11-18T10:22:31.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster_var_name=cluster 2021-11-18T10:22:31.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance_var_name=instance 2021-11-18T10:22:31.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cluster=cluster2 2021-11-18T10:22:31.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ instance=1 2021-11-18T10:22:31.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 1 = cluster2:1 ']' 2021-11-18T10:22:31.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval cluster=cluster2 2021-11-18T10:22:31.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster2 2021-11-18T10:22:31.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval instance=1 2021-11-18T10:22:31.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:22:31.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n 1 2021-11-18T10:22:31.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 2021-11-18T10:22:31.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:31.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ start_mirror cluster2:2 2021-11-18T10:22:31.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2:2 2021-11-18T10:22:31.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance 2021-11-18T10:22:31.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set_cluster_instance cluster2:2 cluster instance 2021-11-18T10:22:31.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local val=cluster2:2 2021-11-18T10:22:31.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster_var_name=cluster 2021-11-18T10:22:31.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance_var_name=instance 2021-11-18T10:22:31.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cluster=cluster2 2021-11-18T10:22:31.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ instance=2 2021-11-18T10:22:31.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 2 = cluster2:2 ']' 2021-11-18T10:22:31.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval cluster=cluster2 2021-11-18T10:22:31.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster2 2021-11-18T10:22:31.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval instance=2 2021-11-18T10:22:31.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:22:31.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n 1 2021-11-18T10:22:31.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 2021-11-18T10:22:31.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:31.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ start_mirror cluster2:3 2021-11-18T10:22:31.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2:3 2021-11-18T10:22:31.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance 2021-11-18T10:22:31.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set_cluster_instance cluster2:3 cluster instance 2021-11-18T10:22:31.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local val=cluster2:3 2021-11-18T10:22:31.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster_var_name=cluster 2021-11-18T10:22:31.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local instance_var_name=instance 2021-11-18T10:22:31.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cluster=cluster2 2021-11-18T10:22:31.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ instance=3 2021-11-18T10:22:31.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 3 = cluster2:3 ']' 2021-11-18T10:22:31.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval cluster=cluster2 2021-11-18T10:22:31.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster2 2021-11-18T10:22:31.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ eval instance=3 2021-11-18T10:22:31.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:22:31.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n 1 2021-11-18T10:22:31.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 2021-11-18T10:22:31.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ testlog 'TEST: add image and test replay after client crashes' 2021-11-18T10:22:31.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee -a /tmp/tmp.S6ytW1uNG1/rbd-mirror.test.log 2021-11-18T10:22:31.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ date '+%F %T' 2021-11-18T10:22:31.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo 2021-11-18 10:22:30 TEST: add image and test replay after client crashes 2021-11-18T10:22:31.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18 10:22:30 TEST: add image and test replay after client crashes 2021-11-18T10:22:31.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=test 2021-11-18T10:22:31.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror test snapshot 512M 2021-11-18T10:22:31.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:22:31.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:31.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:22:31.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:31.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:22:31.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:31.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:22:31.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:22:31.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:31.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror test 512M 2021-11-18T10:22:31.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:22:31.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:31.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:22:31.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:31.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:22:31.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:31.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:22:31.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 512M ']' 2021-11-18T10:22:31.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=512M 2021-11-18T10:22:31.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:22:31.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 512M --image-feature layering,exclusive-lock mirror/test 2021-11-18T10:22:31.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:22:31.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror test snapshot 2021-11-18T10:22:31.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:22:31.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:22:31.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:22:31.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:22:31.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/test snapshot 2021-11-18T10:22:31.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:22:31.823 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/test 2021-11-18T10:22:31.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:22:31.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:22:31.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:22:31.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:22:31.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10a178a09a45 2021-11-18T10:22:31.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10a178a09a45 2021-11-18T10:22:31.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:22:31.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:22:31.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:22:31.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:22:31.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:31 2021 2021-11-18T10:22:31.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:22:31 2021 2021-11-18T10:22:31.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:31 2021 2021-11-18T10:22:31.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:22:31.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:22:31.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:22:31.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:22:31.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:22:31.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:22:31.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:22:31.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:22:31.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:22:31.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:22:31.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:22:31.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:22:31.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:22:31.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:22:31.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:22:31.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:22:32.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:22:32.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:22:32.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:22:32.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:22:32.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:22:32.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:22:32.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:22:32.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:22:32.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:22:32.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:32.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:22:32.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:22:32.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:22:32.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:22:32.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:22:32.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:22:32.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:22:32.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:22:32.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:32.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:22:32.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:22:32.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:32.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:32.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:22:32.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:22:32.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:32.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:32.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:32.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:22:32.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:32.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:32.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:32.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:22:32.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:32.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:22:32.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:22:32.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:32.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:32.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:22:32.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:22:32.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:32.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:32.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:32.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:32.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:32.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:32.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:32.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:22:32.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:22:32.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:22:32.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:32.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:32.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:32.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:22:32.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:32.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:32.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:32.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:32.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:22:32.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:22:32.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:32.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:32.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:22:32.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:22:32.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:32.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:32.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:32.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:22:32.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:32.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:32.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:32.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:22:32.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:32.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:22:32.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:22:32.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:32.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:32.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:22:32.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:22:32.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:32.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:32.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:32.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:32.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:32.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:32.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:32.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:22:32.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:22:32.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:22:32.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:32.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:32.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:32.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:22:33.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:33.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:33.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:33.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:33.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:22:33.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:22:33.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:33.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:33.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:22:33.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:22:33.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:33.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:33.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:33.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:22:33.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:22:33.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:33.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:33.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:22:33.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:22:33.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:22:33.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:22:33.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:33.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:33.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:22:33.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:22:33.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:33.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:33.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:33.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:22:33.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:22:33.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:33.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:33.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:22:33.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:22:33.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:22:33.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:33.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:33.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:33.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:22:33.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:33.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:33.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:33.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:33.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:22:33.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:22:33.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:33.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:33.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:22:33.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:22:33.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:33.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:33.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:33.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:22:33.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:22:33.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:33.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:33.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:22:33.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:22:33.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:22:33.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:22:33.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:33.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:33.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:22:33.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:22:33.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:33.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:33.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:33.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:22:33.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:22:33.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:33.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:33.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:22:33.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:22:33.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:22:33.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:33.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:33.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:33.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:22:33.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:33.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:33.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:33.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:22:33.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 1 2021-11-18T10:22:34.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:22:34.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:22:34.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:34.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:22:34.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:22:34.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:34.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:34.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:22:34.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:22:34.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:34.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:34.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:34.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:22:34.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:34.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:34.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:34.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:22:34.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:34.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:22:34.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:22:34.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:34.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:34.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:22:34.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:22:34.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:34.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:34.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:34.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:34.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:34.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:34.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:34.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:22:34.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:22:34.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:22:34.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:34.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:34.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:34.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:22:34.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:34.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:34.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:34.244 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:34.244 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:22:34.245 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:22:34.245 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:34.245 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:34.245 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:22:34.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:22:34.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:34.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:34.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:34.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:22:34.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:34.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:34.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:34.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:22:34.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:34.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:22:34.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:22:34.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:34.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:34.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:22:34.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:22:34.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:34.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:34.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:34.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:34.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:34.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:34.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:34.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:22:34.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:22:34.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:22:34.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:34.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:34.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:34.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:22:34.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:34.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:34.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:34.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:34.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:22:34.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:22:34.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:34.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:34.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:22:34.322 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:22:34.322 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:34.322 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:34.322 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:34.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:22:34.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:22:34.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:34.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:34.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:22:34.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:22:34.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:22:34.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:22:34.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:34.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:34.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:22:34.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:22:34.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:34.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:34.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:34.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:22:34.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:22:34.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:34.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:34.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:22:34.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:22:34.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:22:34.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:34.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:34.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:34.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:22:34.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:34.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:34.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:34.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:34.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:22:34.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:22:34.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:34.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:34.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:22:34.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:22:34.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:34.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:34.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:34.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:22:34.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:22:34.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:34.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:34.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:22:34.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:22:34.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:22:34.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:22:34.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:34.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:34.402 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:22:34.402 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:22:34.402 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:34.402 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:34.403 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:34.403 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:22:34.403 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:22:34.403 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:34.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:34.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:22:34.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:22:34.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:22:34.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:34.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:34.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:34.407 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:22:34.469 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:34.470 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:34.470 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:34.471 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:22:34.471 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 2 2021-11-18T10:22:36.472 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:22:36.472 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:22:36.477 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:36.477 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:22:36.478 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:22:36.478 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:36.478 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:36.479 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:22:36.479 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:22:36.479 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:36.480 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:36.480 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:36.480 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:22:36.481 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:36.481 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:36.481 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:36.481 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:22:36.481 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:36.482 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:22:36.482 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:22:36.482 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:36.482 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:36.483 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:22:36.483 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:22:36.483 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:36.483 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:36.484 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:36.484 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:36.484 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:36.484 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:36.484 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:36.485 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:22:36.485 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:22:36.485 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:22:36.486 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:36.486 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:36.486 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:36.487 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:22:36.548 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:36.548 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:36.548 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:36.551 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:36.551 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:22:36.552 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:22:36.552 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:36.552 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:36.552 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:22:36.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:22:36.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:36.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:36.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:36.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:22:36.554 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:36.554 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:36.554 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:36.554 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:22:36.555 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:36.555 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:22:36.555 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:22:36.555 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:36.555 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:36.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:22:36.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:22:36.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:36.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:36.557 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:36.557 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:36.557 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:36.557 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:36.557 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:36.558 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:22:36.558 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:22:36.558 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:22:36.560 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:36.561 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:36.561 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:36.561 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:22:36.623 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:36.624 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:36.624 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:36.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:36.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:22:36.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:22:36.628 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:36.628 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:36.628 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:22:36.628 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:22:36.628 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:36.629 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:36.629 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:36.629 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:22:36.629 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:22:36.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:36.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:36.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:22:36.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:22:36.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:22:36.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:22:36.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:36.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:36.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:22:36.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:22:36.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:36.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:36.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:36.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:22:36.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:22:36.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:36.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:36.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:22:36.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:22:36.634 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:22:36.636 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:36.636 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:36.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:36.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:22:36.700 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:36.700 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:36.700 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:36.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:36.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:22:36.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:22:36.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:36.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:36.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:22:36.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:22:36.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:36.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:36.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:36.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:22:36.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:22:36.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:36.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:36.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:22:36.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:22:36.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:22:36.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:22:36.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:36.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:36.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:22:36.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:22:36.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:36.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:36.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:36.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:22:36.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:22:36.710 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:36.710 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:36.710 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:22:36.710 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:22:36.710 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:22:36.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:36.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:36.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:36.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:22:36.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:36.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:36.778 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:36.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:22:36.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 4 2021-11-18T10:22:40.778 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:22:40.778 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:22:40.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:40.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:22:40.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:22:40.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:40.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:40.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:22:40.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:22:40.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:40.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:40.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:40.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:22:40.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:40.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:40.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:40.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:22:40.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:40.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:22:40.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:22:40.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:40.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:40.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:22:40.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:22:40.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:40.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:40.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:40.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:40.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:40.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:40.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:40.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:22:40.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:22:40.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:22:40.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:40.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:40.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:40.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:22:40.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:40.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:40.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:40.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:40.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:22:40.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:22:40.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:40.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:40.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:22:40.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:22:40.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:40.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:40.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:40.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:22:40.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:40.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:40.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:40.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:22:40.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:40.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:22:40.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:22:40.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:40.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:40.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:22:40.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:22:40.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:40.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:40.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:40.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:40.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:40.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:40.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:40.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:22:40.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:22:40.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:22:40.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:40.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:40.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:40.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:22:40.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:40.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:40.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:40.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:40.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:22:40.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:22:40.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:40.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:40.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:22:40.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:22:40.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:40.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:40.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:40.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:22:40.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:22:40.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:40.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:40.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:22:40.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:22:40.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:22:40.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:22:40.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:40.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:40.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:22:40.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:22:40.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:40.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:40.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:40.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:22:40.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:22:40.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:40.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:40.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:22:40.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:22:40.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:22:40.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:40.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:40.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:40.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:22:41.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:41.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:41.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:41.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:41.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:22:41.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:22:41.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:41.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:41.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:22:41.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:22:41.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:41.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:41.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:41.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:22:41.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:22:41.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:41.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:41.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:22:41.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:22:41.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:22:41.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:22:41.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:41.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:41.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:22:41.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:22:41.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:41.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:41.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:41.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:22:41.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:22:41.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:41.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:41.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:22:41.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:22:41.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:22:41.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:41.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:41.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:41.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:22:41.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:41.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:41.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:41.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:22:41.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 8 2021-11-18T10:22:49.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:22:49.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:22:49.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:49.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:22:49.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:22:49.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:49.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:49.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:22:49.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:22:49.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:49.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:49.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:49.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:22:49.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:49.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:49.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:49.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:22:49.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:49.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:22:49.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:22:49.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:49.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:49.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:22:49.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:22:49.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:49.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:49.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:49.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:49.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:49.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:49.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:49.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:22:49.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:22:49.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:22:49.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:49.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:49.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:49.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:22:49.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:49.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:49.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:49.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:49.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:22:49.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:22:49.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:49.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:49.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:22:49.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:22:49.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:49.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:49.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:49.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:22:49.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:49.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:49.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:49.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:22:49.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:49.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:22:49.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:22:49.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:49.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:49.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:22:49.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:22:49.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:49.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:49.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:49.179 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:49.179 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:49.179 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:49.179 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:49.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:22:49.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:22:49.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:22:49.181 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:49.181 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:49.182 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:49.182 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:22:49.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:49.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:49.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:49.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:49.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:22:49.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:22:49.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:49.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:49.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:22:49.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:22:49.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:49.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:49.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:49.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:22:49.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:22:49.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:49.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:49.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:22:49.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:22:49.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:22:49.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:22:49.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:49.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:49.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:22:49.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:22:49.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:49.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:49.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:49.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:22:49.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:22:49.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:49.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:49.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:22:49.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:22:49.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:22:49.259 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:49.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:49.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:22:49.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:22:49.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:49.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:49.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:49.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:49.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:22:49.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:22:49.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:49.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:49.365 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:22:49.365 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:22:49.365 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:49.365 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:49.365 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:49.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:22:49.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:22:49.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:49.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:49.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:22:49.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:22:49.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:22:49.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:22:49.368 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:49.368 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:49.368 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:22:49.368 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:22:49.368 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:49.369 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:49.369 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:49.369 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:22:49.369 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:22:49.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:49.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:49.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:22:49.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:22:49.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:22:49.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:49.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:49.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:22:49.372 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:22:49.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:49.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:49.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:49.405 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:22:49.405 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 8 2021-11-18T10:22:52.228 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2021-11-18T10:22:52.229 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2021-11-18T10:22:52.231 INFO:tasks.rbd_mirror_thrash:waiting for 5 secs before reviving daemons 2021-11-18T10:22:52.231 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba019.stderr:2021-11-18T10:22:52.232+0000 7f40712b4700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 39869) UID: 1000 2021-11-18T10:22:52.431 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:22:57.231 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2021-11-18T10:22:57.232 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:22:57.232 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:22:57.233 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2021-11-18T10:22:57.233 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2021-11-18T10:22:57.233 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2021-11-18T10:22:57.236 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2021-11-18T10:22:57.237 INFO:tasks.rbd_mirror_thrash:waiting for 75 secs before thrashing 2021-11-18T10:22:57.405 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:22:57.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:22:57.409 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:57.409 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:22:57.409 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:22:57.409 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:57.410 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:57.410 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:22:57.410 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:22:57.410 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:57.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:57.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:57.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:22:57.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:57.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:57.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:57.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:22:57.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:57.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:22:57.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:22:57.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:57.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:57.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:22:57.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:22:57.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:57.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:57.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:57.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:22:57.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:22:57.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:57.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:57.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:22:57.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:22:57.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:22:57.418 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:57.418 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:57.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:22:57.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:22:57.485 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:22:57.486 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:22:57.486 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:22:57.489 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:22:57.489 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:22:57.489 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:22:57.490 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:22:57.490 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:22:57.490 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:22:57.490 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:22:57.491 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:22:57.491 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:22:57.491 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:22:57.491 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:22:57.491 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:57.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:22:57.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:57.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:22:57.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:57.493 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:22:57.493 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:22:57.493 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:22:57.493 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:22:57.493 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:22:57.494 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:22:57.494 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:22:57.494 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:22:57.494 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:22:57.495 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:22:57.495 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:22:57.495 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:22:57.495 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:22:57.495 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:22:57.496 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:22:57.496 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:22:57.498 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:57.498 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:57.498 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:22:57.499 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:22:57.572 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:22:57.572 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:22:57.572 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:22:57.572 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:22:57.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:22:57.575 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:22:57.576 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:22:57.576 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:22:57.576 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ clean_snap_name= 2021-11-18T10:22:57.576 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ seq 1 10 2021-11-18T10:22:57.577 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:22:57.577 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror test 2021-11-18T10:22:57.577 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:22:57.577 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:22:57.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:22:57.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:22:57.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=12 2021-11-18T10:22:57.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:22:57.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 12s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-18T10:22:57.644 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 21173248 bytes 2021-11-18T10:22:57.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 59469824 bytes 2021-11-18T10:22:57.778 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 116611072 bytes 2021-11-18T10:22:57.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 128623616 bytes 2021-11-18T10:22:57.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 280588288 bytes 2021-11-18T10:22:58.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 361619456 bytes 2021-11-18T10:22:58.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 367252480 bytes 2021-11-18T10:22:58.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 397517824 bytes 2021-11-18T10:22:58.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 435182592 bytes 2021-11-18T10:22:58.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 444518400 bytes 2021-11-18T10:22:58.346 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 527392768 bytes 2021-11-18T10:22:58.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 546754560 bytes 2021-11-18T10:22:58.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 569428992 bytes 2021-11-18T10:22:58.471 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 599090176 bytes 2021-11-18T10:22:58.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 697541632 bytes 2021-11-18T10:22:58.629 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 721200128 bytes 2021-11-18T10:22:58.702 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 776129536 bytes 2021-11-18T10:22:58.747 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 799973376 bytes 2021-11-18T10:22:58.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 855306240 bytes 2021-11-18T10:22:58.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 855930880 bytes 2021-11-18T10:22:58.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 887194624 bytes 2021-11-18T10:22:58.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 954354688 bytes 2021-11-18T10:22:59.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1018215424 bytes 2021-11-18T10:22:59.133 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1070744576 bytes 2021-11-18T10:22:59.230 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1136430080 bytes 2021-11-18T10:22:59.270 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1156089856 bytes 2021-11-18T10:22:59.352 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1218315264 bytes 2021-11-18T10:22:59.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1236987904 bytes 2021-11-18T10:22:59.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1246781440 bytes 2021-11-18T10:22:59.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1312375808 bytes 2021-11-18T10:22:59.570 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1352799232 bytes 2021-11-18T10:22:59.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1376680960 bytes 2021-11-18T10:22:59.711 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1446689792 bytes 2021-11-18T10:22:59.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1495279616 bytes 2021-11-18T10:22:59.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1545338880 bytes 2021-11-18T10:22:59.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1608086528 bytes 2021-11-18T10:23:00.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1653460992 bytes 2021-11-18T10:23:00.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1733195776 bytes 2021-11-18T10:23:00.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1739054080 bytes 2021-11-18T10:23:00.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1804487680 bytes 2021-11-18T10:23:00.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1848242176 bytes 2021-11-18T10:23:00.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1915708416 bytes 2021-11-18T10:23:00.464 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1961786368 bytes 2021-11-18T10:23:00.518 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1995003904 bytes 2021-11-18T10:23:00.564 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 2024323072 bytes 2021-11-18T10:23:00.670 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2081729536 bytes 2021-11-18T10:23:00.742 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2120554496 bytes 2021-11-18T10:23:00.771 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2126579712 bytes 2021-11-18T10:23:00.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2204414976 bytes 2021-11-18T10:23:00.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2285295616 bytes 2021-11-18T10:23:01.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2310077440 bytes 2021-11-18T10:23:01.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2366919680 bytes 2021-11-18T10:23:01.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2367557632 bytes 2021-11-18T10:23:01.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2378601472 bytes 2021-11-18T10:23:01.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2423711744 bytes 2021-11-18T10:23:01.282 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2448989184 bytes 2021-11-18T10:23:01.312 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2466825216 bytes 2021-11-18T10:23:01.390 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2510219264 bytes 2021-11-18T10:23:01.456 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2551519232 bytes 2021-11-18T10:23:01.548 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2606259200 bytes 2021-11-18T10:23:01.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2606858240 bytes 2021-11-18T10:23:01.667 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2674417664 bytes 2021-11-18T10:23:01.718 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2701215744 bytes 2021-11-18T10:23:01.770 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2730113024 bytes 2021-11-18T10:23:01.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2810086400 bytes 2021-11-18T10:23:01.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2849745920 bytes 2021-11-18T10:23:02.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2958332928 bytes 2021-11-18T10:23:02.109 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2963823616 bytes 2021-11-18T10:23:02.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2998402048 bytes 2021-11-18T10:23:02.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 3032334336 bytes 2021-11-18T10:23:02.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3079946240 bytes 2021-11-18T10:23:02.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3117435904 bytes 2021-11-18T10:23:02.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3158502400 bytes 2021-11-18T10:23:02.474 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3178067968 bytes 2021-11-18T10:23:02.547 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3232498688 bytes 2021-11-18T10:23:02.653 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3304370176 bytes 2021-11-18T10:23:02.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3352890368 bytes 2021-11-18T10:23:02.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3387393024 bytes 2021-11-18T10:23:02.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3450636288 bytes 2021-11-18T10:23:02.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3485217792 bytes 2021-11-18T10:23:02.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3511193600 bytes 2021-11-18T10:23:03.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3582064640 bytes 2021-11-18T10:23:03.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3619092480 bytes 2021-11-18T10:23:03.198 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3628994560 bytes 2021-11-18T10:23:03.229 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3631778816 bytes 2021-11-18T10:23:03.280 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3656065024 bytes 2021-11-18T10:23:03.354 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3706664960 bytes 2021-11-18T10:23:03.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3747430400 bytes 2021-11-18T10:23:03.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3757940736 bytes 2021-11-18T10:23:03.615 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3883233280 bytes 2021-11-18T10:23:03.726 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3969852416 bytes 2021-11-18T10:23:03.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 4116246528 bytes 2021-11-18T10:23:04.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 4209067008 bytes 2021-11-18T10:23:04.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 4213115904 bytes 2021-11-18T10:23:04.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 4251215872 bytes 2021-11-18T10:23:04.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 4269416448 bytes 2021-11-18T10:23:04.236 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 4310332416 bytes 2021-11-18T10:23:04.288 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4333417472 bytes 2021-11-18T10:23:04.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4461842432 bytes 2021-11-18T10:23:04.541 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4529054720 bytes 2021-11-18T10:23:04.613 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4568790016 bytes 2021-11-18T10:23:04.670 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4596619264 bytes 2021-11-18T10:23:04.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4613111808 bytes 2021-11-18T10:23:04.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4690382848 bytes 2021-11-18T10:23:04.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4741690368 bytes 2021-11-18T10:23:04.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4810153984 bytes 2021-11-18T10:23:05.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4880928768 bytes 2021-11-18T10:23:05.188 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4943154176 bytes 2021-11-18T10:23:05.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4948475904 bytes 2021-11-18T10:23:05.268 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4963316736 bytes 2021-11-18T10:23:05.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4988319744 bytes 2021-11-18T10:23:05.374 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 5010368512 bytes 2021-11-18T10:23:05.509 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 5115874304 bytes 2021-11-18T10:23:05.596 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 5174239232 bytes 2021-11-18T10:23:05.666 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 5212297216 bytes 2021-11-18T10:23:05.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 5309883392 bytes 2021-11-18T10:23:05.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 5425272832 bytes 2021-11-18T10:23:05.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 5438525440 bytes 2021-11-18T10:23:06.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 5460677632 bytes 2021-11-18T10:23:06.110 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 5505808384 bytes 2021-11-18T10:23:06.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 5542377472 bytes 2021-11-18T10:23:06.237 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 5571451904 bytes 2021-11-18T10:23:06.285 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 5587195904 bytes 2021-11-18T10:23:06.379 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 5648649216 bytes 2021-11-18T10:23:06.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12500 IOs, 5696190464 bytes 2021-11-18T10:23:06.545 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12600 IOs, 5751653376 bytes 2021-11-18T10:23:06.670 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12700 IOs, 5845452800 bytes 2021-11-18T10:23:06.727 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12800 IOs, 5866109952 bytes 2021-11-18T10:23:06.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12900 IOs, 5904443392 bytes 2021-11-18T10:23:06.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13000 IOs, 5905028096 bytes 2021-11-18T10:23:06.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13100 IOs, 5919230976 bytes 2021-11-18T10:23:06.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13200 IOs, 5970329600 bytes 2021-11-18T10:23:07.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13300 IOs, 5991171072 bytes 2021-11-18T10:23:07.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13400 IOs, 6029903872 bytes 2021-11-18T10:23:07.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13500 IOs, 6085735424 bytes 2021-11-18T10:23:07.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13600 IOs, 6096858112 bytes 2021-11-18T10:23:07.312 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13700 IOs, 6153745408 bytes 2021-11-18T10:23:07.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13800 IOs, 6208197632 bytes 2021-11-18T10:23:07.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13900 IOs, 6223364096 bytes 2021-11-18T10:23:07.541 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14000 IOs, 6269636608 bytes 2021-11-18T10:23:07.661 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14100 IOs, 6359925760 bytes 2021-11-18T10:23:07.743 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14200 IOs, 6405955584 bytes 2021-11-18T10:23:07.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14300 IOs, 6441064448 bytes 2021-11-18T10:23:07.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14400 IOs, 6489980928 bytes 2021-11-18T10:23:07.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14500 IOs, 6537164800 bytes 2021-11-18T10:23:08.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14600 IOs, 6572668928 bytes 2021-11-18T10:23:08.141 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14700 IOs, 6626642944 bytes 2021-11-18T10:23:08.196 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14800 IOs, 6651579392 bytes 2021-11-18T10:23:08.267 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14900 IOs, 6689379328 bytes 2021-11-18T10:23:08.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15000 IOs, 6754100224 bytes 2021-11-18T10:23:08.445 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15100 IOs, 6795828224 bytes 2021-11-18T10:23:08.508 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15200 IOs, 6824131584 bytes 2021-11-18T10:23:08.569 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15300 IOs, 6855917568 bytes 2021-11-18T10:23:08.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15400 IOs, 6876605440 bytes 2021-11-18T10:23:08.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15500 IOs, 6919265280 bytes 2021-11-18T10:23:08.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15600 IOs, 6948649984 bytes 2021-11-18T10:23:08.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15700 IOs, 7000808448 bytes 2021-11-18T10:23:09.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15800 IOs, 7066357760 bytes 2021-11-18T10:23:09.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15900 IOs, 7096159232 bytes 2021-11-18T10:23:09.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16000 IOs, 7128476672 bytes 2021-11-18T10:23:09.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16100 IOs, 7142604800 bytes 2021-11-18T10:23:09.266 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16200 IOs, 7185044480 bytes 2021-11-18T10:23:09.351 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16300 IOs, 7246382080 bytes 2021-11-18T10:23:09.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16400 IOs, 7260969984 bytes 2021-11-18T10:23:09.454 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16500 IOs, 7263769600 bytes 2021-11-18T10:23:09.561 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16600 IOs, 7282343936 bytes 2021-11-18T10:23:09.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:23:09.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:23:09.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:23:09.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:23:09.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-18T10:23:09.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:09.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:09.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:09.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:23:09.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:23:09.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:23:09.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:23:09.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:23:10.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:23:10.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:10.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:10.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:10.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:23:10.581 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:23:10.581 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:23:10.581 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:23:10.581 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:23:10.581 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:23:10.582 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:10.582 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:23:10.583 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:23:10.583 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:10.616 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:23:10.617 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:23:10.617 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:23:10.617 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:23:10.617 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:23:10.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:23:10.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:23:10.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:23:10.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:23:10.619 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:23:10.621 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:10.622 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:23:10.622 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:23:10.622 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 2 2021-11-18T10:23:12.624 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:23:12.624 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:12.624 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:12.624 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:12.625 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:23:12.625 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:23:12.625 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:23:12.625 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:23:12.626 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:23:12.626 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:23:12.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:12.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:23:12.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:23:12.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:12.662 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:23:12.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:23:12.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:23:12.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:23:12.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:23:12.664 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:23:12.664 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:23:12.664 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:23:12.664 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:23:12.665 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:23:12.667 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:12.668 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:23:12.668 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:23:12.668 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 4 2021-11-18T10:23:16.670 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:23:16.670 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:16.670 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:16.670 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:16.671 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:23:16.671 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:23:16.671 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:23:16.671 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:23:16.672 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:23:16.672 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:23:16.673 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:16.673 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:23:16.673 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:23:16.673 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:16.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:23:16.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:23:16.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:23:16.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:23:16.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:23:16.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:23:16.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:23:16.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:23:16.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:23:16.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:23:16.711 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:16.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:23:16.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:23:16.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 8 2021-11-18T10:23:24.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:23:24.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:24.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:24.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:24.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:23:24.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:23:24.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:23:24.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:23:24.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:23:24.716 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:23:24.716 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:24.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:23:24.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:23:24.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:24.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:23:24.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:23:24.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+replaying 2021-11-18T10:23:24.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637230951,"remote_snapshot_timestamp":1637230951,"replay_state":"idle"} 2021-11-18T10:23:24.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: service: mirror.1 on gibba019 2021-11-18T10:23:24.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:23:18 2021-11-18T10:23:24.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:23:24.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:23:24.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:23:24.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:23:24.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:23:24.754 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:24.754 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: state: up+replaying 2021-11-18T10:23:24.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ description: .*' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:24.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637230951,"remote_snapshot_timestamp":1637230951,"replay_state":"idle"} 2021-11-18T10:23:24.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:23:24.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:23:24.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^up+' 2021-11-18T10:23:24.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:23:24.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:24.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: service: mirror.1 on gibba019 2021-11-18T10:23:24.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:24.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'last_update=2021-11-18 10:23:18' 2021-11-18T10:23:24.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-18 10:23:18' 2021-11-18T10:23:24.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:24.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:24.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:24.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:23:24.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'prev_last_update=2021-11-18 10:23:18' 2021-11-18T10:23:24.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-18T10:23:24.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror.mirror_status 2021-11-18T10:23:24.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:23:24.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror.mirror_status 2021-11-18T10:23:24.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-18T10:23:24.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: failed to query services: (13) Permission denied 2021-11-18T10:23:24.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local last_update state 2021-11-18T10:23:24.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-18T10:23:24.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ last_update='2021-11-18 10:23:18' 2021-11-18T10:23:24.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-18T10:23:24.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ state=up+replaying 2021-11-18T10:23:24.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:23:24.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep up+replaying 2021-11-18T10:23:24.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:23:24.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:23:24.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:23:24.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap1 2021-11-18T10:23:24.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap1 2021-11-18T10:23:24.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:23:24.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:24.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:24.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap1 2021-11-18T10:23:24.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap1 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:23:40.691 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:23:40.692 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:40.692 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:40.692 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:40.692 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:23:40.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:40.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:40.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:40.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:23:40.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:23:40.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:23:40.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:23:41.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:23:41.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:41.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:41.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:41.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:23:41.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:23:41.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:23:41.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:23:41.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:23:41.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:23:41.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:23:41.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:23:41.696 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:23:41.696 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:23:41.696 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:23:41.696 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:23:41.696 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:23:41.697 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:23:41.700 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:23:41.700 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:23:41.700 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:23:41.701 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:23:41.701 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:23:41.701 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:23:41.701 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:23:41.702 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:23:41.702 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:23:41.702 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:23:41.702 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:23:41.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:23:41.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:23:41.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:23:41.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:23:41.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:23:41.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:23:41.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:23:41.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:23:41.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:23:41.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:23:41.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:23:41.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:23:41.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:23:41.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:23:41.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:23:41.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:23:41.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:23:41.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:23:41.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:23:41.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:23:41.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:23:41.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:23:41.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:23:41.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:23:41.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:23:41.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:23:41.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:23:41.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:23:41.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:23:41.776 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:23:41.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:23:41.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:23:41.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:23:41.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:23:41.778 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:23:41.778 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:23:41.778 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:23:41.778 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:23:41.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:23:41.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:23:41.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:23:41.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:23:41.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:23:41.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:23:41.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:23:41.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:23:41.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:23:41.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:23:41.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:23:41.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:23:41.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:23:41.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:23:41.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:23:41.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:23:41.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:23:41.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:23:41.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:23:41.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:23:41.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:23:41.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:23:41.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:23:41.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:23:41.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:23:41.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:23:41.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:23:41.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:23:41.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:23:41.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:23:41.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:23:41.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:23:41.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:23:41.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:23:41.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-18T10:23:41.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:23:41.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:23:41.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:41.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:41.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = journal ']' 2021-11-18T10:23:41.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = snapshot ']' 2021-11-18T10:23:41.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-18T10:23:41.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:23:41.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:23:41.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:41.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:41.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster2-mirror-test.status 2021-11-18T10:23:41.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster2-mirror-test.status 2021-11-18T10:23:41.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:23:41.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:23:41.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.status 2021-11-18T10:23:41.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.status 2021-11-18T10:23:41.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:23:41.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:23:41.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-18T10:23:41.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:23:41.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:41.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:41.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-18T10:23:42.699 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Snapshot ID: 6 2021-11-18T10:23:42.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:23:42.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:23:42.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:42.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:42.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:23:42.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-18T10:23:42.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:23:42.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-18T10:23:42.740 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snapshot_id=6 2021-11-18T10:23:42.740 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:23:42.741 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:23:42.741 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.2 2021-11-18T10:23:42.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:23:42.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:42.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:42.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:42.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:23:42.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:23:42.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:23:42.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:23:42.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=4 2021-11-18T10:23:42.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 6 = 4 2021-11-18T10:23:42.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:23:42.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.4 2021-11-18T10:23:43.383 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:23:43.383 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:43.383 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:43.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:43.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:23:43.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:23:43.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:23:43.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:23:43.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:23:43.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:23:43.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:23:43.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:23:43.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:23:43.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 6 = '' 2021-11-18T10:23:43.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:23:43.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.8 2021-11-18T10:23:44.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:23:44.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:44.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:44.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:44.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:23:44.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:23:44.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:23:44.262 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:23:44.263 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:23:44.264 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:23:44.264 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:23:44.264 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:23:44.264 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:23:44.265 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 6 = '' 2021-11-18T10:23:44.265 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:23:44.265 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1.6 2021-11-18T10:23:45.227 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.697757704484137) > weight (0.25) 2021-11-18T10:23:45.228 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.1 2021-11-18T10:23:45.228 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 15 2021-11-18T10:23:45.229 INFO:tasks.rbd_mirror_thrash:waiting for 1 secs before reviving daemons 2021-11-18T10:23:45.229 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba019.stderr:2021-11-18T10:23:45.232+0000 7fc83b831700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 39752) UID: 1000 2021-11-18T10:23:45.430 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:23:45.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:23:45.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:45.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:45.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:45.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:23:45.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:23:45.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:23:45.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:23:45.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=6 2021-11-18T10:23:45.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 6 = 6 2021-11-18T10:23:45.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:23:45.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snap_present cluster1 mirror test snap1 2021-11-18T10:23:45.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:45.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:45.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:45.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap1 2021-11-18T10:23:45.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:23:45.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-18T10:23:45.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:23:46.230 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.1 2021-11-18T10:23:46.230 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:23:46.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:23:46.232 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.1 2021-11-18T10:23:46.232 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2021-11-18T10:23:46.232 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2021-11-18T10:23:46.235 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2021-11-18T10:23:46.236 INFO:tasks.rbd_mirror_thrash:waiting for 62 secs before thrashing 2021-11-18T10:23:46.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 info mirror/test@snap1 2021-11-18T10:23:46.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:23:46.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:23:46.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:23:46.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 2 2021-11-18T10:23:46.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10acfb4eccf5 2021-11-18T10:23:46.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10acfb4eccf5 2021-11-18T10:23:46.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:23:46.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock, non-primary 2021-11-18T10:23:46.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:23:46.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:23:46.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:23:46.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:23:46.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:23:46.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: protected: False 2021-11-18T10:23:46.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:23:46.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:23:46.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:23:46.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: false 2021-11-18T10:23:46.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:23:46.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:23:46.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap1 2021-11-18T10:23:46.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:46.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:46.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap1 2021-11-18T10:23:46.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:23:46.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:23:46.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:23:46.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:23:46.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap1 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:23:47.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:23:47.418 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap1 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:23:48.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:23:48.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:23:48.144 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:23:48.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:23:48.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ clean_snap_name=snap1-clean 2021-11-18T10:23:48.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap1-clean 2021-11-18T10:23:48.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:23:48.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:48.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:48.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap1-clean 2021-11-18T10:23:48.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap1-clean --debug-rbd=20 --debug-journaler=20 2021-11-18T10:23:48.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:23:48.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror test 2021-11-18T10:23:48.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:23:48.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:48.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:48.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:23:48.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=7 2021-11-18T10:23:48.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:23:48.710 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 7s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-18T10:23:48.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 11817984 bytes 2021-11-18T10:23:48.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 30362624 bytes 2021-11-18T10:23:48.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 54892544 bytes 2021-11-18T10:23:49.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 163131392 bytes 2021-11-18T10:23:49.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 215758848 bytes 2021-11-18T10:23:49.267 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 252327936 bytes 2021-11-18T10:23:49.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 307292160 bytes 2021-11-18T10:23:49.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 373314560 bytes 2021-11-18T10:23:49.545 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 415379456 bytes 2021-11-18T10:23:49.584 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 415998976 bytes 2021-11-18T10:23:49.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 427857920 bytes 2021-11-18T10:23:49.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 453216256 bytes 2021-11-18T10:23:49.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 480782336 bytes 2021-11-18T10:23:49.823 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 510817280 bytes 2021-11-18T10:23:49.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 644244480 bytes 2021-11-18T10:23:50.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 715520000 bytes 2021-11-18T10:23:50.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 750996480 bytes 2021-11-18T10:23:50.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 794510336 bytes 2021-11-18T10:23:50.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 819852288 bytes 2021-11-18T10:23:50.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 862113792 bytes 2021-11-18T10:23:50.464 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 904531968 bytes 2021-11-18T10:23:50.549 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 937267200 bytes 2021-11-18T10:23:50.599 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 947814400 bytes 2021-11-18T10:23:50.683 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1014980608 bytes 2021-11-18T10:23:50.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1065327616 bytes 2021-11-18T10:23:50.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1085702144 bytes 2021-11-18T10:23:50.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1114743808 bytes 2021-11-18T10:23:51.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1194268672 bytes 2021-11-18T10:23:51.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1233054720 bytes 2021-11-18T10:23:51.203 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1261001728 bytes 2021-11-18T10:23:51.275 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1289788416 bytes 2021-11-18T10:23:51.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1336621056 bytes 2021-11-18T10:23:51.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1359826944 bytes 2021-11-18T10:23:51.525 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1423597568 bytes 2021-11-18T10:23:51.575 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1433937920 bytes 2021-11-18T10:23:51.675 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1494279168 bytes 2021-11-18T10:23:51.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1516910592 bytes 2021-11-18T10:23:51.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1590275072 bytes 2021-11-18T10:23:51.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1658078208 bytes 2021-11-18T10:23:52.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1723753472 bytes 2021-11-18T10:23:52.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1806740480 bytes 2021-11-18T10:23:52.273 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1840719872 bytes 2021-11-18T10:23:52.356 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1878401024 bytes 2021-11-18T10:23:52.396 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1879017472 bytes 2021-11-18T10:23:52.522 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1981741056 bytes 2021-11-18T10:23:52.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2039962624 bytes 2021-11-18T10:23:52.741 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2102177792 bytes 2021-11-18T10:23:52.797 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2116153344 bytes 2021-11-18T10:23:52.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2172819456 bytes 2021-11-18T10:23:53.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2258831360 bytes 2021-11-18T10:23:53.308 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2304295936 bytes 2021-11-18T10:23:53.356 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2310929408 bytes 2021-11-18T10:23:53.435 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2346560512 bytes 2021-11-18T10:23:53.517 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2387436544 bytes 2021-11-18T10:23:53.591 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2420972544 bytes 2021-11-18T10:23:53.657 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2447145984 bytes 2021-11-18T10:23:53.740 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2480859136 bytes 2021-11-18T10:23:53.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2533072896 bytes 2021-11-18T10:23:53.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2579627008 bytes 2021-11-18T10:23:53.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2604631040 bytes 2021-11-18T10:23:54.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2641315840 bytes 2021-11-18T10:23:54.109 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2641925120 bytes 2021-11-18T10:23:54.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2672892928 bytes 2021-11-18T10:23:54.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2697222144 bytes 2021-11-18T10:23:54.338 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2750204928 bytes 2021-11-18T10:23:54.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2784650240 bytes 2021-11-18T10:23:54.593 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2906310656 bytes 2021-11-18T10:23:54.701 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2971890688 bytes 2021-11-18T10:23:54.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 3029715968 bytes 2021-11-18T10:23:54.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 3038038016 bytes 2021-11-18T10:23:54.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3126971392 bytes 2021-11-18T10:23:55.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3140642816 bytes 2021-11-18T10:23:55.112 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3184365568 bytes 2021-11-18T10:23:55.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3283817472 bytes 2021-11-18T10:23:55.378 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3354716160 bytes 2021-11-18T10:23:55.451 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3381209088 bytes 2021-11-18T10:23:55.529 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3415730176 bytes 2021-11-18T10:23:55.647 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3491559424 bytes 2021-11-18T10:23:55.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3502651392 bytes 2021-11-18T10:23:55.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:23:55.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:23:55.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:23:55.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:23:55.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-18T10:23:55.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:55.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:55.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:55.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:23:55.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:23:55.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:23:55.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:23:55.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:23:56.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:23:56.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:56.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:56.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:56.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:23:56.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:23:56.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:23:56.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:23:56.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:23:56.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:23:56.716 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:56.716 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:23:56.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:23:56.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:56.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:23:56.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:23:56.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:23:56.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:23:56.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:23:56.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:23:56.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:23:56.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:23:56.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:23:56.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:23:48 2021-11-18T10:23:56.754 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:56.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:23:56.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:23:56.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 2 2021-11-18T10:23:58.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:23:58.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:23:58.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:23:58.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:23:58.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:23:58.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:23:58.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:23:58.759 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:23:58.759 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:23:58.759 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:23:58.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:58.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:23:58.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:23:58.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:58.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:23:58.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:23:58.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:23:58.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:23:58.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:23:58.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:23:58.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:23:58.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:23:58.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:23:58.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:23:48 2021-11-18T10:23:58.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:23:58.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:23:58.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:23:58.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 4 2021-11-18T10:24:02.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:24:02.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:02.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:02.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:02.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:24:02.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:24:02.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:24:02.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:24:02.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:24:02.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:24:02.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:02.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:24:02.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:24:02.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:02.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:24:02.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:24:02.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:24:02.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:24:02.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:24:02.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:24:02.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:24:02.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:24:02.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:24:02.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:23:48 2021-11-18T10:24:02.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:02.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:24:02.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:24:02.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 8 2021-11-18T10:24:10.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:24:10.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:10.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:10.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:10.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:24:10.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:24:10.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:24:10.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:24:10.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:24:10.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:24:10.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:10.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:24:10.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:24:10.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:10.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:24:10.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:24:10.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:24:10.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:24:10.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:24:10.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:24:10.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:24:10.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:24:10.953 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:24:10.953 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:23:48 2021-11-18T10:24:10.955 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:10.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:24:10.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:24:10.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 8 2021-11-18T10:24:12.237 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.47622612703984546) > weight (0.25) 2021-11-18T10:24:12.238 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2021-11-18T10:24:12.238 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2021-11-18T10:24:12.238 INFO:tasks.rbd_mirror_thrash:waiting for 2 secs before reviving daemons 2021-11-18T10:24:12.239 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:2021-11-18T10:24:12.241+0000 7f77be2a3700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 39907) UID: 1000 2021-11-18T10:24:12.440 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:24:14.239 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2021-11-18T10:24:14.240 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:24:14.240 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:24:14.241 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2021-11-18T10:24:14.241 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2021-11-18T10:24:14.241 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2021-11-18T10:24:14.244 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2021-11-18T10:24:14.245 INFO:tasks.rbd_mirror_thrash:waiting for 73 secs before thrashing 2021-11-18T10:24:18.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:24:18.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:18.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:18.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:18.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:24:18.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:24:18.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:24:18.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:24:18.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:24:18.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:24:18.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:18.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:24:18.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:24:18.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:18.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:24:18.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:24:18.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+replaying 2021-11-18T10:24:18.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637231022,"remote_snapshot_timestamp":1637231022,"replay_state":"idle"} 2021-11-18T10:24:18.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: service: mirror.2 on gibba019 2021-11-18T10:24:18.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:24:18 2021-11-18T10:24:18.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:24:18.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:24:18.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:24:18.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:24:19.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:24:19.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:19.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: state: up+replaying 2021-11-18T10:24:19.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ description: .*' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:19.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637231022,"remote_snapshot_timestamp":1637231022,"replay_state":"idle"} 2021-11-18T10:24:19.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:24:19.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:24:19.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^up+' 2021-11-18T10:24:19.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:24:19.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:19.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: service: mirror.2 on gibba019 2021-11-18T10:24:19.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:19.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'last_update=2021-11-18 10:24:18' 2021-11-18T10:24:19.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-18 10:24:18' 2021-11-18T10:24:19.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:19.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:19.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:19.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:24:19.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'prev_last_update=2021-11-18 10:24:18' 2021-11-18T10:24:19.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-18T10:24:19.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror.mirror_status 2021-11-18T10:24:19.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:24:19.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror.mirror_status 2021-11-18T10:24:19.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-18T10:24:19.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: failed to query services: (13) Permission denied 2021-11-18T10:24:19.057 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local last_update state 2021-11-18T10:24:19.058 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-18T10:24:19.058 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ last_update='2021-11-18 10:24:18' 2021-11-18T10:24:19.059 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-18T10:24:19.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ state=up+replaying 2021-11-18T10:24:19.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:24:19.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep up+replaying 2021-11-18T10:24:19.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:24:19.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:24:19.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:24:19.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap2 2021-11-18T10:24:19.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap2 2021-11-18T10:24:19.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:24:19.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:19.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:19.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap2 2021-11-18T10:24:19.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap2 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:24:26.731 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:24:26.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:26.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:26.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:26.733 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:24:26.733 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:26.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:26.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:26.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:24:26.736 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:24:26.736 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:24:26.737 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:24:27.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:24:27.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:27.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:27.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:27.733 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:24:27.733 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:24:27.733 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:24:27.733 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:24:27.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:24:27.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:24:27.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:24:27.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:24:27.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:24:27.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:24:27.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:24:27.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:24:27.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:24:27.736 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:24:27.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:24:27.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:24:27.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:24:27.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:24:27.740 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:24:27.740 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:24:27.740 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:24:27.740 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:24:27.741 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:24:27.741 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:24:27.741 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:24:27.741 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:24:27.742 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:24:27.742 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:24:27.742 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:24:27.742 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:24:27.743 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:24:27.743 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:24:27.743 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:24:27.743 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:24:27.743 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:24:27.744 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:24:27.744 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:24:27.744 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:24:27.744 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:24:27.745 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:24:27.745 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:24:27.745 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:24:27.745 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:24:27.745 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:24:27.746 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:24:27.746 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:24:27.747 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:24:27.747 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:24:27.747 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:24:27.747 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:24:27.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:24:27.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:24:27.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:24:27.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:24:27.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:24:27.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:24:27.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:24:27.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:24:27.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:24:27.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:24:27.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:24:27.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:24:27.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:24:27.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:24:27.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:24:27.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:24:27.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:24:27.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:24:27.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:24:27.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:24:27.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:24:27.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:24:27.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:24:27.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:24:27.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:24:27.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:24:27.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:24:27.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:24:27.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:24:27.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:24:27.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:24:27.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:24:27.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:24:27.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:24:27.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:24:27.824 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:24:27.824 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:24:27.824 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:24:27.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:24:27.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:24:27.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:24:27.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:24:27.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:24:27.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:24:27.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:24:27.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:24:27.894 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:24:27.894 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:24:27.894 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:24:27.894 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:24:27.894 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:24:27.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:24:27.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:24:27.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:24:27.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:24:27.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:24:27.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:24:27.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:24:27.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:24:27.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:24:27.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:24:27.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:24:27.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:24:27.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:24:27.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:24:27.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:24:27.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:24:27.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:24:27.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:24:27.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:24:27.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:24:27.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:24:27.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:24:27.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:24:27.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:24:27.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:24:27.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:24:27.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:24:27.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:24:27.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:24:27.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:24:27.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:24:27.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:24:27.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:24:27.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:24:27.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:24:27.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-18T10:24:27.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:24:27.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:24:27.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:27.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:27.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = journal ']' 2021-11-18T10:24:27.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = snapshot ']' 2021-11-18T10:24:27.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-18T10:24:27.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:24:27.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:24:27.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:27.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:27.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster2-mirror-test.status 2021-11-18T10:24:27.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster2-mirror-test.status 2021-11-18T10:24:27.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:24:27.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:24:27.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.status 2021-11-18T10:24:27.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.status 2021-11-18T10:24:27.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:24:27.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:24:27.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-18T10:24:27.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:24:27.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:27.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:27.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-18T10:24:28.741 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Snapshot ID: 10 2021-11-18T10:24:28.749 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:24:28.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:24:28.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:28.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:28.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:24:28.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-18T10:24:28.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:24:28.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-18T10:24:28.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snapshot_id=10 2021-11-18T10:24:28.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:24:28.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:24:28.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.2 2021-11-18T10:24:28.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:24:28.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:28.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:28.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:28.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:24:28.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:24:28.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:24:29.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:24:29.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=6 2021-11-18T10:24:29.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 10 = 6 2021-11-18T10:24:29.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:24:29.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.4 2021-11-18T10:24:29.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:24:29.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:29.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:29.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:29.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:24:29.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:24:29.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:24:29.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:24:29.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:24:29.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:24:29.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:24:29.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:24:29.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:24:29.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 10 = '' 2021-11-18T10:24:29.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:24:29.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.8 2021-11-18T10:24:30.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:24:30.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:30.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:30.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:30.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:24:30.262 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:24:30.262 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:24:30.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:24:30.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:24:30.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:24:30.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:24:30.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:24:30.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:24:30.302 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 10 = '' 2021-11-18T10:24:30.302 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:24:30.302 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1.6 2021-11-18T10:24:31.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:24:31.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:31.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:31.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:31.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:24:31.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:24:31.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:24:31.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:24:31.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=10 2021-11-18T10:24:31.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 10 = 10 2021-11-18T10:24:31.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:24:31.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snap_present cluster1 mirror test snap2 2021-11-18T10:24:31.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:31.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:31.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:31.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap2 2021-11-18T10:24:31.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:24:31.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-18T10:24:31.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:24:32.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 info mirror/test@snap2 2021-11-18T10:24:32.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:24:32.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:24:32.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:24:32.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 5 2021-11-18T10:24:32.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10acfb4eccf5 2021-11-18T10:24:32.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10acfb4eccf5 2021-11-18T10:24:32.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:24:32.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock, operations, non-primary 2021-11-18T10:24:32.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: snap-trash 2021-11-18T10:24:32.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:24:32.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:24:32.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:24:32.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:24:32.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: protected: False 2021-11-18T10:24:32.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:24:32.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:24:32.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:24:32.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: false 2021-11-18T10:24:32.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:24:32.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snap1-clean ']' 2021-11-18T10:24:32.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap1-clean 2021-11-18T10:24:32.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:32.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:32.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap1-clean 2021-11-18T10:24:32.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:24:32.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:24:32.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:24:32.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:24:32.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap1-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:24:33.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:24:33.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap1-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:24:34.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:24:34.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:24:34.229 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:24:34.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:24:34.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap2 2021-11-18T10:24:34.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:34.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:34.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap2 2021-11-18T10:24:34.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:24:34.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:24:34.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:24:34.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:24:34.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap2 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:24:34.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:24:34.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap2 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:24:35.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:24:35.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:24:35.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:24:35.557 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:24:35.557 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ clean_snap_name=snap2-clean 2021-11-18T10:24:35.558 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap2-clean 2021-11-18T10:24:35.558 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:24:35.558 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:35.558 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:35.559 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap2-clean 2021-11-18T10:24:35.559 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap2-clean --debug-rbd=20 --debug-journaler=20 2021-11-18T10:24:35.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:24:35.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror test 2021-11-18T10:24:35.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:24:35.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:35.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:35.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:24:35.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=12 2021-11-18T10:24:35.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:24:35.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 12s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-18T10:24:35.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 43337728 bytes 2021-11-18T10:24:36.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 107162624 bytes 2021-11-18T10:24:36.113 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 145640448 bytes 2021-11-18T10:24:36.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 166877184 bytes 2021-11-18T10:24:36.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 198294528 bytes 2021-11-18T10:24:36.373 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 272948224 bytes 2021-11-18T10:24:36.443 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 296741888 bytes 2021-11-18T10:24:36.528 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 352323584 bytes 2021-11-18T10:24:36.613 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 376129536 bytes 2021-11-18T10:24:36.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 418957312 bytes 2021-11-18T10:24:36.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 547081216 bytes 2021-11-18T10:24:36.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 570787840 bytes 2021-11-18T10:24:37.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 685707264 bytes 2021-11-18T10:24:37.209 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 737605632 bytes 2021-11-18T10:24:37.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 837924864 bytes 2021-11-18T10:24:37.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 861857792 bytes 2021-11-18T10:24:37.491 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 894515200 bytes 2021-11-18T10:24:37.588 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 928359424 bytes 2021-11-18T10:24:37.701 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 992979968 bytes 2021-11-18T10:24:37.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 1056124928 bytes 2021-11-18T10:24:37.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 1082043392 bytes 2021-11-18T10:24:37.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 1113913344 bytes 2021-11-18T10:24:38.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1156993024 bytes 2021-11-18T10:24:38.104 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1162029056 bytes 2021-11-18T10:24:38.198 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1212479488 bytes 2021-11-18T10:24:38.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1293144064 bytes 2021-11-18T10:24:38.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1328106496 bytes 2021-11-18T10:24:38.480 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1354665984 bytes 2021-11-18T10:24:38.615 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1454823424 bytes 2021-11-18T10:24:38.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1543744512 bytes 2021-11-18T10:24:38.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1561112576 bytes 2021-11-18T10:24:38.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1630247936 bytes 2021-11-18T10:24:39.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1660039168 bytes 2021-11-18T10:24:39.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1697460224 bytes 2021-11-18T10:24:39.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1723977728 bytes 2021-11-18T10:24:39.263 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1760284672 bytes 2021-11-18T10:24:39.403 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1844499456 bytes 2021-11-18T10:24:39.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1886934016 bytes 2021-11-18T10:24:39.602 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1948026880 bytes 2021-11-18T10:24:39.718 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 2014750720 bytes 2021-11-18T10:24:39.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 2050491392 bytes 2021-11-18T10:24:39.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 2104880128 bytes 2021-11-18T10:24:40.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 2156448768 bytes 2021-11-18T10:24:40.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 2188867584 bytes 2021-11-18T10:24:40.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 2213679104 bytes 2021-11-18T10:24:40.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2233665536 bytes 2021-11-18T10:24:40.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2264792064 bytes 2021-11-18T10:24:40.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2305797120 bytes 2021-11-18T10:24:40.467 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2312031232 bytes 2021-11-18T10:24:40.593 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2384015360 bytes 2021-11-18T10:24:40.674 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2411541504 bytes 2021-11-18T10:24:40.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2445091840 bytes 2021-11-18T10:24:40.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2534152192 bytes 2021-11-18T10:24:40.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2564508672 bytes 2021-11-18T10:24:41.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2605549568 bytes 2021-11-18T10:24:41.136 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2634330112 bytes 2021-11-18T10:24:41.269 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2709043200 bytes 2021-11-18T10:24:41.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2749136896 bytes 2021-11-18T10:24:41.444 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2783183872 bytes 2021-11-18T10:24:41.537 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2844297216 bytes 2021-11-18T10:24:41.648 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2878738432 bytes 2021-11-18T10:24:41.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2898135040 bytes 2021-11-18T10:24:41.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2973973504 bytes 2021-11-18T10:24:41.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 3022030848 bytes 2021-11-18T10:24:42.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 3056625664 bytes 2021-11-18T10:24:42.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 3081240576 bytes 2021-11-18T10:24:42.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 3130459136 bytes 2021-11-18T10:24:42.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 3208078336 bytes 2021-11-18T10:24:42.402 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 3242710016 bytes 2021-11-18T10:24:42.483 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 3277572096 bytes 2021-11-18T10:24:42.542 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3296162816 bytes 2021-11-18T10:24:42.613 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3323167744 bytes 2021-11-18T10:24:42.722 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3383093248 bytes 2021-11-18T10:24:42.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3461313536 bytes 2021-11-18T10:24:42.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3537380352 bytes 2021-11-18T10:24:43.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3637597184 bytes 2021-11-18T10:24:43.220 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3658208256 bytes 2021-11-18T10:24:43.305 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3697783808 bytes 2021-11-18T10:24:43.409 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3743479808 bytes 2021-11-18T10:24:43.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3747311616 bytes 2021-11-18T10:24:43.514 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3747943424 bytes 2021-11-18T10:24:43.662 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3849032704 bytes 2021-11-18T10:24:43.730 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3873390592 bytes 2021-11-18T10:24:43.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3911658496 bytes 2021-11-18T10:24:44.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3980443648 bytes 2021-11-18T10:24:44.189 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 4091721728 bytes 2021-11-18T10:24:44.315 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 4156903424 bytes 2021-11-18T10:24:44.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 4207392768 bytes 2021-11-18T10:24:44.498 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 4239222784 bytes 2021-11-18T10:24:44.602 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 4291451904 bytes 2021-11-18T10:24:44.688 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 4323597312 bytes 2021-11-18T10:24:44.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 4381622272 bytes 2021-11-18T10:24:44.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 4436764672 bytes 2021-11-18T10:24:45.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 4516024320 bytes 2021-11-18T10:24:45.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 4595616768 bytes 2021-11-18T10:24:45.245 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 4639918080 bytes 2021-11-18T10:24:45.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 4657381376 bytes 2021-11-18T10:24:45.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4742369280 bytes 2021-11-18T10:24:45.621 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4859104256 bytes 2021-11-18T10:24:45.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4966835200 bytes 2021-11-18T10:24:45.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4985091072 bytes 2021-11-18T10:24:45.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 5005700096 bytes 2021-11-18T10:24:46.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 5065188352 bytes 2021-11-18T10:24:46.112 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 5075871744 bytes 2021-11-18T10:24:46.238 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 5162784768 bytes 2021-11-18T10:24:46.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 5256473600 bytes 2021-11-18T10:24:46.470 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 5282403328 bytes 2021-11-18T10:24:46.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 5329240064 bytes 2021-11-18T10:24:46.698 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 5404416000 bytes 2021-11-18T10:24:46.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 5431404544 bytes 2021-11-18T10:24:46.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 5444751360 bytes 2021-11-18T10:24:46.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 5529053184 bytes 2021-11-18T10:24:47.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 5606077440 bytes 2021-11-18T10:24:47.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 5614473216 bytes 2021-11-18T10:24:47.291 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 5679569920 bytes 2021-11-18T10:24:47.368 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 5701737472 bytes 2021-11-18T10:24:47.444 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 5719328768 bytes 2021-11-18T10:24:47.518 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 5741467648 bytes 2021-11-18T10:24:47.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 5742076928 bytes 2021-11-18T10:24:47.661 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 5772409856 bytes 2021-11-18T10:24:47.743 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 5795200000 bytes 2021-11-18T10:24:47.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:24:47.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:24:47.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:24:47.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:24:47.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-18T10:24:47.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:47.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:47.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:47.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:24:47.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:24:47.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:24:47.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:24:47.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:24:48.236 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.5552599335216943) > weight (0.25) 2021-11-18T10:24:48.237 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.36697808781769126) > weight (0.25) 2021-11-18T10:24:48.237 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.2 2021-11-18T10:24:48.238 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Sent signal 15 2021-11-18T10:24:48.238 INFO:tasks.rbd_mirror_thrash:waiting for 0 secs before reviving daemons 2021-11-18T10:24:48.239 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.2 2021-11-18T10:24:48.239 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:24:48.240 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.gibba019.stderr:2021-11-18T10:24:48.240+0000 7f5378bd4700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 (PID: 39790) UID: 1000 2021-11-18T10:24:48.439 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:24:48.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:24:48.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:48.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:48.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:48.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:24:48.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:24:48.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:24:48.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:24:48.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:24:48.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:24:48.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:48.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:24:48.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:24:48.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:48.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:24:48.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:24:48.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+stopped 2021-11-18T10:24:48.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: stopped 2021-11-18T10:24:48.800 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:24:48 2021-11-18T10:24:48.800 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:24:48.800 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:24:48.800 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:24:48.801 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:24:48.801 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:24:48 2021-11-18T10:24:48.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:48.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:24:48.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:24:48.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 2 2021-11-18T10:24:50.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:24:50.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:50.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:50.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:50.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:24:50.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:24:50.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:24:50.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:24:50.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:24:50.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:24:50.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:50.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:24:50.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:24:50.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:50.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:24:50.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:24:50.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+stopped 2021-11-18T10:24:50.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: stopped 2021-11-18T10:24:50.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:24:48 2021-11-18T10:24:50.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:24:50.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:24:50.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:24:50.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:24:50.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:24:48 2021-11-18T10:24:50.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:50.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:24:50.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:24:50.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 4 2021-11-18T10:24:54.340 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:24:54.341 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.2 2021-11-18T10:24:54.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Restarting daemon 2021-11-18T10:24:54.341 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 2021-11-18T10:24:54.344 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Started 2021-11-18T10:24:54.344 INFO:tasks.rbd_mirror_thrash:waiting for 110 secs before thrashing 2021-11-18T10:24:54.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:24:54.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:24:54.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:24:54.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:24:54.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:24:54.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:24:54.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:24:54.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:24:54.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:24:54.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:24:54.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:24:54.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:54.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:24:54.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:24:54.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:24:54.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:24:54.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:24:54.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:24:54.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:24:54.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:24:54.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:24:54.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:24:48 2021-11-18T10:24:54.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:24:54.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:24:54.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:24:54.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 8 2021-11-18T10:25:02.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:25:02.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:02.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:02.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:02.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:25:02.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:25:02.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:25:02.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:25:02.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:25:02.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:25:02.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:02.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:25:02.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:25:02.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:02.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:25:02.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:25:02.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:25:02.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:25:02.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:25:02.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:25:02.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:25:02.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:25:02.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:25:02.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:24:48 2021-11-18T10:25:02.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:02.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:25:02.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:25:02.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 8 2021-11-18T10:25:10.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:25:10.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:10.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:10.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:10.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:25:10.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:25:10.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:25:10.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:25:10.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:25:10.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:25:10.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:10.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:25:10.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:25:10.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:10.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:25:10.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:25:10.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: down+unknown 2021-11-18T10:25:10.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: status not found 2021-11-18T10:25:10.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18T10:25:10.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:25:10.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:25:10.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:25:10.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:25:10.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:24:48 2021-11-18T10:25:10.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 1 2021-11-18T10:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:25:10.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 8 2021-11-18T10:25:18.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:25:18.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:18.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:18.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:18.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:25:18.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:25:18.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:25:18.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:25:18.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:25:18.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:25:18.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:18.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:25:18.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:25:18.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:19.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:25:19.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:25:19.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+replaying 2021-11-18T10:25:19.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637231068,"remote_snapshot_timestamp":1637231068,"replay_state":"idle"} 2021-11-18T10:25:19.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: service: mirror.3 on gibba019 2021-11-18T10:25:19.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:25:18 2021-11-18T10:25:19.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:25:19.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:25:19.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:25:19.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:25:19.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:25:18 2021-11-18T10:25:19.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:19.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: state: up+replaying 2021-11-18T10:25:19.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ description: .*' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:19.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637231068,"remote_snapshot_timestamp":1637231068,"replay_state":"idle"} 2021-11-18T10:25:19.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:25:19.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:25:19.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^up+' 2021-11-18T10:25:19.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:25:19.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:19.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: service: mirror.3 on gibba019 2021-11-18T10:25:19.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:19.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'last_update=2021-11-18 10:25:18' 2021-11-18T10:25:19.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-18 10:25:18' 2021-11-18T10:25:19.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:19.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:19.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:19.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:25:19.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'prev_last_update=2021-11-18 10:25:18' 2021-11-18T10:25:19.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-18T10:25:19.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror.mirror_status 2021-11-18T10:25:19.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:25:19.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror.mirror_status 2021-11-18T10:25:19.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-18T10:25:19.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: failed to query services: (13) Permission denied 2021-11-18T10:25:19.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local last_update state 2021-11-18T10:25:19.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-18T10:25:19.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ last_update='2021-11-18 10:25:18' 2021-11-18T10:25:19.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-18T10:25:19.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ state=up+replaying 2021-11-18T10:25:19.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:25:19.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep up+replaying 2021-11-18T10:25:19.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:25:19.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:25:19.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:25:19.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap3 2021-11-18T10:25:19.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap3 2021-11-18T10:25:19.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:25:19.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:19.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:19.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap3 2021-11-18T10:25:19.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap3 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:25:20.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:25:20.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:20.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:20.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:20.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:25:20.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:20.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:20.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:20.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:25:20.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:25:20.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:25:20.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:25:21.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:25:21.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:21.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:21.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:21.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:25:21.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:25:21.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:25:21.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:25:21.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:25:21.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:25:21.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:25:21.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:25:21.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:25:21.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:25:21.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:25:21.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:25:21.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:25:21.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:25:21.768 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:25:21.769 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:25:21.769 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:25:21.769 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:25:21.769 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:25:21.770 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:25:21.770 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:25:21.770 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:25:21.770 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:25:21.771 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:25:21.771 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:25:21.771 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:25:21.771 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:25:21.771 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:25:21.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:25:21.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:25:21.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:25:21.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:25:21.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:25:21.773 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:25:21.773 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:25:21.773 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:25:21.773 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:25:21.774 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:25:21.774 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:25:21.774 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:25:21.774 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:25:21.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:25:21.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:25:21.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:25:21.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:25:21.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:25:21.776 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:25:21.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:25:21.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:25:21.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:25:21.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:25:21.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:25:21.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:25:21.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:25:21.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:25:21.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:25:21.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:25:21.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:25:21.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:25:21.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:25:21.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:25:21.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:25:21.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:25:21.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:25:21.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:25:21.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:25:21.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:25:21.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:25:21.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:25:21.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:25:21.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:25:21.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:25:21.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:25:21.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:25:21.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:25:21.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:25:21.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:25:21.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:25:21.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:25:21.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:25:21.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:25:21.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:25:21.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:25:21.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:25:21.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:25:21.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:25:21.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:25:21.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:25:21.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:25:21.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:25:21.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:25:21.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:25:21.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:25:21.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:25:21.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:25:21.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:25:21.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:25:21.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:25:21.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:25:21.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:25:21.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:25:21.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:25:21.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:25:21.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:25:21.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:25:21.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:25:21.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:25:21.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:25:21.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:25:21.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:25:21.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:25:21.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:25:21.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:25:21.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:25:21.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:25:21.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:25:21.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:25:21.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:25:21.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:25:21.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:25:21.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:25:21.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:25:21.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:25:21.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:25:21.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:25:21.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:25:21.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:25:21.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:25:22.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:25:22.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:25:22.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:25:22.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:25:22.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:25:22.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:25:22.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:25:22.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:25:22.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:25:22.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:25:22.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:25:22.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:25:22.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:25:22.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:25:22.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:25:22.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:25:22.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:25:22.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:25:22.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:25:22.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:25:22.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:25:22.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:25:22.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:25:22.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:25:22.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:25:22.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:25:22.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:25:22.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:25:22.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:25:22.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:25:22.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:25:22.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:25:22.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:25:22.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:25:22.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:25:22.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:25:22.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:25:22.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:25:22.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:25:22.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:25:22.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:25:22.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:25:22.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:25:22.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:25:22.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:25:22.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:25:22.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:25:22.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-18T10:25:22.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:25:22.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:25:22.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:22.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:22.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = journal ']' 2021-11-18T10:25:22.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = snapshot ']' 2021-11-18T10:25:22.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-18T10:25:22.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:25:22.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:25:22.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:22.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:22.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster2-mirror-test.status 2021-11-18T10:25:22.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster2-mirror-test.status 2021-11-18T10:25:22.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:25:22.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:25:22.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.status 2021-11-18T10:25:22.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.status 2021-11-18T10:25:22.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:25:22.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:25:22.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-18T10:25:22.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:25:22.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:22.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:22.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-18T10:25:22.770 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Snapshot ID: 14 2021-11-18T10:25:22.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:25:22.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:25:22.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:22.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:22.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:25:22.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-18T10:25:22.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:25:22.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-18T10:25:22.813 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snapshot_id=14 2021-11-18T10:25:22.813 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:25:22.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:25:22.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.2 2021-11-18T10:25:23.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:25:23.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:23.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:23.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:23.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:25:23.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:25:23.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:25:23.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:25:23.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=10 2021-11-18T10:25:23.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 14 = 10 2021-11-18T10:25:23.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:25:23.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.4 2021-11-18T10:25:23.453 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:25:23.454 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:23.454 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:23.454 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:23.455 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:25:23.455 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:25:23.455 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:25:23.494 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:25:23.494 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:25:23.495 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:25:23.496 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:25:23.496 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:25:23.496 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:25:23.496 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 14 = '' 2021-11-18T10:25:23.497 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:25:23.497 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.8 2021-11-18T10:25:24.296 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:25:24.297 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:24.297 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:24.297 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:24.297 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:25:24.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:25:24.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:25:24.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:25:24.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:25:24.332 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:25:24.332 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:25:24.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:25:24.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:25:24.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 14 = '' 2021-11-18T10:25:24.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:25:24.334 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1.6 2021-11-18T10:25:25.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:25:25.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:25.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:25.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:25.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:25:25.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:25:25.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:25:25.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:25:25.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=14 2021-11-18T10:25:25.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 14 = 14 2021-11-18T10:25:25.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:25:25.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snap_present cluster1 mirror test snap3 2021-11-18T10:25:25.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:25.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:25.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:25.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap3 2021-11-18T10:25:25.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:25:25.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-18T10:25:25.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:25:26.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 info mirror/test@snap3 2021-11-18T10:25:27.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:25:27.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:25:27.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:25:27.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 7 2021-11-18T10:25:27.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10acfb4eccf5 2021-11-18T10:25:27.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10acfb4eccf5 2021-11-18T10:25:27.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:25:27.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock, operations, non-primary 2021-11-18T10:25:27.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: snap-trash 2021-11-18T10:25:27.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:25:27.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:25:27.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:24:33 2021 2021-11-18T10:25:27.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:25:27.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: protected: False 2021-11-18T10:25:27.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:25:27.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:25:27.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:25:27.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: false 2021-11-18T10:25:27.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:25:27.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snap2-clean ']' 2021-11-18T10:25:27.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap2-clean 2021-11-18T10:25:27.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:27.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:27.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap2-clean 2021-11-18T10:25:27.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:25:27.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:25:27.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:25:27.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:25:27.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap2-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:25:27.245 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.8695908636438086) > weight (0.25) 2021-11-18T10:25:27.246 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2021-11-18T10:25:27.247 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2021-11-18T10:25:27.248 INFO:tasks.rbd_mirror_thrash:waiting for 0 secs before reviving daemons 2021-11-18T10:25:27.248 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2021-11-18T10:25:27.248 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:25:27.250 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:2021-11-18T10:25:27.250+0000 7f2f9b14d700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 42319) UID: 1000 2021-11-18T10:25:27.441 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:25:27.443 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap2-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:25:27.448 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:25:28.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:25:28.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:25:28.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:25:28.293 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:25:28.294 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap3 2021-11-18T10:25:28.294 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:28.294 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:28.294 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap3 2021-11-18T10:25:28.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:25:28.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:25:28.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:25:28.296 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:25:28.296 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap3 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:25:28.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:25:28.759 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap3 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:25:29.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:25:29.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:25:29.592 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:25:29.687 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:25:29.687 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ clean_snap_name=snap3-clean 2021-11-18T10:25:29.687 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap3-clean 2021-11-18T10:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap3-clean 2021-11-18T10:25:29.688 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap3-clean --debug-rbd=20 --debug-journaler=20 2021-11-18T10:25:29.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:25:29.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror test 2021-11-18T10:25:29.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:25:29.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:29.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:29.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:25:29.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=9 2021-11-18T10:25:29.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:25:29.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 9s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-18T10:25:29.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 46551040 bytes 2021-11-18T10:25:30.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 95784960 bytes 2021-11-18T10:25:30.211 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 156742656 bytes 2021-11-18T10:25:30.273 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 158097408 bytes 2021-11-18T10:25:30.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 215932928 bytes 2021-11-18T10:25:30.519 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 311763968 bytes 2021-11-18T10:25:30.657 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 382616576 bytes 2021-11-18T10:25:30.770 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 437998592 bytes 2021-11-18T10:25:30.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 527063040 bytes 2021-11-18T10:25:31.042 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 594778112 bytes 2021-11-18T10:25:31.205 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 707598336 bytes 2021-11-18T10:25:31.285 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 717422592 bytes 2021-11-18T10:25:31.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 738811904 bytes 2021-11-18T10:25:31.464 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 773521408 bytes 2021-11-18T10:25:31.540 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 787218432 bytes 2021-11-18T10:25:31.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 807841792 bytes 2021-11-18T10:25:31.720 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 836928512 bytes 2021-11-18T10:25:31.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 903159808 bytes 2021-11-18T10:25:31.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 967451648 bytes 2021-11-18T10:25:32.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 1052437504 bytes 2021-11-18T10:25:32.202 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 1093721088 bytes 2021-11-18T10:25:32.292 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 1128939520 bytes 2021-11-18T10:25:32.396 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1184756736 bytes 2021-11-18T10:25:32.501 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1235470336 bytes 2021-11-18T10:25:32.603 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1265821696 bytes 2021-11-18T10:25:32.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1308762112 bytes 2021-11-18T10:25:32.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1358964736 bytes 2021-11-18T10:25:32.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1382447104 bytes 2021-11-18T10:25:32.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1423598592 bytes 2021-11-18T10:25:33.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1439739904 bytes 2021-11-18T10:25:33.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1494161408 bytes 2021-11-18T10:25:33.263 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1517845504 bytes 2021-11-18T10:25:33.346 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1544951808 bytes 2021-11-18T10:25:33.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:25:33.351 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2021-11-18T10:25:33.352 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2021-11-18T10:25:33.352 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2021-11-18T10:25:33.355 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2021-11-18T10:25:33.355 INFO:tasks.rbd_mirror_thrash:waiting for 82 secs before thrashing 2021-11-18T10:25:33.442 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1579544576 bytes 2021-11-18T10:25:33.539 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1623140352 bytes 2021-11-18T10:25:33.673 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1683636224 bytes 2021-11-18T10:25:33.789 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1743416320 bytes 2021-11-18T10:25:33.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1796230144 bytes 2021-11-18T10:25:33.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1818086400 bytes 2021-11-18T10:25:34.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1837594624 bytes 2021-11-18T10:25:34.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1857284096 bytes 2021-11-18T10:25:34.275 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1912554496 bytes 2021-11-18T10:25:34.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1952051200 bytes 2021-11-18T10:25:34.486 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 2011192320 bytes 2021-11-18T10:25:34.576 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 2037163008 bytes 2021-11-18T10:25:34.682 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2084059136 bytes 2021-11-18T10:25:34.797 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2156066816 bytes 2021-11-18T10:25:34.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2187253760 bytes 2021-11-18T10:25:35.034 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2264786944 bytes 2021-11-18T10:25:35.141 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2313869312 bytes 2021-11-18T10:25:35.263 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2367875072 bytes 2021-11-18T10:25:35.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2375939072 bytes 2021-11-18T10:25:35.511 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2484044800 bytes 2021-11-18T10:25:35.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2525159424 bytes 2021-11-18T10:25:35.710 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2552465408 bytes 2021-11-18T10:25:35.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2610872320 bytes 2021-11-18T10:25:35.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2627782656 bytes 2021-11-18T10:25:36.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2692194304 bytes 2021-11-18T10:25:36.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2743027712 bytes 2021-11-18T10:25:36.268 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2817530880 bytes 2021-11-18T10:25:36.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2868630528 bytes 2021-11-18T10:25:36.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2887945216 bytes 2021-11-18T10:25:36.589 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2944880640 bytes 2021-11-18T10:25:36.696 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2990336000 bytes 2021-11-18T10:25:36.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 3040330752 bytes 2021-11-18T10:25:36.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 3065396224 bytes 2021-11-18T10:25:37.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 3111584768 bytes 2021-11-18T10:25:37.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 3127794688 bytes 2021-11-18T10:25:37.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 3186531328 bytes 2021-11-18T10:25:37.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 3216380928 bytes 2021-11-18T10:25:37.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3242022912 bytes 2021-11-18T10:25:37.479 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3253294080 bytes 2021-11-18T10:25:37.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3282605056 bytes 2021-11-18T10:25:37.701 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3350946816 bytes 2021-11-18T10:25:37.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3420240896 bytes 2021-11-18T10:25:37.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3476114432 bytes 2021-11-18T10:25:38.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3528406016 bytes 2021-11-18T10:25:38.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3571649536 bytes 2021-11-18T10:25:38.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3601735680 bytes 2021-11-18T10:25:38.403 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3689296896 bytes 2021-11-18T10:25:38.507 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3734979584 bytes 2021-11-18T10:25:38.639 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3800979456 bytes 2021-11-18T10:25:38.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:25:38.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:25:38.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:25:38.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:25:38.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-18T10:25:38.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:38.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:38.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:38.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:25:38.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:25:38.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:25:38.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:25:38.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:25:39.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:25:39.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:39.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:39.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:39.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:25:39.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:25:39.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:25:39.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:25:39.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:25:39.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:25:39.789 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:39.789 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:25:39.789 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:25:39.789 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:39.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:25:39.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:25:39.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+replaying 2021-11-18T10:25:39.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637231068,"remote_snapshot_timestamp":1637231068,"replay_state":"idle"} 2021-11-18T10:25:39.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: service: mirror.3 on gibba019 2021-11-18T10:25:39.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:25:18 2021-11-18T10:25:39.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:25:39.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:25:39.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:25:39.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:25:39.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:25:18 2021-11-18T10:25:39.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:39.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: state: up+replaying 2021-11-18T10:25:39.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ description: .*' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:39.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":0.0,"local_snapshot_timestamp":1637231068,"remote_snapshot_timestamp":1637231068,"replay_state":"idle"} 2021-11-18T10:25:39.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:25:39.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:25:39.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^up+' 2021-11-18T10:25:39.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:25:39.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:39.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: service: mirror.3 on gibba019 2021-11-18T10:25:39.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:25:39.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'last_update=2021-11-18 10:25:18' 2021-11-18T10:25:39.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-18 10:25:18' 2021-11-18T10:25:39.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:25:39.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:39.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:39.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:25:39.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'prev_last_update=2021-11-18 10:25:18' 2021-11-18T10:25:39.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-18T10:25:39.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror.mirror_status 2021-11-18T10:25:39.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:25:39.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror.mirror_status 2021-11-18T10:25:39.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-18T10:25:39.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: failed to query services: (13) Permission denied 2021-11-18T10:25:39.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local last_update state 2021-11-18T10:25:39.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-18T10:25:39.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ last_update='2021-11-18 10:25:18' 2021-11-18T10:25:39.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-18T10:25:39.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ state=up+replaying 2021-11-18T10:25:39.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:25:39.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep up+replaying 2021-11-18T10:25:39.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:25:39.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:25:39.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:25:39.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap4 2021-11-18T10:25:39.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap4 2021-11-18T10:25:39.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:25:39.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:25:39.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:25:39.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap4 2021-11-18T10:25:39.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap4 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:26:08.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:26:08.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:26:08.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:08.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:08.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:26:08.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:26:08.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:08.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:08.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:26:08.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:26:08.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:26:08.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:26:09.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:26:09.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:26:09.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:09.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:09.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:26:09.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:26:09.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:26:09.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:26:09.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:26:09.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:26:09.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:26:09.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:26:09.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:26:09.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:26:09.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:26:09.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:26:09.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:26:09.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:26:09.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:26:09.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:26:09.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:26:09.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:26:09.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:26:09.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:26:09.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:26:09.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:26:09.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:26:09.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:26:09.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:26:09.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:26:09.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:26:09.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:26:09.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:26:09.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:26:09.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:26:09.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:26:09.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:26:09.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:26:09.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:26:09.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:26:09.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:26:09.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:26:09.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:26:09.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:26:09.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:26:09.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:26:09.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:26:09.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:26:09.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:26:09.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:26:09.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:26:09.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:26:09.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:26:09.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:26:09.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:26:09.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:26:09.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:26:09.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:26:09.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:26:09.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:26:09.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:26:09.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:26:09.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:26:09.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:26:09.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:26:09.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:26:09.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:26:09.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:26:09.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:26:09.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:26:09.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:26:09.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:26:09.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:26:09.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:26:09.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:26:09.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:26:09.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:26:09.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:26:09.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:26:09.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:26:09.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:26:09.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:26:09.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:26:09.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:26:09.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:26:09.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:26:09.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:26:09.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:26:09.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:26:09.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:26:09.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:26:09.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:26:09.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:26:10.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:26:10.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:26:10.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:26:10.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:26:10.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:26:10.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:26:10.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:26:10.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:26:10.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:26:10.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:26:10.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:26:10.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:26:10.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:26:10.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:26:10.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:26:10.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:26:10.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:26:10.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:26:10.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:26:10.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:26:10.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:26:10.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:26:10.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:26:10.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:26:10.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:26:10.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:26:10.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:26:10.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:26:10.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:26:10.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:26:10.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:26:10.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:26:10.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:26:10.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:26:10.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:26:10.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:26:10.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:26:10.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:26:10.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:26:10.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:26:10.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:26:10.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:26:10.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:26:10.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:26:10.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:26:10.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:26:10.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:26:10.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:26:10.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:26:10.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:26:10.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:26:10.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:26:10.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:26:10.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:26:10.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:26:10.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:26:10.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:26:10.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:26:10.103 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:26:10.103 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:26:10.103 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:26:10.103 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:26:10.103 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:26:10.104 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:26:10.104 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:26:10.104 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:26:10.104 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:26:10.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:26:10.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:26:10.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:26:10.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:26:10.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:26:10.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:26:10.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:26:10.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:26:10.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:26:10.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:26:10.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:26:10.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:26:10.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:26:10.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:26:10.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:26:10.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:26:10.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:26:10.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:26:10.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:26:10.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-18T10:26:10.181 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:26:10.181 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:26:10.181 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:10.181 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:10.181 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = journal ']' 2021-11-18T10:26:10.182 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = snapshot ']' 2021-11-18T10:26:10.182 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-18T10:26:10.182 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:26:10.182 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:26:10.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:10.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:10.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster2-mirror-test.status 2021-11-18T10:26:10.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster2-mirror-test.status 2021-11-18T10:26:10.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:26:10.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:26:10.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.status 2021-11-18T10:26:10.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.status 2021-11-18T10:26:10.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:26:10.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:26:10.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-18T10:26:10.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:26:10.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:10.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:10.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-18T10:26:10.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Snapshot ID: 18 2021-11-18T10:26:10.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:26:10.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:26:10.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:10.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:10.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:26:10.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-18T10:26:10.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:26:10.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-18T10:26:10.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snapshot_id=18 2021-11-18T10:26:10.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:26:10.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:26:10.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.2 2021-11-18T10:26:11.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:26:11.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:26:11.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:11.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:11.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:26:11.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:26:11.108 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:26:11.351 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:26:11.352 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:26:11.353 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:26:11.353 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:26:11.353 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:26:11.353 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:26:11.354 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 18 = '' 2021-11-18T10:26:11.354 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:26:11.354 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.4 2021-11-18T10:26:11.754 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:26:11.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:26:11.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:11.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:11.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:26:11.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:26:11.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:26:11.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:26:11.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:26:11.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:26:11.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:26:11.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:26:11.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:26:11.794 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 18 = '' 2021-11-18T10:26:11.794 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:26:11.794 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.8 2021-11-18T10:26:12.594 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:26:12.594 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:26:12.595 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:12.595 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:12.595 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:26:12.595 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:26:12.596 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:26:12.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:26:12.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:26:12.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:26:12.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:26:12.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:26:12.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:26:12.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 18 = '' 2021-11-18T10:26:12.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:26:12.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1.6 2021-11-18T10:26:14.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:26:14.234 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:26:14.234 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:14.234 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:14.234 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:26:14.235 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:26:14.235 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:26:14.275 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:26:14.276 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=18 2021-11-18T10:26:14.277 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 18 = 18 2021-11-18T10:26:14.277 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:26:14.277 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snap_present cluster1 mirror test snap4 2021-11-18T10:26:14.277 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:26:14.278 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:14.278 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:14.278 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap4 2021-11-18T10:26:14.278 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:26:14.279 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-18T10:26:14.279 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:26:15.278 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 info mirror/test@snap4 2021-11-18T10:26:15.312 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:26:15.312 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:26:15.312 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:26:15.313 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 8 2021-11-18T10:26:15.313 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10acfb4eccf5 2021-11-18T10:26:15.313 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10acfb4eccf5 2021-11-18T10:26:15.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:26:15.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock, non-primary 2021-11-18T10:26:15.315 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:26:15.315 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:26:15.315 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:26:15.315 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:24:33 2021 2021-11-18T10:26:15.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:26:15.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: protected: False 2021-11-18T10:26:15.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:26:15.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:26:15.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:26:15.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: false 2021-11-18T10:26:15.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:26:15.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snap3-clean ']' 2021-11-18T10:26:15.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap3-clean 2021-11-18T10:26:15.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:15.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:15.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap3-clean 2021-11-18T10:26:15.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:26:15.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:26:15.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:26:15.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:26:15.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap3-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:26:15.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:26:15.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap3-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:26:16.378 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:26:16.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:26:16.509 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:26:16.607 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:26:16.607 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap4 2021-11-18T10:26:16.608 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:16.608 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:16.608 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap4 2021-11-18T10:26:16.608 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:26:16.609 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:26:16.609 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:26:16.610 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:26:16.610 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap4 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:26:17.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:26:17.056 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap4 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:26:17.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:26:17.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:26:17.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:26:17.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:26:17.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ clean_snap_name=snap4-clean 2021-11-18T10:26:17.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap4-clean 2021-11-18T10:26:17.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:26:17.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:17.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:17.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap4-clean 2021-11-18T10:26:17.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap4-clean --debug-rbd=20 --debug-journaler=20 2021-11-18T10:26:18.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:26:18.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror test 2021-11-18T10:26:18.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:26:18.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:18.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:18.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:26:18.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=14 2021-11-18T10:26:18.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:26:18.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 14s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-18T10:26:19.046 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 47007744 bytes 2021-11-18T10:26:19.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 100649984 bytes 2021-11-18T10:26:19.273 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 124792832 bytes 2021-11-18T10:26:19.435 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 221893632 bytes 2021-11-18T10:26:19.548 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 287846400 bytes 2021-11-18T10:26:19.658 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 319890432 bytes 2021-11-18T10:26:19.729 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 330937344 bytes 2021-11-18T10:26:19.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 394809344 bytes 2021-11-18T10:26:19.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 395408384 bytes 2021-11-18T10:26:20.034 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 460590080 bytes 2021-11-18T10:26:20.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 461177856 bytes 2021-11-18T10:26:20.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 481803264 bytes 2021-11-18T10:26:20.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 545064960 bytes 2021-11-18T10:26:20.450 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 591150080 bytes 2021-11-18T10:26:20.544 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 649793536 bytes 2021-11-18T10:26:20.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 712294400 bytes 2021-11-18T10:26:20.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 712910848 bytes 2021-11-18T10:26:20.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 739205120 bytes 2021-11-18T10:26:20.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 755687424 bytes 2021-11-18T10:26:21.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 823274496 bytes 2021-11-18T10:26:21.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 863574016 bytes 2021-11-18T10:26:21.278 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 899113984 bytes 2021-11-18T10:26:21.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 967564288 bytes 2021-11-18T10:26:21.518 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1010845696 bytes 2021-11-18T10:26:21.660 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1092859904 bytes 2021-11-18T10:26:21.754 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1119666176 bytes 2021-11-18T10:26:21.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1139284992 bytes 2021-11-18T10:26:21.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1172420608 bytes 2021-11-18T10:26:22.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1191469056 bytes 2021-11-18T10:26:22.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1233637376 bytes 2021-11-18T10:26:22.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1246801920 bytes 2021-11-18T10:26:22.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1277544448 bytes 2021-11-18T10:26:22.437 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1333474304 bytes 2021-11-18T10:26:22.531 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1358057472 bytes 2021-11-18T10:26:22.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1484180480 bytes 2021-11-18T10:26:22.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1580767232 bytes 2021-11-18T10:26:23.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1672127488 bytes 2021-11-18T10:26:23.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1698912256 bytes 2021-11-18T10:26:23.203 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1699555328 bytes 2021-11-18T10:26:23.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1734665216 bytes 2021-11-18T10:26:23.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1776825344 bytes 2021-11-18T10:26:23.494 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1780572160 bytes 2021-11-18T10:26:23.595 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1826597888 bytes 2021-11-18T10:26:23.729 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1860564992 bytes 2021-11-18T10:26:23.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1894501376 bytes 2021-11-18T10:26:23.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1941861376 bytes 2021-11-18T10:26:24.042 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1961156608 bytes 2021-11-18T10:26:24.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1994373120 bytes 2021-11-18T10:26:24.264 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2052404224 bytes 2021-11-18T10:26:24.344 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2053016576 bytes 2021-11-18T10:26:24.437 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2074177536 bytes 2021-11-18T10:26:24.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2108713984 bytes 2021-11-18T10:26:24.649 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2156053504 bytes 2021-11-18T10:26:24.721 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2164278272 bytes 2021-11-18T10:26:24.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2183191552 bytes 2021-11-18T10:26:24.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2266399744 bytes 2021-11-18T10:26:25.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2312395776 bytes 2021-11-18T10:26:25.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2348683264 bytes 2021-11-18T10:26:25.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2404263936 bytes 2021-11-18T10:26:25.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2418309120 bytes 2021-11-18T10:26:25.532 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2476704768 bytes 2021-11-18T10:26:25.665 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2530505728 bytes 2021-11-18T10:26:25.769 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2561439744 bytes 2021-11-18T10:26:25.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2582617088 bytes 2021-11-18T10:26:25.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2603959296 bytes 2021-11-18T10:26:26.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2681474048 bytes 2021-11-18T10:26:26.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2693479424 bytes 2021-11-18T10:26:26.270 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2694096896 bytes 2021-11-18T10:26:26.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2737034240 bytes 2021-11-18T10:26:26.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2743587840 bytes 2021-11-18T10:26:26.570 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2777877504 bytes 2021-11-18T10:26:26.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2819483648 bytes 2021-11-18T10:26:26.778 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2820099072 bytes 2021-11-18T10:26:26.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2893751296 bytes 2021-11-18T10:26:27.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 2917017600 bytes 2021-11-18T10:26:27.205 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3033404416 bytes 2021-11-18T10:26:27.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3101045760 bytes 2021-11-18T10:26:27.436 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3132679168 bytes 2021-11-18T10:26:27.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3201315840 bytes 2021-11-18T10:26:27.682 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3274112000 bytes 2021-11-18T10:26:27.795 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3290409984 bytes 2021-11-18T10:26:27.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3310134272 bytes 2021-11-18T10:26:28.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3382494208 bytes 2021-11-18T10:26:28.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3459982336 bytes 2021-11-18T10:26:28.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3471539200 bytes 2021-11-18T10:26:28.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3496520704 bytes 2021-11-18T10:26:28.519 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3582893056 bytes 2021-11-18T10:26:28.653 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3652442112 bytes 2021-11-18T10:26:28.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3713586176 bytes 2021-11-18T10:26:28.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3772512256 bytes 2021-11-18T10:26:29.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3791729664 bytes 2021-11-18T10:26:29.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3819038720 bytes 2021-11-18T10:26:29.201 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3856735232 bytes 2021-11-18T10:26:29.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3892210688 bytes 2021-11-18T10:26:29.453 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3955303424 bytes 2021-11-18T10:26:29.538 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3987082240 bytes 2021-11-18T10:26:29.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 3998439424 bytes 2021-11-18T10:26:29.716 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4013746176 bytes 2021-11-18T10:26:29.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4079744000 bytes 2021-11-18T10:26:29.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4138819584 bytes 2021-11-18T10:26:30.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4164567040 bytes 2021-11-18T10:26:30.182 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4186455040 bytes 2021-11-18T10:26:30.304 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4225561600 bytes 2021-11-18T10:26:30.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4262472704 bytes 2021-11-18T10:26:30.528 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4304403456 bytes 2021-11-18T10:26:30.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4339562496 bytes 2021-11-18T10:26:30.740 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4347652096 bytes 2021-11-18T10:26:30.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4401740800 bytes 2021-11-18T10:26:30.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4402382848 bytes 2021-11-18T10:26:31.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4418791424 bytes 2021-11-18T10:26:31.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4444362752 bytes 2021-11-18T10:26:31.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4535531520 bytes 2021-11-18T10:26:31.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4536152064 bytes 2021-11-18T10:26:31.499 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4577543168 bytes 2021-11-18T10:26:31.654 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4631280640 bytes 2021-11-18T10:26:31.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4692914176 bytes 2021-11-18T10:26:31.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 4751490048 bytes 2021-11-18T10:26:32.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 4826985472 bytes 2021-11-18T10:26:32.204 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 4896652288 bytes 2021-11-18T10:26:32.368 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 4983560192 bytes 2021-11-18T10:26:32.497 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 5041286144 bytes 2021-11-18T10:26:32.611 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 5082865664 bytes 2021-11-18T10:26:32.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 5118094336 bytes 2021-11-18T10:26:32.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:26:32.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:26:32.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:26:32.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:26:32.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-18T10:26:32.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:26:32.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:32.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:32.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:26:32.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:26:32.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:26:32.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:26:32.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:26:33.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:26:33.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:26:33.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:33.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:33.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:26:33.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:26:33.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:26:33.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:26:33.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:26:33.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:26:33.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:26:33.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:26:33.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:26:33.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:26:33.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:26:33.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:26:33.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+replaying 2021-11-18T10:26:33.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: replaying, {"bytes_per_second":1677721.6,"bytes_per_snapshot":535449600.0,"local_snapshot_timestamp":1637231170,"remote_snapshot_timestamp":1637231170,"replay_state":"idle"} 2021-11-18T10:26:33.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: service: mirror.3 on gibba019 2021-11-18T10:26:33.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:26:18 2021-11-18T10:26:33.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:26:33.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:26:33.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:26:33.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:26:33.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:26:18 2021-11-18T10:26:33.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:26:33.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: state: up+replaying 2021-11-18T10:26:33.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ description: .*' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:26:33.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: description: replaying, {"bytes_per_second":1677721.6,"bytes_per_snapshot":535449600.0,"local_snapshot_timestamp":1637231170,"remote_snapshot_timestamp":1637231170,"replay_state":"idle"} 2021-11-18T10:26:33.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:26:33.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:26:33.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^up+' 2021-11-18T10:26:33.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:26:33.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:26:33.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: service: mirror.3 on gibba019 2021-11-18T10:26:33.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:26:33.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'last_update=2021-11-18 10:26:18' 2021-11-18T10:26:33.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-18 10:26:18' 2021-11-18T10:26:33.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:26:33.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:33.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:33.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:26:33.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'prev_last_update=2021-11-18 10:26:18' 2021-11-18T10:26:33.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-18T10:26:33.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror.mirror_status 2021-11-18T10:26:33.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:26:33.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror.mirror_status 2021-11-18T10:26:33.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-18T10:26:33.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: failed to query services: (13) Permission denied 2021-11-18T10:26:33.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local last_update state 2021-11-18T10:26:33.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-18T10:26:33.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ last_update='2021-11-18 10:26:18' 2021-11-18T10:26:33.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-18T10:26:33.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ state=up+replaying 2021-11-18T10:26:33.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:26:33.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep up+replaying 2021-11-18T10:26:33.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:26:33.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:26:33.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:26:33.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap5 2021-11-18T10:26:33.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap5 2021-11-18T10:26:33.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:26:33.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:26:33.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:26:33.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap5 2021-11-18T10:26:33.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap5 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:26:44.345 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.7943576450225647) > weight (0.25) 2021-11-18T10:26:44.345 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.9598895881732415) > weight (0.25) 2021-11-18T10:26:44.346 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.7383151051987404) > weight (0.25) 2021-11-18T10:26:44.346 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.694422977017853) > weight (0.25) 2021-11-18T10:26:44.346 INFO:tasks.rbd_mirror_thrash:waiting for 97 secs before thrashing 2021-11-18T10:26:55.357 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.40845656321294144) > weight (0.25) 2021-11-18T10:26:55.357 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2021-11-18T10:26:55.358 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2021-11-18T10:26:55.358 INFO:tasks.rbd_mirror_thrash:waiting for 7 secs before reviving daemons 2021-11-18T10:26:55.359 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:2021-11-18T10:26:55.361+0000 7fd2f857d700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 43519) UID: 1000 2021-11-18T10:26:55.560 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:27:02.359 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2021-11-18T10:27:02.359 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:27:02.360 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:27:02.360 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2021-11-18T10:27:02.361 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2021-11-18T10:27:02.361 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2021-11-18T10:27:02.364 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2021-11-18T10:27:02.365 INFO:tasks.rbd_mirror_thrash:waiting for 87 secs before thrashing 2021-11-18T10:27:03.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:27:03.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:03.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:03.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:03.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:27:03.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:03.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:03.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:03.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:27:03.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:27:03.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:27:03.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:27:04.802 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:27:04.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:04.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:04.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:04.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:27:04.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:27:04.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:27:04.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:27:04.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:27:04.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:27:04.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:27:04.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:27:04.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:27:04.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:27:04.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:27:04.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:27:04.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:27:04.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:27:04.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:27:04.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:27:04.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:27:04.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:27:04.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:27:04.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:27:04.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:27:04.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:27:04.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:27:04.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:27:04.813 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:27:04.813 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:27:04.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:27:04.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:04.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:27:04.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:27:04.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:27:04.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:27:04.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:27:04.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:27:04.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:27:04.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:27:04.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:27:04.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:27:04.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:04.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:27:04.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:27:04.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:27:04.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:27:04.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:27:04.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:27:04.823 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:27:04.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:27:04.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:27:04.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:27:04.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:27:04.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:27:04.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:27:04.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:27:04.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:27:04.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:27:04.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:27:04.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:27:04.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:27:04.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:27:04.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:27:04.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:27:04.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:27:04.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:27:04.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:27:04.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:27:04.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:27:04.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:04.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:27:04.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:27:04.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:27:04.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:27:04.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:27:04.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:27:04.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:27:04.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:27:04.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:27:04.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:27:04.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:04.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:27:04.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:27:04.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:27:04.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:27:04.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:27:04.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:27:04.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:27:04.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:27:04.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:27:04.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:27:04.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:27:04.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:27:04.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:27:04.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:27:04.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:27:04.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:27:04.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:27:04.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:27:04.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:27:04.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:27:04.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:27:04.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:27:04.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:27:04.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:27:04.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:27:04.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:27:04.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:27:04.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:04.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:27:04.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:27:04.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:27:04.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:27:04.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:27:04.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:27:04.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:27:04.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:27:04.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:27:04.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:27:04.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:04.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:27:04.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:27:04.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:27:04.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:27:04.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:27:04.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:27:04.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:27:04.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:27:04.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:27:04.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:27:04.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:27:05.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:27:05.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:27:05.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:27:05.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:27:05.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:27:05.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:27:05.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:27:05.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:27:05.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:27:05.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:27:05.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:27:05.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:27:05.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:27:05.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:27:05.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:27:05.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:27:05.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:05.042 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:27:05.042 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:27:05.042 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:27:05.042 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:27:05.043 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:27:05.043 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:27:05.043 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:27:05.043 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:27:05.044 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:27:05.044 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:27:05.044 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:05.044 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:27:05.044 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:27:05.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:27:05.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:27:05.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:27:05.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:27:05.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:27:05.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:27:05.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:27:05.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:27:05.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:27:05.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:27:05.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:27:05.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:27:05.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:27:05.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:27:05.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:27:05.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:27:05.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:27:05.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-18T10:27:05.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:27:05.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:27:05.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:05.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:05.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = journal ']' 2021-11-18T10:27:05.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = snapshot ']' 2021-11-18T10:27:05.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-18T10:27:05.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:27:05.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:27:05.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:05.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:05.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster2-mirror-test.status 2021-11-18T10:27:05.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster2-mirror-test.status 2021-11-18T10:27:05.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:27:05.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:27:05.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.status 2021-11-18T10:27:05.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.status 2021-11-18T10:27:05.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:27:05.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:05.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-18T10:27:05.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:27:05.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:05.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:05.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-18T10:27:05.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Snapshot ID: 22 2021-11-18T10:27:05.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:27:05.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:27:05.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:05.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:05.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:27:05.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-18T10:27:05.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:27:05.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-18T10:27:05.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snapshot_id=22 2021-11-18T10:27:05.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:27:05.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:27:05.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.2 2021-11-18T10:27:06.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:06.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:06.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:06.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:06.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:06.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:27:06.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:27:06.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:27:06.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=18 2021-11-18T10:27:06.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 22 = 18 2021-11-18T10:27:06.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:27:06.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.4 2021-11-18T10:27:06.493 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:06.493 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:06.494 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:06.494 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:06.494 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:06.494 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:27:06.495 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:27:06.531 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:27:06.531 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:27:06.532 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:27:06.532 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:27:06.532 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:27:06.532 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:27:06.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 22 = '' 2021-11-18T10:27:06.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:27:06.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.8 2021-11-18T10:27:07.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:07.334 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:07.334 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:07.334 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:07.335 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:07.335 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:27:07.335 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:27:07.369 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:27:07.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:27:07.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:27:07.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:27:07.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:27:07.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:27:07.372 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 22 = '' 2021-11-18T10:27:07.372 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:27:07.372 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1.6 2021-11-18T10:27:08.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:08.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:08.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:08.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:08.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:08.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:27:08.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:27:09.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:27:09.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=22 2021-11-18T10:27:09.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 22 = 22 2021-11-18T10:27:09.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:27:09.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snap_present cluster1 mirror test snap5 2021-11-18T10:27:09.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:09.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:09.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:09.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap5 2021-11-18T10:27:09.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:27:09.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-18T10:27:09.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:27:10.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 info mirror/test@snap5 2021-11-18T10:27:10.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:27:10.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:27:10.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:27:10.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 11 2021-11-18T10:27:10.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10acfb4eccf5 2021-11-18T10:27:10.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10acfb4eccf5 2021-11-18T10:27:10.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:27:10.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock, operations, non-primary 2021-11-18T10:27:10.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: snap-trash 2021-11-18T10:27:10.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:27:10.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:27:10.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:26:15 2021 2021-11-18T10:27:10.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:27:10.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: protected: False 2021-11-18T10:27:10.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:27:10.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:27:10.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:27:10.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: false 2021-11-18T10:27:10.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:27:10.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snap4-clean ']' 2021-11-18T10:27:10.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap4-clean 2021-11-18T10:27:10.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:10.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:10.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap4-clean 2021-11-18T10:27:10.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:27:10.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:27:10.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:27:10.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:27:10.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap4-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:27:10.499 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:27:10.502 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap4-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:27:11.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:27:11.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:27:11.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:27:11.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:27:11.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap5 2021-11-18T10:27:11.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:11.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:11.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap5 2021-11-18T10:27:11.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:27:11.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:27:11.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:27:11.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:27:11.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap5 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:27:11.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:27:11.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap5 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:27:12.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:27:12.559 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:27:12.687 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:27:12.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:27:12.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ clean_snap_name=snap5-clean 2021-11-18T10:27:12.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap5-clean 2021-11-18T10:27:12.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:27:12.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:12.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:12.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap5-clean 2021-11-18T10:27:12.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap5-clean --debug-rbd=20 --debug-journaler=20 2021-11-18T10:27:13.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:27:13.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror test 2021-11-18T10:27:13.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:27:13.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:13.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:13.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:27:13.753 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=11 2021-11-18T10:27:13.753 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:27:13.753 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 11s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-18T10:27:13.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 16225280 bytes 2021-11-18T10:27:14.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 31911936 bytes 2021-11-18T10:27:14.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 116491264 bytes 2021-11-18T10:27:14.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 162192384 bytes 2021-11-18T10:27:14.409 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 195087360 bytes 2021-11-18T10:27:14.541 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 233587712 bytes 2021-11-18T10:27:14.656 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 279308288 bytes 2021-11-18T10:27:14.741 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 279946240 bytes 2021-11-18T10:27:14.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 304147456 bytes 2021-11-18T10:27:14.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 304778240 bytes 2021-11-18T10:27:15.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 346986496 bytes 2021-11-18T10:27:15.213 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 434949120 bytes 2021-11-18T10:27:15.356 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 491849728 bytes 2021-11-18T10:27:15.474 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 523741184 bytes 2021-11-18T10:27:15.634 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 621712384 bytes 2021-11-18T10:27:15.753 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 655429632 bytes 2021-11-18T10:27:15.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 682637312 bytes 2021-11-18T10:27:15.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 709578752 bytes 2021-11-18T10:27:16.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 763276288 bytes 2021-11-18T10:27:16.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 822319104 bytes 2021-11-18T10:27:16.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 840196096 bytes 2021-11-18T10:27:16.449 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 900000768 bytes 2021-11-18T10:27:16.597 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 948239360 bytes 2021-11-18T10:27:16.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 987561984 bytes 2021-11-18T10:27:16.795 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1008592896 bytes 2021-11-18T10:27:16.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1034157056 bytes 2021-11-18T10:27:17.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1090415616 bytes 2021-11-18T10:27:17.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1100806144 bytes 2021-11-18T10:27:17.265 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1133586432 bytes 2021-11-18T10:27:17.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1209062400 bytes 2021-11-18T10:27:17.545 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1260029952 bytes 2021-11-18T10:27:17.677 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1305721856 bytes 2021-11-18T10:27:17.795 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1342798848 bytes 2021-11-18T10:27:17.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1386682368 bytes 2021-11-18T10:27:18.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1437657088 bytes 2021-11-18T10:27:18.133 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1455266816 bytes 2021-11-18T10:27:18.262 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1511713792 bytes 2021-11-18T10:27:18.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1559602176 bytes 2021-11-18T10:27:18.483 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1582713856 bytes 2021-11-18T10:27:18.582 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1598429184 bytes 2021-11-18T10:27:18.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1639681024 bytes 2021-11-18T10:27:18.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1652940800 bytes 2021-11-18T10:27:18.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1660647424 bytes 2021-11-18T10:27:18.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1693444096 bytes 2021-11-18T10:27:19.137 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1740954624 bytes 2021-11-18T10:27:19.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1749278720 bytes 2021-11-18T10:27:19.354 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1799371776 bytes 2021-11-18T10:27:19.484 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1850740736 bytes 2021-11-18T10:27:19.626 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1917266944 bytes 2021-11-18T10:27:19.744 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 1947980800 bytes 2021-11-18T10:27:19.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 1955323904 bytes 2021-11-18T10:27:19.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 1980024832 bytes 2021-11-18T10:27:20.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2019547136 bytes 2021-11-18T10:27:20.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2024713216 bytes 2021-11-18T10:27:20.283 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2079303680 bytes 2021-11-18T10:27:20.381 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2097293312 bytes 2021-11-18T10:27:20.537 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2179318784 bytes 2021-11-18T10:27:20.647 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2202968064 bytes 2021-11-18T10:27:20.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2253460480 bytes 2021-11-18T10:27:20.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2312811520 bytes 2021-11-18T10:27:21.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2344408064 bytes 2021-11-18T10:27:21.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2370383872 bytes 2021-11-18T10:27:21.244 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2382918656 bytes 2021-11-18T10:27:21.387 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2448103424 bytes 2021-11-18T10:27:21.501 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2479195136 bytes 2021-11-18T10:27:21.643 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2540987392 bytes 2021-11-18T10:27:21.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2585284608 bytes 2021-11-18T10:27:21.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2629237760 bytes 2021-11-18T10:27:22.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2702019584 bytes 2021-11-18T10:27:22.179 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2769959936 bytes 2021-11-18T10:27:22.275 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2796387328 bytes 2021-11-18T10:27:22.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2831224832 bytes 2021-11-18T10:27:22.530 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2867790848 bytes 2021-11-18T10:27:22.662 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2917142528 bytes 2021-11-18T10:27:22.771 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 2940438528 bytes 2021-11-18T10:27:22.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 2941056000 bytes 2021-11-18T10:27:22.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 2988068864 bytes 2021-11-18T10:27:23.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3034226688 bytes 2021-11-18T10:27:23.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3093459968 bytes 2021-11-18T10:27:23.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3142612992 bytes 2021-11-18T10:27:23.511 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3199708160 bytes 2021-11-18T10:27:23.664 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3251969024 bytes 2021-11-18T10:27:23.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3284944896 bytes 2021-11-18T10:27:23.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3323572224 bytes 2021-11-18T10:27:24.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3348728832 bytes 2021-11-18T10:27:24.124 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3393213440 bytes 2021-11-18T10:27:24.266 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3441885184 bytes 2021-11-18T10:27:24.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3511234560 bytes 2021-11-18T10:27:24.587 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3598340096 bytes 2021-11-18T10:27:24.729 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3674503168 bytes 2021-11-18T10:27:24.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:27:24.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:27:24.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:27:24.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:27:24.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-18T10:27:24.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:24.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:24.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:24.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:27:24.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:27:24.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:27:24.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:27:24.759 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:27:25.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:27:25.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:25.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:25.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:25.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:27:25.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:27:25.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:27:25.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:27:25.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:27:25.759 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:27:25.759 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:27:25.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:27:25.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:27:25.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:27:25.797 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:27:25.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:27:25.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+replaying 2021-11-18T10:27:25.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: replaying, {"bytes_per_second":17871086.93,"bytes_per_snapshot":536185344.0,"local_snapshot_timestamp":1637231225,"remote_snapshot_timestamp":1637231225,"replay_state":"idle"} 2021-11-18T10:27:25.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: service: mirror.3 on gibba019 2021-11-18T10:27:25.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:27:18 2021-11-18T10:27:25.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:27:25.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:27:25.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:27:25.800 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:27:25.800 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:27:18 2021-11-18T10:27:25.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:27:25.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: state: up+replaying 2021-11-18T10:27:25.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ description: .*' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:27:25.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: description: replaying, {"bytes_per_second":17871086.93,"bytes_per_snapshot":536185344.0,"local_snapshot_timestamp":1637231225,"remote_snapshot_timestamp":1637231225,"replay_state":"idle"} 2021-11-18T10:27:25.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:27:25.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:27:25.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^up+' 2021-11-18T10:27:25.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:27:25.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:27:25.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: service: mirror.3 on gibba019 2021-11-18T10:27:25.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:27:25.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'last_update=2021-11-18 10:27:18' 2021-11-18T10:27:25.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-18 10:27:18' 2021-11-18T10:27:25.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:25.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:25.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:25.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:27:25.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'prev_last_update=2021-11-18 10:27:18' 2021-11-18T10:27:25.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-18T10:27:25.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror.mirror_status 2021-11-18T10:27:25.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:27:25.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror.mirror_status 2021-11-18T10:27:25.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-18T10:27:25.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: failed to query services: (13) Permission denied 2021-11-18T10:27:25.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local last_update state 2021-11-18T10:27:25.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-18T10:27:25.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ last_update='2021-11-18 10:27:18' 2021-11-18T10:27:25.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-18T10:27:25.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ state=up+replaying 2021-11-18T10:27:25.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:27:25.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep up+replaying 2021-11-18T10:27:25.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:27:25.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:27:25.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:27:25.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap6 2021-11-18T10:27:25.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap6 2021-11-18T10:27:25.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:27:25.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:25.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:25.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap6 2021-11-18T10:27:25.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap6 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:27:55.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:27:55.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:55.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:55.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:55.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:27:55.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:55.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:55.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:55.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:27:55.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:27:55.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:27:55.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:27:56.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:27:56.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:56.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:56.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:56.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:27:56.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:27:56.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:27:56.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:27:56.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:27:56.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:27:56.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:27:56.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:27:56.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:27:56.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:27:56.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:27:56.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:27:56.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:27:56.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:27:56.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:27:56.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:27:56.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:27:56.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:27:56.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:27:56.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:27:56.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:27:56.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:27:56.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:27:56.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:27:56.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:27:56.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:27:56.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:27:56.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:56.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:27:56.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:27:56.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:27:56.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:27:56.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:27:56.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:27:56.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:27:56.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:27:56.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:27:56.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:27:56.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:56.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:27:56.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:27:56.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:27:56.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:27:56.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:27:56.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:27:56.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:27:56.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:27:56.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:27:56.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:27:56.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:27:56.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:27:56.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:27:56.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:27:56.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:27:56.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:27:56.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:27:56.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:27:56.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:27:56.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:27:56.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:27:56.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:27:56.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:27:56.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:27:56.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:27:56.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:27:56.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:27:56.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:56.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:27:56.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:27:56.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:27:56.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:27:56.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:27:56.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:27:56.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:27:56.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:27:56.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:27:56.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:27:56.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:56.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:27:56.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:27:56.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:27:56.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:27:56.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:27:56.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:27:56.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:27:56.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:27:56.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:27:56.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:27:56.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:27:56.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:27:56.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:27:56.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:27:56.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:27:56.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:27:56.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:27:56.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:27:56.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:27:56.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:27:56.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:27:56.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:27:56.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:27:56.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:27:56.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:27:56.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:27:56.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:27:56.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:56.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:27:56.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:27:56.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:27:56.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:27:56.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:27:56.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:27:56.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:27:56.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:27:56.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:27:56.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:27:56.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:56.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:27:56.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:27:56.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:27:56.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:27:56.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:27:56.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:27:56.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:27:56.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:27:56.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:27:56.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:27:56.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:27:57.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:27:57.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:27:57.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:27:57.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:27:57.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:27:57.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:27:57.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:27:57.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:27:57.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:27:57.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:27:57.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:27:57.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:27:57.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:27:57.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:27:57.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:27:57.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:27:57.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:57.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:27:57.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:27:57.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:27:57.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:27:57.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:27:57.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:27:57.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:27:57.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:27:57.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:27:57.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:27:57.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:27:57.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:27:57.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:27:57.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:27:57.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:27:57.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:27:57.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:27:57.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:27:57.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:27:57.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:27:57.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:27:57.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:27:57.140 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:27:57.141 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:27:57.141 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:27:57.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:27:57.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:27:57.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:27:57.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:27:57.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:27:57.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-18T10:27:57.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:27:57.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:27:57.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:57.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:57.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = journal ']' 2021-11-18T10:27:57.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = snapshot ']' 2021-11-18T10:27:57.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-18T10:27:57.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:27:57.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:27:57.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:57.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:57.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster2-mirror-test.status 2021-11-18T10:27:57.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster2-mirror-test.status 2021-11-18T10:27:57.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:27:57.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:27:57.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.status 2021-11-18T10:27:57.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.status 2021-11-18T10:27:57.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:27:57.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:57.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-18T10:27:57.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:27:57.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:57.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:57.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-18T10:27:57.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Snapshot ID: 26 2021-11-18T10:27:57.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:27:57.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:27:57.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:57.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:57.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:27:57.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-18T10:27:57.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:27:57.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-18T10:27:57.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snapshot_id=26 2021-11-18T10:27:57.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:27:57.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:27:57.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.2 2021-11-18T10:27:58.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:58.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:58.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:58.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:58.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:58.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:27:58.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:27:58.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:27:58.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=22 2021-11-18T10:27:58.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 26 = 22 2021-11-18T10:27:58.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:27:58.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.4 2021-11-18T10:27:58.516 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:58.516 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:58.516 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:58.517 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:58.517 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:58.517 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:27:58.517 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:27:58.554 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:27:58.554 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:27:58.555 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:27:58.555 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:27:58.555 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:27:58.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:27:58.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 26 = '' 2021-11-18T10:27:58.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:27:58.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.8 2021-11-18T10:27:59.356 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:59.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:27:59.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:27:59.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:27:59.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:27:59.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:27:59.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:27:59.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:27:59.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:27:59.396 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:27:59.396 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:27:59.396 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:27:59.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:27:59.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 26 = '' 2021-11-18T10:27:59.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:27:59.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1.6 2021-11-18T10:28:00.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:28:00.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:00.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:00.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:00.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:28:01.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:28:01.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:28:01.058 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:28:01.059 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=26 2021-11-18T10:28:01.059 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 26 = 26 2021-11-18T10:28:01.059 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:01.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snap_present cluster1 mirror test snap6 2021-11-18T10:28:01.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:01.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:01.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:01.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap6 2021-11-18T10:28:01.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:28:01.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-18T10:28:01.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:28:02.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 info mirror/test@snap6 2021-11-18T10:28:02.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:28:02.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:28:02.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:28:02.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 13 2021-11-18T10:28:02.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10acfb4eccf5 2021-11-18T10:28:02.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10acfb4eccf5 2021-11-18T10:28:02.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:28:02.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock, operations, non-primary 2021-11-18T10:28:02.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: snap-trash 2021-11-18T10:28:02.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:28:02.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:28:02.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:26:15 2021 2021-11-18T10:28:02.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:28:02.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: protected: False 2021-11-18T10:28:02.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:28:02.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:28:02.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:28:02.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: false 2021-11-18T10:28:02.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:02.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snap5-clean ']' 2021-11-18T10:28:02.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap5-clean 2021-11-18T10:28:02.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:02.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:02.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap5-clean 2021-11-18T10:28:02.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:28:02.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:28:02.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:02.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:02.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap5-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:28:02.542 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:28:02.544 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap5-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:03.190 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:28:03.192 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:03.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:03.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:03.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap6 2021-11-18T10:28:03.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:03.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:03.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap6 2021-11-18T10:28:03.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:28:03.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:28:03.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:03.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:03.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap6 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:28:03.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:28:03.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap6 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:04.498 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:28:04.501 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:04.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:04.726 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:04.727 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ clean_snap_name=snap6-clean 2021-11-18T10:28:04.727 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap6-clean 2021-11-18T10:28:04.727 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:28:04.727 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:04.728 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:04.728 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap6-clean 2021-11-18T10:28:04.728 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap6-clean --debug-rbd=20 --debug-journaler=20 2021-11-18T10:28:04.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:28:04.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror test 2021-11-18T10:28:04.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:28:04.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:04.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:04.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:28:04.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=9 2021-11-18T10:28:04.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:28:04.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 9s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-18T10:28:05.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 18269184 bytes 2021-11-18T10:28:05.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 36325376 bytes 2021-11-18T10:28:05.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 98848768 bytes 2021-11-18T10:28:05.373 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 114780160 bytes 2021-11-18T10:28:05.468 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 125988864 bytes 2021-11-18T10:28:05.587 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 162823168 bytes 2021-11-18T10:28:05.686 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 172811264 bytes 2021-11-18T10:28:05.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 285641728 bytes 2021-11-18T10:28:05.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 302166016 bytes 2021-11-18T10:28:06.108 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 343646208 bytes 2021-11-18T10:28:06.275 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 457981952 bytes 2021-11-18T10:28:06.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 461353984 bytes 2021-11-18T10:28:06.482 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 461956096 bytes 2021-11-18T10:28:06.604 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 503932928 bytes 2021-11-18T10:28:06.754 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 572128256 bytes 2021-11-18T10:28:06.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 572735488 bytes 2021-11-18T10:28:06.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 625643520 bytes 2021-11-18T10:28:07.110 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 663255040 bytes 2021-11-18T10:28:07.244 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 708490240 bytes 2021-11-18T10:28:07.355 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 734395392 bytes 2021-11-18T10:28:07.518 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 795220992 bytes 2021-11-18T10:28:07.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 838864896 bytes 2021-11-18T10:28:07.748 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 850540544 bytes 2021-11-18T10:28:07.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 909578240 bytes 2021-11-18T10:28:08.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 960962560 bytes 2021-11-18T10:28:08.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 997037056 bytes 2021-11-18T10:28:08.312 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1064366080 bytes 2021-11-18T10:28:08.435 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1111036928 bytes 2021-11-18T10:28:08.609 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1177265152 bytes 2021-11-18T10:28:08.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1214538752 bytes 2021-11-18T10:28:08.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1246815232 bytes 2021-11-18T10:28:09.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1303497728 bytes 2021-11-18T10:28:09.206 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1400740864 bytes 2021-11-18T10:28:09.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1472122880 bytes 2021-11-18T10:28:09.465 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1497220096 bytes 2021-11-18T10:28:09.597 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1542603776 bytes 2021-11-18T10:28:09.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1631893504 bytes 2021-11-18T10:28:09.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1653304320 bytes 2021-11-18T10:28:10.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1698369536 bytes 2021-11-18T10:28:10.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1751080960 bytes 2021-11-18T10:28:10.289 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1787963392 bytes 2021-11-18T10:28:10.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1837465600 bytes 2021-11-18T10:28:10.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1879879680 bytes 2021-11-18T10:28:10.711 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1944755200 bytes 2021-11-18T10:28:10.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1974286336 bytes 2021-11-18T10:28:10.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1974899712 bytes 2021-11-18T10:28:11.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2010484736 bytes 2021-11-18T10:28:11.179 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2048956416 bytes 2021-11-18T10:28:11.355 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2138527744 bytes 2021-11-18T10:28:11.495 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2178525184 bytes 2021-11-18T10:28:11.641 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2250772480 bytes 2021-11-18T10:28:11.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2311399424 bytes 2021-11-18T10:28:11.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2318641152 bytes 2021-11-18T10:28:12.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2366596096 bytes 2021-11-18T10:28:12.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2405089280 bytes 2021-11-18T10:28:12.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2479252480 bytes 2021-11-18T10:28:12.483 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2491900928 bytes 2021-11-18T10:28:12.654 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2576248832 bytes 2021-11-18T10:28:12.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2675096576 bytes 2021-11-18T10:28:12.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2719457280 bytes 2021-11-18T10:28:13.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2761217024 bytes 2021-11-18T10:28:13.282 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2822770688 bytes 2021-11-18T10:28:13.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2875931648 bytes 2021-11-18T10:28:13.538 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2892755968 bytes 2021-11-18T10:28:13.688 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2976747520 bytes 2021-11-18T10:28:13.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:28:13.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:28:13.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:28:13.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:13.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-18T10:28:13.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:13.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:13.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:13.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:28:13.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:28:13.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:28:13.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:28:13.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:28:14.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:28:14.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:14.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:14.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:14.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:28:14.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:28:14.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:28:14.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:28:14.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:28:14.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:28:14.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:28:14.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:28:14.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:28:14.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:28:14.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:28:14.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:28:14.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+replaying 2021-11-18T10:28:14.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: replaying, {"bytes_per_second":17871086.93,"bytes_per_snapshot":536185344.0,"local_snapshot_timestamp":1637231225,"remote_snapshot_timestamp":1637231225,"replay_state":"idle"} 2021-11-18T10:28:14.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: service: mirror.3 on gibba019 2021-11-18T10:28:14.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:27:48 2021-11-18T10:28:14.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:28:14.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:28:14.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:28:14.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:28:14.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:27:48 2021-11-18T10:28:14.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:28:14.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: state: up+replaying 2021-11-18T10:28:14.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ description: .*' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:28:14.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: description: replaying, {"bytes_per_second":17871086.93,"bytes_per_snapshot":536185344.0,"local_snapshot_timestamp":1637231225,"remote_snapshot_timestamp":1637231225,"replay_state":"idle"} 2021-11-18T10:28:14.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:28:14.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:28:14.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^up+' 2021-11-18T10:28:14.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:28:14.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:28:14.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: service: mirror.3 on gibba019 2021-11-18T10:28:14.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:28:14.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'last_update=2021-11-18 10:27:48' 2021-11-18T10:28:14.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-18 10:27:48' 2021-11-18T10:28:14.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:14.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:14.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:14.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:28:14.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'prev_last_update=2021-11-18 10:27:48' 2021-11-18T10:28:14.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-18T10:28:14.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror.mirror_status 2021-11-18T10:28:14.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:28:14.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror.mirror_status 2021-11-18T10:28:14.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-18T10:28:14.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: failed to query services: (13) Permission denied 2021-11-18T10:28:14.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local last_update state 2021-11-18T10:28:14.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-18T10:28:14.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ last_update='2021-11-18 10:27:48' 2021-11-18T10:28:14.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-18T10:28:14.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ state=up+replaying 2021-11-18T10:28:14.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:28:14.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep up+replaying 2021-11-18T10:28:14.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:28:14.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:14.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:14.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap7 2021-11-18T10:28:14.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap7 2021-11-18T10:28:14.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:28:14.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:14.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:14.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap7 2021-11-18T10:28:14.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap7 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:28:21.347 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.7004264213138784) > weight (0.25) 2021-11-18T10:28:21.348 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.1 2021-11-18T10:28:21.349 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 15 2021-11-18T10:28:21.349 INFO:tasks.rbd_mirror_thrash:waiting for 9 secs before reviving daemons 2021-11-18T10:28:21.350 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba019.stderr:2021-11-18T10:28:21.352+0000 7fde9eda3700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 41988) UID: 1000 2021-11-18T10:28:21.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:28:29.366 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2021-11-18T10:28:29.367 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2021-11-18T10:28:29.367 INFO:tasks.rbd_mirror_thrash:waiting for 0 secs before reviving daemons 2021-11-18T10:28:29.367 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2021-11-18T10:28:29.368 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:28:29.369 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba019.stderr:2021-11-18T10:28:29.371+0000 7f4a0b9e8700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 41429) UID: 1000 2021-11-18T10:28:29.569 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:28:30.350 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.1 2021-11-18T10:28:30.351 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:28:30.351 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:28:30.352 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.1 2021-11-18T10:28:30.352 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2021-11-18T10:28:30.353 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2021-11-18T10:28:30.357 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2021-11-18T10:28:30.357 INFO:tasks.rbd_mirror_thrash:waiting for 61 secs before thrashing 2021-11-18T10:28:35.469 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:28:35.470 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2021-11-18T10:28:35.470 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2021-11-18T10:28:35.470 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2021-11-18T10:28:35.473 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2021-11-18T10:28:35.474 INFO:tasks.rbd_mirror_thrash:waiting for 80 secs before thrashing 2021-11-18T10:28:44.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:28:44.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:44.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:44.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:44.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:28:44.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:44.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:44.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:44.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:28:44.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:28:44.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:28:44.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:28:45.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:28:45.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:45.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:45.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:45.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:28:45.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:28:45.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:28:45.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:28:45.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:28:45.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:28:45.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:28:45.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:28:45.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:28:45.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:28:45.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:28:45.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:28:45.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:28:45.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:28:45.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:28:45.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:28:45.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:28:45.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:28:45.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:28:45.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:28:45.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:28:45.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:28:45.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:28:45.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:28:45.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:28:45.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:28:45.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:28:45.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:28:45.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:28:45.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:28:45.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:28:45.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:28:45.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:28:45.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:28:45.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:28:45.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:28:45.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:28:45.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:28:45.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:28:45.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:28:45.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:28:45.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:28:45.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:28:45.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:28:45.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:28:45.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:28:45.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:28:45.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:28:45.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:28:45.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:28:45.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:28:45.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:28:45.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:28:45.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:28:45.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:28:45.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:28:45.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:28:45.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:28:45.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:28:45.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:28:45.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:28:45.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:28:45.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:28:45.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:28:45.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:28:45.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:28:45.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:28:45.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:28:45.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:28:45.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:28:45.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:28:45.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:28:45.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:28:45.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:28:45.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:28:45.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:28:45.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:28:45.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:28:45.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:28:45.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:28:45.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:28:45.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:28:45.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:28:45.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:28:45.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:28:46.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:28:46.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:28:46.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:28:46.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:28:46.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:28:46.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:28:46.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:28:46.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:28:46.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:28:46.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:28:46.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:28:46.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:28:46.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:28:46.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:28:46.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:28:46.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:28:46.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:28:46.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:28:46.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:28:46.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:28:46.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:28:46.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:28:46.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:28:46.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:28:46.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:28:46.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:28:46.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:28:46.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:28:46.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:28:46.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:28:46.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:28:46.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:28:46.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:28:46.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:28:46.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:28:46.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:28:46.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:28:46.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:28:46.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:28:46.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:28:46.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:28:46.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:28:46.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:28:46.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:28:46.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:28:46.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:28:46.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:28:46.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:28:46.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:28:46.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:28:46.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:28:46.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:28:46.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:28:46.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:28:46.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:28:46.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:28:46.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:28:46.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:28:46.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:28:46.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:28:46.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:28:46.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:28:46.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:28:46.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:28:46.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:28:46.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:28:46.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:28:46.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:28:46.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:28:46.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:28:46.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:28:46.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:28:46.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:28:46.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:28:46.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:28:46.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:28:46.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:28:46.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:28:46.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:28:46.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:28:46.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:28:46.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:28:46.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:28:46.234 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:28:46.234 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:28:46.234 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:28:46.235 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:28:46.237 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:28:46.238 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:28:46.238 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:46.238 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-18T10:28:46.238 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:28:46.239 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:28:46.239 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:46.239 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:46.239 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = journal ']' 2021-11-18T10:28:46.239 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = snapshot ']' 2021-11-18T10:28:46.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-18T10:28:46.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:28:46.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:28:46.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:46.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:46.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster2-mirror-test.status 2021-11-18T10:28:46.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster2-mirror-test.status 2021-11-18T10:28:46.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:28:46.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:28:46.242 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.status 2021-11-18T10:28:46.242 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.status 2021-11-18T10:28:46.242 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:28:46.242 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:28:46.243 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-18T10:28:46.243 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:28:46.243 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:46.243 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:46.243 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-18T10:28:46.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Snapshot ID: 30 2021-11-18T10:28:46.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:28:46.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:28:46.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:46.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:46.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:28:46.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-18T10:28:46.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:28:46.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-18T10:28:46.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snapshot_id=30 2021-11-18T10:28:46.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:28:46.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:28:46.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.2 2021-11-18T10:28:47.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:28:47.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:47.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:47.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:47.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:28:47.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:28:47.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:28:47.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:28:47.197 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=26 2021-11-18T10:28:47.197 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 30 = 26 2021-11-18T10:28:47.197 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:28:47.198 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.4 2021-11-18T10:28:47.599 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:28:47.600 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:47.601 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:47.602 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:47.603 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:28:47.604 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:28:47.606 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:28:47.636 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:28:47.636 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:28:47.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:28:47.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:28:47.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:28:47.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:28:47.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 30 = '' 2021-11-18T10:28:47.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:28:47.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.8 2021-11-18T10:28:48.438 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:28:48.438 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:48.439 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:48.439 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:48.439 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:28:48.439 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:28:48.440 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:28:48.472 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:28:48.473 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:28:48.473 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:28:48.474 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:28:48.474 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:28:48.474 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:28:48.474 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 30 = '' 2021-11-18T10:28:48.475 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:28:48.475 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1.6 2021-11-18T10:28:50.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:28:50.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:50.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:50.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:50.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:28:50.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:28:50.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:28:50.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:28:50.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=30 2021-11-18T10:28:50.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 30 = 30 2021-11-18T10:28:50.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:50.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snap_present cluster1 mirror test snap7 2021-11-18T10:28:50.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:28:50.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:50.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:50.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap7 2021-11-18T10:28:50.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:28:50.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-18T10:28:50.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:28:51.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 info mirror/test@snap7 2021-11-18T10:28:51.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:28:51.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:28:51.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:28:51.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 15 2021-11-18T10:28:51.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10acfb4eccf5 2021-11-18T10:28:51.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10acfb4eccf5 2021-11-18T10:28:51.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:28:51.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock, operations, non-primary 2021-11-18T10:28:51.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: snap-trash 2021-11-18T10:28:51.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:28:51.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:28:51.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:28:02 2021 2021-11-18T10:28:51.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:28:51.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: protected: False 2021-11-18T10:28:51.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:28:51.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:28:51.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:28:51.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: false 2021-11-18T10:28:51.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:51.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snap6-clean ']' 2021-11-18T10:28:51.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap6-clean 2021-11-18T10:28:51.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:51.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:51.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap6-clean 2021-11-18T10:28:51.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:28:51.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:28:51.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:51.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:51.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap6-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:28:51.597 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:28:51.600 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap6-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:52.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:28:52.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:52.286 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:52.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:52.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap7 2021-11-18T10:28:52.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:52.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:52.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap7 2021-11-18T10:28:52.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:28:52.386 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:28:52.386 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:52.386 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:52.386 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap7 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:28:52.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:28:52.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap7 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:53.477 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:28:53.480 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:53.610 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:28:53.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:28:53.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ clean_snap_name=snap7-clean 2021-11-18T10:28:53.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap7-clean 2021-11-18T10:28:53.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:28:53.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:53.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:53.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap7-clean 2021-11-18T10:28:53.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap7-clean --debug-rbd=20 --debug-journaler=20 2021-11-18T10:28:54.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:28:54.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror test 2021-11-18T10:28:54.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:28:54.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:28:54.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:28:54.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:28:54.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=14 2021-11-18T10:28:54.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:28:54.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 14s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-18T10:28:54.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 78701568 bytes 2021-11-18T10:28:55.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 93070336 bytes 2021-11-18T10:28:55.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 131486720 bytes 2021-11-18T10:28:55.390 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 178884608 bytes 2021-11-18T10:28:55.520 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 212106240 bytes 2021-11-18T10:28:55.648 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 243591168 bytes 2021-11-18T10:28:55.747 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 247371776 bytes 2021-11-18T10:28:55.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 288058368 bytes 2021-11-18T10:28:55.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 311347200 bytes 2021-11-18T10:28:56.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 347812864 bytes 2021-11-18T10:28:56.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 402426880 bytes 2021-11-18T10:28:56.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 411611136 bytes 2021-11-18T10:28:56.489 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 474252288 bytes 2021-11-18T10:28:56.682 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 541448192 bytes 2021-11-18T10:28:56.801 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 570349568 bytes 2021-11-18T10:28:57.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 629563392 bytes 2021-11-18T10:28:57.269 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 638654464 bytes 2021-11-18T10:28:57.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 668115968 bytes 2021-11-18T10:28:57.489 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 668748800 bytes 2021-11-18T10:28:57.621 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 705590272 bytes 2021-11-18T10:28:57.746 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 729620480 bytes 2021-11-18T10:28:57.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 778232832 bytes 2021-11-18T10:28:58.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 806935552 bytes 2021-11-18T10:28:58.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 816964608 bytes 2021-11-18T10:28:58.230 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 867968000 bytes 2021-11-18T10:28:58.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 901912576 bytes 2021-11-18T10:28:58.499 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 924136448 bytes 2021-11-18T10:28:58.660 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1000188928 bytes 2021-11-18T10:28:58.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1070743552 bytes 2021-11-18T10:28:59.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1131899904 bytes 2021-11-18T10:28:59.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1151329280 bytes 2021-11-18T10:28:59.291 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1177294848 bytes 2021-11-18T10:28:59.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1218050048 bytes 2021-11-18T10:28:59.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1220206592 bytes 2021-11-18T10:28:59.671 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1279826944 bytes 2021-11-18T10:28:59.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1351603200 bytes 2021-11-18T10:28:59.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1392537600 bytes 2021-11-18T10:29:00.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1413445632 bytes 2021-11-18T10:29:00.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1433562112 bytes 2021-11-18T10:29:00.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1441685504 bytes 2021-11-18T10:29:00.475 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1485049856 bytes 2021-11-18T10:29:00.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1491602432 bytes 2021-11-18T10:29:00.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1506369536 bytes 2021-11-18T10:29:00.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1599486976 bytes 2021-11-18T10:29:01.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1689059328 bytes 2021-11-18T10:29:01.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1697337344 bytes 2021-11-18T10:29:01.266 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1704190976 bytes 2021-11-18T10:29:01.442 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1799003136 bytes 2021-11-18T10:29:01.560 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1827178496 bytes 2021-11-18T10:29:01.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 1882664960 bytes 2021-11-18T10:29:01.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 1925729280 bytes 2021-11-18T10:29:02.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 1957641216 bytes 2021-11-18T10:29:02.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 1969800192 bytes 2021-11-18T10:29:02.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2009315328 bytes 2021-11-18T10:29:02.353 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2009910272 bytes 2021-11-18T10:29:02.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2051220480 bytes 2021-11-18T10:29:02.627 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2094911488 bytes 2021-11-18T10:29:02.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2200203264 bytes 2021-11-18T10:29:02.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2251636736 bytes 2021-11-18T10:29:03.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2283678720 bytes 2021-11-18T10:29:03.205 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2287911936 bytes 2021-11-18T10:29:03.342 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2312857600 bytes 2021-11-18T10:29:03.449 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2324666368 bytes 2021-11-18T10:29:03.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2360976384 bytes 2021-11-18T10:29:03.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2385929216 bytes 2021-11-18T10:29:03.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2454334464 bytes 2021-11-18T10:29:04.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2519439360 bytes 2021-11-18T10:29:04.203 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2595689472 bytes 2021-11-18T10:29:04.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2673614848 bytes 2021-11-18T10:29:04.547 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2754899968 bytes 2021-11-18T10:29:04.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2793648128 bytes 2021-11-18T10:29:04.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2819738624 bytes 2021-11-18T10:29:04.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2852072448 bytes 2021-11-18T10:29:05.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2890366976 bytes 2021-11-18T10:29:05.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 2915961856 bytes 2021-11-18T10:29:05.342 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 2945007616 bytes 2021-11-18T10:29:05.493 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 2987247616 bytes 2021-11-18T10:29:05.595 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 2988574720 bytes 2021-11-18T10:29:05.710 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3023082496 bytes 2021-11-18T10:29:05.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3031278592 bytes 2021-11-18T10:29:05.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3048680448 bytes 2021-11-18T10:29:06.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3051440128 bytes 2021-11-18T10:29:06.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3057297408 bytes 2021-11-18T10:29:06.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3090819072 bytes 2021-11-18T10:29:06.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3124710400 bytes 2021-11-18T10:29:06.566 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3167837184 bytes 2021-11-18T10:29:06.691 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3189637120 bytes 2021-11-18T10:29:06.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3213128704 bytes 2021-11-18T10:29:06.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3247202304 bytes 2021-11-18T10:29:07.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3317409792 bytes 2021-11-18T10:29:07.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3327686656 bytes 2021-11-18T10:29:07.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3354975232 bytes 2021-11-18T10:29:07.486 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3362230272 bytes 2021-11-18T10:29:07.595 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3368764416 bytes 2021-11-18T10:29:07.741 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3406034944 bytes 2021-11-18T10:29:07.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3431391232 bytes 2021-11-18T10:29:07.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 3454052352 bytes 2021-11-18T10:29:08.134 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 3489698816 bytes 2021-11-18T10:29:08.244 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 3498415104 bytes 2021-11-18T10:29:08.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 3536424960 bytes 2021-11-18T10:29:08.524 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 3569053696 bytes 2021-11-18T10:29:08.648 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 3594221568 bytes 2021-11-18T10:29:08.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:29:08.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:29:08.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:29:08.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:29:08.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-18T10:29:08.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:08.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:08.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:08.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:29:08.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:29:08.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:29:08.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:29:08.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:29:09.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:29:09.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:09.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:09.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:09.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:29:09.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:29:09.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:29:09.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:29:09.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:29:09.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:29:09.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:09.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:29:09.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:29:09.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:09.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:29:09.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:29:09.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+replaying 2021-11-18T10:29:09.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":536065536.0,"local_snapshot_timestamp":1637231277,"remote_snapshot_timestamp":1637231277,"replay_state":"idle"} 2021-11-18T10:29:09.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: service: mirror.3 on gibba019 2021-11-18T10:29:09.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:28:48 2021-11-18T10:29:09.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:29:09.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:29:09.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:29:09.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:29:09.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:28:48 2021-11-18T10:29:09.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:09.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: state: up+replaying 2021-11-18T10:29:09.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ description: .*' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:09.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: description: replaying, {"bytes_per_second":0.0,"bytes_per_snapshot":536065536.0,"local_snapshot_timestamp":1637231277,"remote_snapshot_timestamp":1637231277,"replay_state":"idle"} 2021-11-18T10:29:09.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:29:09.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:29:09.813 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^up+' 2021-11-18T10:29:09.813 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:29:09.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:09.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: service: mirror.3 on gibba019 2021-11-18T10:29:09.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:09.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'last_update=2021-11-18 10:28:48' 2021-11-18T10:29:09.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-18 10:28:48' 2021-11-18T10:29:09.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:09.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:09.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:09.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:29:09.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'prev_last_update=2021-11-18 10:28:48' 2021-11-18T10:29:09.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-18T10:29:09.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror.mirror_status 2021-11-18T10:29:09.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:29:09.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror.mirror_status 2021-11-18T10:29:09.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-18T10:29:09.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: failed to query services: (13) Permission denied 2021-11-18T10:29:09.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local last_update state 2021-11-18T10:29:09.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-18T10:29:09.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ last_update='2021-11-18 10:28:48' 2021-11-18T10:29:09.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-18T10:29:09.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ state=up+replaying 2021-11-18T10:29:09.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:29:09.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep up+replaying 2021-11-18T10:29:09.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:29:09.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:29:09.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:29:09.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap8 2021-11-18T10:29:09.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap8 2021-11-18T10:29:09.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:29:09.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:09.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:09.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap8 2021-11-18T10:29:09.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap8 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:29:31.358 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.5651517412580579) > weight (0.25) 2021-11-18T10:29:31.359 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.1 2021-11-18T10:29:31.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 15 2021-11-18T10:29:31.360 INFO:tasks.rbd_mirror_thrash:waiting for 6 secs before reviving daemons 2021-11-18T10:29:31.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba019.stderr:2021-11-18T10:29:31.364+0000 7f71ddebd700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 45078) UID: 1000 2021-11-18T10:29:31.562 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:29:37.362 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.1 2021-11-18T10:29:37.362 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:29:37.363 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:29:37.363 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.1 2021-11-18T10:29:37.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2021-11-18T10:29:37.364 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2021-11-18T10:29:37.367 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2021-11-18T10:29:37.368 INFO:tasks.rbd_mirror_thrash:waiting for 67 secs before thrashing 2021-11-18T10:29:40.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:29:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:29:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:29:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:29:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:29:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:29:41.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:29:41.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:41.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:41.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:41.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:29:41.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:29:41.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:29:41.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:29:41.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:29:41.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:29:41.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:29:41.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:29:41.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:29:41.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:29:41.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:29:41.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:29:41.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:29:41.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:29:41.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:29:41.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:29:41.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:29:41.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:29:41.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:29:41.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:29:41.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:29:41.019 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:29:41.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:29:41.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:29:41.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:29:41.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:29:41.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:29:41.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:29:41.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:29:41.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:29:41.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:29:41.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:29:41.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:29:41.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:29:41.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:29:41.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:29:41.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:29:41.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:29:41.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:29:41.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:29:41.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:29:41.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:29:41.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:29:41.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:29:41.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:29:41.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:29:41.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:29:41.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:29:41.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:29:41.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:29:41.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:29:41.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:29:41.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:29:41.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:29:41.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:29:41.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:29:41.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:29:41.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:29:41.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:29:41.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:29:41.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:29:41.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:29:41.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:29:41.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:29:41.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:29:41.093 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:29:41.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:29:41.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:29:41.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:29:41.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:29:41.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:29:41.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:29:41.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:29:41.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:29:41.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:29:41.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:29:41.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:29:41.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:29:41.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:29:41.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:29:41.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:29:41.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:29:41.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:29:41.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:29:41.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:29:41.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:29:41.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:29:41.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:29:41.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:29:41.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:29:41.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:29:41.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:29:41.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:29:41.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:29:41.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:29:41.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:29:41.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:29:41.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:29:41.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:29:41.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:29:41.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:29:41.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:29:41.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:29:41.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:29:41.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:29:41.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:29:41.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:29:41.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:29:41.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:29:41.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:29:41.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:29:41.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:29:41.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:29:41.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:29:41.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:29:41.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:29:41.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:29:41.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:29:41.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:29:41.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:29:41.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:29:41.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:29:41.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:29:41.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:29:41.179 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:29:41.179 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:29:41.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:29:41.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:29:41.244 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:29:41.245 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:29:41.245 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:29:41.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:29:41.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:29:41.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:29:41.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:29:41.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:29:41.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:29:41.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:29:41.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:29:41.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:29:41.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:29:41.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:29:41.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:29:41.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:29:41.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:29:41.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:29:41.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:29:41.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:29:41.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:29:41.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:29:41.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:29:41.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:29:41.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:29:41.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:29:41.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:29:41.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:29:41.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:29:41.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:29:41.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:29:41.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:29:41.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:29:41.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:29:41.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:29:41.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:29:41.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:29:41.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:29:41.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:29:41.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:29:41.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:29:41.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:29:41.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:29:41.332 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:29:41.334 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:29:41.334 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:29:41.334 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:29:41.335 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-18T10:29:41.335 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:29:41.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:29:41.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:41.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:41.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = journal ']' 2021-11-18T10:29:41.337 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = snapshot ']' 2021-11-18T10:29:41.337 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-18T10:29:41.337 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:29:41.337 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:29:41.338 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:41.338 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:41.338 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster2-mirror-test.status 2021-11-18T10:29:41.338 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster2-mirror-test.status 2021-11-18T10:29:41.338 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:29:41.339 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:29:41.339 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.status 2021-11-18T10:29:41.339 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.status 2021-11-18T10:29:41.339 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:29:41.339 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:29:41.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-18T10:29:41.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:29:41.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:41.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:41.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-18T10:29:42.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Snapshot ID: 34 2021-11-18T10:29:42.232 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:29:42.232 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:29:42.232 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:42.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:42.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:29:42.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-18T10:29:42.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:29:42.263 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-18T10:29:42.264 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snapshot_id=34 2021-11-18T10:29:42.265 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:29:42.265 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:29:42.265 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.2 2021-11-18T10:29:42.466 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:29:42.466 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:42.466 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:42.467 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:42.467 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:29:42.467 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:29:42.467 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:29:42.503 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:29:42.503 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:29:42.504 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:29:42.504 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:29:42.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:29:42.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:29:42.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 34 = '' 2021-11-18T10:29:42.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:29:42.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.4 2021-11-18T10:29:42.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:29:42.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:42.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:42.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:42.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:29:42.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:29:42.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:29:42.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:29:42.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:29:42.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:29:42.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:29:42.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:29:42.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:29:42.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 34 = '' 2021-11-18T10:29:42.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:29:42.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.8 2021-11-18T10:29:43.749 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:29:43.749 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:43.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:43.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:43.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:29:43.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:29:43.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:29:43.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:29:43.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:29:43.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:29:43.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:29:43.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:29:43.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:29:43.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 34 = '' 2021-11-18T10:29:43.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:29:43.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1.6 2021-11-18T10:29:45.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:29:45.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:45.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:45.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:45.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:29:45.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:29:45.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:29:45.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:29:45.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=34 2021-11-18T10:29:45.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 34 = 34 2021-11-18T10:29:45.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:29:45.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snap_present cluster1 mirror test snap8 2021-11-18T10:29:45.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:45.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:45.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:45.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap8 2021-11-18T10:29:45.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:29:45.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-18T10:29:45.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:29:46.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 info mirror/test@snap8 2021-11-18T10:29:46.457 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:29:46.457 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:29:46.457 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:29:46.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 16 2021-11-18T10:29:46.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10acfb4eccf5 2021-11-18T10:29:46.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10acfb4eccf5 2021-11-18T10:29:46.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:29:46.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock, non-primary 2021-11-18T10:29:46.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:29:46.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:29:46.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:29:46.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:28:02 2021 2021-11-18T10:29:46.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:29:46.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: protected: False 2021-11-18T10:29:46.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:29:46.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:29:46.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:29:46.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: false 2021-11-18T10:29:46.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:29:46.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snap7-clean ']' 2021-11-18T10:29:46.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap7-clean 2021-11-18T10:29:46.464 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:46.464 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:46.464 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap7-clean 2021-11-18T10:29:46.464 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:29:46.465 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:29:46.465 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:29:46.465 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:29:46.465 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap7-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:29:46.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:29:46.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap7-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:29:47.608 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:29:47.611 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:29:47.742 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:29:47.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:29:47.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap8 2021-11-18T10:29:47.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:47.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:47.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap8 2021-11-18T10:29:47.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:29:47.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:29:47.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:29:47.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:29:47.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap8 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:29:48.308 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:29:48.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap8 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:29:48.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:29:48.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:29:48.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:29:49.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:29:49.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ clean_snap_name=snap8-clean 2021-11-18T10:29:49.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap8-clean 2021-11-18T10:29:49.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:29:49.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:49.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:49.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap8-clean 2021-11-18T10:29:49.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap8-clean --debug-rbd=20 --debug-journaler=20 2021-11-18T10:29:50.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:29:50.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror test 2021-11-18T10:29:50.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:29:50.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:50.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:50.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:29:50.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=8 2021-11-18T10:29:50.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:29:50.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 8s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-18T10:29:50.205 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 5676032 bytes 2021-11-18T10:29:50.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 6349824 bytes 2021-11-18T10:29:50.471 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 52676608 bytes 2021-11-18T10:29:50.633 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 131858432 bytes 2021-11-18T10:29:50.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 198080512 bytes 2021-11-18T10:29:50.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 225138688 bytes 2021-11-18T10:29:51.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 272380928 bytes 2021-11-18T10:29:51.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 342853632 bytes 2021-11-18T10:29:51.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 402609152 bytes 2021-11-18T10:29:51.537 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 424022016 bytes 2021-11-18T10:29:51.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 494195712 bytes 2021-11-18T10:29:51.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 529021952 bytes 2021-11-18T10:29:51.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 577884160 bytes 2021-11-18T10:29:52.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 597912576 bytes 2021-11-18T10:29:52.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 688299008 bytes 2021-11-18T10:29:52.408 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 701858816 bytes 2021-11-18T10:29:52.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 782507008 bytes 2021-11-18T10:29:52.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 800508928 bytes 2021-11-18T10:29:52.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 840982528 bytes 2021-11-18T10:29:52.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 841589760 bytes 2021-11-18T10:29:53.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 920825856 bytes 2021-11-18T10:29:53.267 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:29:53.269+0000 7f788168a700 -1 reset not still connected to 0x55e0e4dbb5f0 2021-11-18T10:29:53.299 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 992314368 bytes 2021-11-18T10:29:53.435 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1022408704 bytes 2021-11-18T10:29:53.609 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1124912128 bytes 2021-11-18T10:29:53.771 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1140672512 bytes 2021-11-18T10:29:53.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1191354368 bytes 2021-11-18T10:29:54.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1213607936 bytes 2021-11-18T10:29:54.198 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1254606848 bytes 2021-11-18T10:29:54.303 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1258259456 bytes 2021-11-18T10:29:54.443 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1291926528 bytes 2021-11-18T10:29:54.562 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1318451200 bytes 2021-11-18T10:29:54.719 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1376486400 bytes 2021-11-18T10:29:54.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1450016768 bytes 2021-11-18T10:29:55.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1465332736 bytes 2021-11-18T10:29:55.110 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1489732608 bytes 2021-11-18T10:29:55.267 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1515936768 bytes 2021-11-18T10:29:55.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1539990528 bytes 2021-11-18T10:29:55.474 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.5789180934298201) > weight (0.25) 2021-11-18T10:29:55.475 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2021-11-18T10:29:55.475 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2021-11-18T10:29:55.476 INFO:tasks.rbd_mirror_thrash:waiting for 3 secs before reviving daemons 2021-11-18T10:29:55.476 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:2021-11-18T10:29:55.478+0000 7f8f3a4cc700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 44119) UID: 1000 2021-11-18T10:29:55.540 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1604868096 bytes 2021-11-18T10:29:55.697 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1637075968 bytes 2021-11-18T10:29:55.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1712946176 bytes 2021-11-18T10:29:55.877 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:29:56.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1778270208 bytes 2021-11-18T10:29:56.138 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1790767104 bytes 2021-11-18T10:29:56.292 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1839806464 bytes 2021-11-18T10:29:56.441 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1890191360 bytes 2021-11-18T10:29:56.563 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1907011584 bytes 2021-11-18T10:29:56.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1952246784 bytes 2021-11-18T10:29:56.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1967064064 bytes 2021-11-18T10:29:56.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2011951104 bytes 2021-11-18T10:29:57.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2054664192 bytes 2021-11-18T10:29:57.294 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2101720064 bytes 2021-11-18T10:29:57.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2116019200 bytes 2021-11-18T10:29:57.563 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2176283648 bytes 2021-11-18T10:29:57.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2183720960 bytes 2021-11-18T10:29:57.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2208416768 bytes 2021-11-18T10:29:58.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2250913792 bytes 2021-11-18T10:29:58.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:29:58.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:29:58.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:29:58.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:29:58.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-18T10:29:58.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:58.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:58.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:58.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:29:58.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:29:58.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:29:58.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:29:58.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:29:58.477 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2021-11-18T10:29:58.477 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:29:58.478 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:29:58.478 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2021-11-18T10:29:58.478 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2021-11-18T10:29:58.479 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2021-11-18T10:29:58.482 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2021-11-18T10:29:58.482 INFO:tasks.rbd_mirror_thrash:waiting for 112 secs before thrashing 2021-11-18T10:29:59.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:29:59.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:59.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:59.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:59.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:29:59.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:29:59.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:29:59.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:29:59.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:29:59.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:29:59.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:59.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:29:59.042 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:29:59.042 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:59.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:29:59.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:29:59.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+replaying 2021-11-18T10:29:59.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: replaying, {"bytes_per_second":17683968.0,"bytes_per_snapshot":532342784.0,"local_snapshot_timestamp":1637231381,"remote_snapshot_timestamp":1637231381,"replay_state":"idle"} 2021-11-18T10:29:59.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: service: mirror.3 on gibba019 2021-11-18T10:29:59.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:29:48 2021-11-18T10:29:59.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:29:59.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:29:59.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:29:59.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:29:59.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:29:56 2021-11-18T10:29:59.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:59.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: state: up+replaying 2021-11-18T10:29:59.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ description: .*' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:59.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: description: replaying, {"bytes_per_second":17683968.0,"bytes_per_snapshot":532342784.0,"local_snapshot_timestamp":1637231381,"remote_snapshot_timestamp":1637231381,"replay_state":"idle"} 2021-11-18T10:29:59.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:29:59.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:29:59.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^up+' 2021-11-18T10:29:59.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:29:59.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:59.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: service: mirror.3 on gibba019 2021-11-18T10:29:59.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:29:59.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'last_update=2021-11-18 10:29:48' 2021-11-18T10:29:59.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-18 10:29:48' 2021-11-18T10:29:59.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:29:59.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:59.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:59.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:29:59.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'prev_last_update=2021-11-18 10:29:48' 2021-11-18T10:29:59.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-18T10:29:59.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror.mirror_status 2021-11-18T10:29:59.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:29:59.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror.mirror_status 2021-11-18T10:29:59.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-18T10:29:59.119 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: failed to query services: (13) Permission denied 2021-11-18T10:29:59.143 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local last_update state 2021-11-18T10:29:59.143 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-18T10:29:59.144 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ last_update='2021-11-18 10:29:48' 2021-11-18T10:29:59.144 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-18T10:29:59.145 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ state=up+replaying 2021-11-18T10:29:59.146 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:29:59.146 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep up+replaying 2021-11-18T10:29:59.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:29:59.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:29:59.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:29:59.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap9 2021-11-18T10:29:59.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap9 2021-11-18T10:29:59.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:29:59.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:29:59.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:29:59.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap9 2021-11-18T10:29:59.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap9 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:30:27.823 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:30:27.824 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:30:27.824 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:27.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:27.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:30:27.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:30:27.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:27.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:27.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:30:27.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:30:27.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:30:27.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:30:28.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:30:28.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:30:28.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:28.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:28.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:30:28.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:30:28.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:30:28.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:30:28.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:30:28.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:30:28.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:30:28.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:30:28.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:30:28.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:30:28.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:30:28.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:30:28.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:30:28.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:30:28.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:30:28.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:30:28.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:30:28.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:30:28.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:30:28.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:30:28.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:30:28.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:30:28.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:30:28.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:30:28.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:30:28.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:30:28.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:30:28.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:30:28.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:30:28.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:30:28.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:30:28.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:30:28.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:30:28.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:30:28.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:30:28.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:30:28.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:30:28.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:30:28.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:30:28.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:30:28.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:30:28.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:30:28.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:30:28.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:30:28.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:30:28.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:30:28.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:30:28.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:30:28.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:30:28.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:30:28.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:30:28.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:30:28.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:30:28.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:30:28.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:30:28.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:30:28.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:30:28.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:30:28.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:30:28.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:30:28.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:30:28.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:30:28.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:30:28.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:30:28.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:30:28.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:30:28.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:30:28.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:30:28.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:30:28.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:30:28.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:30:28.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:30:28.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:30:28.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:30:28.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:30:28.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:30:28.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:30:28.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:30:28.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:30:28.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:30:28.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:30:28.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:30:28.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:30:28.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:30:28.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:30:28.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:30:28.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:30:28.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:30:28.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:30:28.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:30:28.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:30:28.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:30:28.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:30:28.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:30:28.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:30:28.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:30:28.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:30:28.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:30:28.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:30:28.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:30:28.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:30:28.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:30:28.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:30:28.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:30:28.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:30:28.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:30:28.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:30:28.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:30:28.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:30:28.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:30:28.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:30:28.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:30:28.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:30:28.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:30:28.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:30:28.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:30:28.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:30:28.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:30:28.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:30:28.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:30:28.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:30:28.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:30:28.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:30:28.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:30:28.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:30:28.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:30:28.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:30:28.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:30:29.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:30:29.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:30:29.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:30:29.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:30:29.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:30:29.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:30:29.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:30:29.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:30:29.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:30:29.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:30:29.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:30:29.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:30:29.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:30:29.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:30:29.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:30:29.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:30:29.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:30:29.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:30:29.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:30:29.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:30:29.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:30:29.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:30:29.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:30:29.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:30:29.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:30:29.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:30:29.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:30:29.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:30:29.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:30:29.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:30:29.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:30:29.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:30:29.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:30:29.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:30:29.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:30:29.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:30:29.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:30:29.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:30:29.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:30:29.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:30:29.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:30:29.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:30:29.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:30:29.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:30:29.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:30:29.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:30:29.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:30:29.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-18T10:30:29.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:30:29.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:30:29.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:29.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:29.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = journal ']' 2021-11-18T10:30:29.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = snapshot ']' 2021-11-18T10:30:29.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-18T10:30:29.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:30:29.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:30:29.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:29.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:29.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster2-mirror-test.status 2021-11-18T10:30:29.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster2-mirror-test.status 2021-11-18T10:30:29.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:30:29.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:30:29.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.status 2021-11-18T10:30:29.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.status 2021-11-18T10:30:29.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:30:29.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:30:29.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-18T10:30:29.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:30:29.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:29.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:29.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-18T10:30:29.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Snapshot ID: 38 2021-11-18T10:30:29.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:30:29.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:30:29.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:29.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:29.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:30:29.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-18T10:30:29.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:30:29.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-18T10:30:29.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snapshot_id=38 2021-11-18T10:30:29.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:30:29.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:30:29.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.2 2021-11-18T10:30:30.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:30:30.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:30:30.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:30.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:30.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:30:30.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:30:30.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:30:30.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:30:30.119 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=34 2021-11-18T10:30:30.119 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 38 = 34 2021-11-18T10:30:30.120 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:30:30.120 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.4 2021-11-18T10:30:30.520 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:30:30.521 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:30:30.521 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:30.521 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:30.521 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:30:30.522 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:30:30.522 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:30:30.557 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:30:30.558 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:30:30.559 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:30:30.559 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:30:30.559 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:30:30.559 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:30:30.560 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 38 = '' 2021-11-18T10:30:30.560 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:30:30.560 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.8 2021-11-18T10:30:31.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:30:31.361 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:30:31.361 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:31.361 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:31.361 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:30:31.362 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:30:31.362 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:30:31.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:30:31.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:30:31.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:30:31.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:30:31.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:30:31.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:30:31.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 38 = '' 2021-11-18T10:30:31.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:30:31.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1.6 2021-11-18T10:30:33.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:30:33.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:30:33.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:33.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:33.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:30:33.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:30:33.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:30:33.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:30:33.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=38 2021-11-18T10:30:33.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 38 = 38 2021-11-18T10:30:33.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:30:33.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snap_present cluster1 mirror test snap9 2021-11-18T10:30:33.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:30:33.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:33.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:33.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap9 2021-11-18T10:30:33.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:30:33.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-18T10:30:33.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:30:34.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 info mirror/test@snap9 2021-11-18T10:30:34.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:30:34.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:30:34.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:30:34.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 19 2021-11-18T10:30:34.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10acfb4eccf5 2021-11-18T10:30:34.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10acfb4eccf5 2021-11-18T10:30:34.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:30:34.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock, operations, non-primary 2021-11-18T10:30:34.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: snap-trash 2021-11-18T10:30:34.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:30:34.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:30:34.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:29:46 2021 2021-11-18T10:30:34.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:30:34.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: protected: False 2021-11-18T10:30:34.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:30:34.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:30:34.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:30:34.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: false 2021-11-18T10:30:34.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:30:34.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snap8-clean ']' 2021-11-18T10:30:34.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap8-clean 2021-11-18T10:30:34.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:34.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:34.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap8-clean 2021-11-18T10:30:34.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:30:34.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:30:34.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:30:34.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:30:34.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap8-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:30:34.538 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:30:34.541 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap8-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:30:35.134 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:30:35.137 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:30:35.265 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:30:35.362 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:30:35.362 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap9 2021-11-18T10:30:35.362 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:35.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:35.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap9 2021-11-18T10:30:35.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:30:35.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:30:35.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:30:35.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:30:35.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap9 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:30:35.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:30:35.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap9 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:30:36.466 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:30:36.469 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:30:36.597 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:30:36.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:30:36.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ clean_snap_name=snap9-clean 2021-11-18T10:30:36.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap9-clean 2021-11-18T10:30:36.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:30:36.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:36.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:36.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap9-clean 2021-11-18T10:30:36.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap9-clean --debug-rbd=20 --debug-journaler=20 2021-11-18T10:30:36.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:30:36.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror test 2021-11-18T10:30:36.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:30:36.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:36.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:36.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:30:36.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=6 2021-11-18T10:30:36.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:30:36.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 6s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror test --debug-rbd=20 --debug-journaler=20 2021-11-18T10:30:37.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 7477248 bytes 2021-11-18T10:30:37.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 50805760 bytes 2021-11-18T10:30:37.354 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 132058112 bytes 2021-11-18T10:30:37.512 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 189641728 bytes 2021-11-18T10:30:37.661 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 235581440 bytes 2021-11-18T10:30:37.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 280933376 bytes 2021-11-18T10:30:37.954 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 308302848 bytes 2021-11-18T10:30:38.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 328230912 bytes 2021-11-18T10:30:38.221 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 370708480 bytes 2021-11-18T10:30:38.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 371325952 bytes 2021-11-18T10:30:38.430 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 373190656 bytes 2021-11-18T10:30:38.541 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 379042816 bytes 2021-11-18T10:30:38.698 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 412942336 bytes 2021-11-18T10:30:38.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 457662464 bytes 2021-11-18T10:30:39.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 493457408 bytes 2021-11-18T10:30:39.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 543220736 bytes 2021-11-18T10:30:39.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 583471104 bytes 2021-11-18T10:30:39.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 642963456 bytes 2021-11-18T10:30:39.582 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 659704832 bytes 2021-11-18T10:30:39.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 675697664 bytes 2021-11-18T10:30:39.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 742782976 bytes 2021-11-18T10:30:40.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 779205632 bytes 2021-11-18T10:30:40.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 803994624 bytes 2021-11-18T10:30:40.281 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 828147712 bytes 2021-11-18T10:30:40.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 863986688 bytes 2021-11-18T10:30:40.574 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 916685824 bytes 2021-11-18T10:30:40.723 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 950203392 bytes 2021-11-18T10:30:40.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1024601088 bytes 2021-11-18T10:30:41.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1079056384 bytes 2021-11-18T10:30:41.205 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1086053376 bytes 2021-11-18T10:30:41.373 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1142493184 bytes 2021-11-18T10:30:41.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1259256832 bytes 2021-11-18T10:30:41.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1327754240 bytes 2021-11-18T10:30:41.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1334540288 bytes 2021-11-18T10:30:41.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1359925248 bytes 2021-11-18T10:30:42.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1405643776 bytes 2021-11-18T10:30:42.293 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1438569472 bytes 2021-11-18T10:30:42.431 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1476158464 bytes 2021-11-18T10:30:42.543 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1476779008 bytes 2021-11-18T10:30:42.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1566831616 bytes 2021-11-18T10:30:42.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:30:42.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:30:42.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:30:42.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:30:42.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_status_in_pool_dir cluster1 mirror test up+replaying 2021-11-18T10:30:42.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:30:42.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:42.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:42.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:30:42.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:30:42.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:30:42.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:30:42.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:30:43.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_status_in_pool_dir cluster1 mirror test up+replaying '' '' 2021-11-18T10:30:43.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:30:43.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:43.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:43.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:30:43.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local description_pattern= 2021-11-18T10:30:43.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local service_pattern= 2021-11-18T10:30:43.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.mirror_status 2021-11-18T10:30:43.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.mirror_status 2021-11-18T10:30:43.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:30:43.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:30:43.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ CEPH_ARGS= 2021-11-18T10:30:43.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror image status mirror/test 2021-11-18T10:30:43.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:30:43.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:test: 2021-11-18T10:30:43.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: global_id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:30:43.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+replaying 2021-11-18T10:30:43.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: replaying, {"bytes_per_second":17683968.0,"bytes_per_snapshot":532342784.0,"local_snapshot_timestamp":1637231381,"remote_snapshot_timestamp":1637231381,"replay_state":"idle"} 2021-11-18T10:30:43.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: service: mirror.3 on gibba019 2021-11-18T10:30:43.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:30:18 2021-11-18T10:30:43.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: peer_sites: 2021-11-18T10:30:43.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: name: cluster2 2021-11-18T10:30:43.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: state: up+stopped 2021-11-18T10:30:43.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: description: local image is primary 2021-11-18T10:30:43.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: last_update: 2021-11-18 10:30:18 2021-11-18T10:30:43.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ state: .*up+replaying' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:30:43.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: state: up+replaying 2021-11-18T10:30:43.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^ description: .*' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:30:43.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: description: replaying, {"bytes_per_second":17683968.0,"bytes_per_snapshot":532342784.0,"local_snapshot_timestamp":1637231381,"remote_snapshot_timestamp":1637231381,"replay_state":"idle"} 2021-11-18T10:30:43.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:30:43.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:30:43.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep '^up+' 2021-11-18T10:30:43.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:30:43.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep 'service: *mirror..* on ' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:30:43.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: service: mirror.3 on gibba019 2021-11-18T10:30:43.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -nEe 's/^ last_update: *(.*) *$/\1/p' /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.mirror_status 2021-11-18T10:30:43.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'last_update=2021-11-18 10:30:18' 2021-11-18T10:30:43.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_mirror_pool_status_verbose cluster1 mirror test up+replaying '2021-11-18 10:30:18' 2021-11-18T10:30:43.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:30:43.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:43.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:43.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state_pattern=up+replaying 2021-11-18T10:30:43.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local 'prev_last_update=2021-11-18 10:30:18' 2021-11-18T10:30:43.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror.mirror_status 2021-11-18T10:30:43.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror.mirror_status 2021-11-18T10:30:43.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:30:43.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror.mirror_status 2021-11-18T10:30:43.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 mirror pool status mirror --verbose --format xml 2021-11-18T10:30:43.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: failed to query services: (13) Permission denied 2021-11-18T10:30:43.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local last_update state 2021-11-18T10:30:43.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/last_update' 2021-11-18T10:30:43.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ last_update='2021-11-18 10:30:18' 2021-11-18T10:30:43.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v '//images/image[name='\''test'\'']/state' 2021-11-18T10:30:43.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ state=up+replaying 2021-11-18T10:30:43.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo up+replaying 2021-11-18T10:30:43.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep up+replaying 2021-11-18T10:30:43.942 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:up+replaying 2021-11-18T10:30:43.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:30:43.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:30:43.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap10 2021-11-18T10:30:43.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap10 2021-11-18T10:30:43.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:30:43.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:30:43.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:30:43.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap10 2021-11-18T10:30:43.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap10 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:30:44.370 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.4799161510479918) > weight (0.25) 2021-11-18T10:30:44.371 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.6971451676375126) > weight (0.25) 2021-11-18T10:30:44.371 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.2963108917800852) > weight (0.25) 2021-11-18T10:30:44.371 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.7180767116353122) > weight (0.25) 2021-11-18T10:30:44.372 INFO:tasks.rbd_mirror_thrash:waiting for 98 secs before thrashing 2021-11-18T10:31:13.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:31:13.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:13.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:13.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:13.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:31:13.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:13.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:13.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:13.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:31:13.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:31:13.823 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:31:13.823 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:31:14.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:31:14.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:14.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:14.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:14.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:31:14.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:31:14.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:31:14.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:31:14.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:31:14.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:31:14.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:31:14.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:31:14.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:31:14.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:31:14.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:31:14.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:31:14.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:31:14.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:31:14.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:31:14.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:31:14.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:31:14.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:31:14.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:31:14.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:31:14.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:31:14.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:31:14.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:31:14.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:31:14.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:31:14.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:31:14.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:31:14.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:14.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:31:14.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:31:14.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:31:14.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:31:14.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:31:14.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:31:14.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:31:14.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:31:14.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:31:14.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:31:14.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:14.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:31:14.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:31:14.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:31:14.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:31:14.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:31:14.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:31:14.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:31:14.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:31:14.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:31:14.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:31:14.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:31:14.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:31:14.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:31:14.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:31:14.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:31:14.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:31:14.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:31:14.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:31:14.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:31:14.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:31:14.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:31:14.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:31:14.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:31:14.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:31:14.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:31:14.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:31:14.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:31:14.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:14.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:31:14.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:31:14.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:31:14.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:31:14.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:31:14.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:31:14.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:31:14.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:31:14.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:31:14.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:31:14.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:14.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:31:14.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:31:14.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:31:14.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:31:14.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:31:14.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:31:14.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:31:14.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:31:14.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:31:14.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:31:14.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:31:14.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:31:14.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:31:14.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:31:14.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:31:14.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:31:14.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:31:14.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:31:14.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:31:14.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:31:14.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:31:14.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:31:14.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:31:14.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:31:14.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:31:14.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:31:14.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:31:14.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:14.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:31:14.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:31:14.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:31:14.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:31:14.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:31:14.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:31:14.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:31:14.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:31:14.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:31:14.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:31:14.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:14.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:31:14.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:31:14.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:31:14.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:31:14.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:31:14.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:31:14.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:31:14.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:31:14.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:31:14.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:31:14.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:31:15.057 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:31:15.058 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:31:15.058 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:31:15.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:31:15.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:31:15.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:31:15.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:31:15.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:31:15.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:31:15.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:31:15.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:31:15.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:31:15.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:31:15.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:31:15.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:31:15.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:31:15.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:15.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:31:15.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:31:15.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:31:15.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:31:15.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:31:15.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:31:15.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:31:15.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:31:15.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:31:15.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:31:15.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:15.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:31:15.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:31:15.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:31:15.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:31:15.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:31:15.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:31:15.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:31:15.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:31:15.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:31:15.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:31:15.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:31:15.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:31:15.143 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:31:15.143 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:31:15.143 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:31:15.144 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:31:15.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:31:15.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:31:15.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:15.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-18T10:31:15.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:31:15.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:15.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:15.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:15.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = journal ']' 2021-11-18T10:31:15.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = snapshot ']' 2021-11-18T10:31:15.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-18T10:31:15.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:31:15.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:15.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:15.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:15.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster2-mirror-test.status 2021-11-18T10:31:15.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster2-mirror-test.status 2021-11-18T10:31:15.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:31:15.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:31:15.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.status 2021-11-18T10:31:15.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.status 2021-11-18T10:31:15.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:31:15.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:15.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-18T10:31:15.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:15.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:15.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:15.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-18T10:31:15.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Snapshot ID: 42 2021-11-18T10:31:15.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:31:15.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:15.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:15.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:15.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:31:15.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-18T10:31:15.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:31:15.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-18T10:31:15.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snapshot_id=42 2021-11-18T10:31:15.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:31:15.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:31:15.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.2 2021-11-18T10:31:16.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:16.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:16.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:16.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:16.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:16.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:31:16.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:31:16.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:31:16.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=38 2021-11-18T10:31:16.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 42 = 38 2021-11-18T10:31:16.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:31:16.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.4 2021-11-18T10:31:16.534 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:16.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:16.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:16.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:16.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:16.536 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:31:16.536 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:31:16.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:31:16.574 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:31:16.574 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:31:16.575 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:31:16.575 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:31:16.575 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:31:16.575 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 42 = '' 2021-11-18T10:31:16.576 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:31:16.576 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.8 2021-11-18T10:31:17.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:17.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:17.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:17.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:17.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:17.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:31:17.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:31:17.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:31:17.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:31:17.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:31:17.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:31:17.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:31:17.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:31:17.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 42 = '' 2021-11-18T10:31:17.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:31:17.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1.6 2021-11-18T10:31:19.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:19.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:19.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:19.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:19.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:19.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:31:19.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:31:19.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:31:19.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=42 2021-11-18T10:31:19.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 42 = 42 2021-11-18T10:31:19.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:19.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snap_present cluster1 mirror test snap10 2021-11-18T10:31:19.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:19.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:19.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:19.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap10 2021-11-18T10:31:19.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:31:19.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-18T10:31:19.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:31:20.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 info mirror/test@snap10 2021-11-18T10:31:20.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:31:20.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:31:20.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:31:20.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 21 2021-11-18T10:31:20.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10acfb4eccf5 2021-11-18T10:31:20.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10acfb4eccf5 2021-11-18T10:31:20.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:31:20.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock, operations, non-primary 2021-11-18T10:31:20.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: snap-trash 2021-11-18T10:31:20.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:31:20.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:31:20.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:29:46 2021 2021-11-18T10:31:20.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:31:20.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: protected: False 2021-11-18T10:31:20.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:31:20.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:31:20.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:31:20.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: false 2021-11-18T10:31:20.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:20.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snap9-clean ']' 2021-11-18T10:31:20.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap9-clean 2021-11-18T10:31:20.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:20.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:20.103 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap9-clean 2021-11-18T10:31:20.103 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:20.103 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:20.103 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:20.103 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:20.104 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap9-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:20.543 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:20.546 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap9-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:21.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:21.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:21.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:21.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:21.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap10 2021-11-18T10:31:21.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:21.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:21.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap10 2021-11-18T10:31:21.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:21.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:21.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:21.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:21.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap10 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:21.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:21.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap10 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:22.644 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:22.647 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:22.778 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:22.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:22.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ clean_snap_name=snap10-clean 2021-11-18T10:31:22.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_snap cluster2 mirror test snap10-clean 2021-11-18T10:31:22.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:22.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:22.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:22.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap10-clean 2021-11-18T10:31:22.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror snap create test@snap10-clean --debug-rbd=20 --debug-journaler=20 2021-11-18T10:31:23.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_started cluster1 mirror test 2021-11-18T10:31:23.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:23.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:23.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:23.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_replay_state cluster1 mirror test started 2021-11-18T10:31:23.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:23.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:23.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:23.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=started 2021-11-18T10:31:23.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:31:23.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:31:23.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:31:24.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_replay_state cluster1 mirror test started 2021-11-18T10:31:24.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:24.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:24.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:24.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=started 2021-11-18T10:31:24.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_result 2021-11-18T10:31:24.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=stopped 2021-11-18T10:31:24.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemons cluster1 rbd mirror status mirror/test 2021-11-18T10:31:24.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ grep -i state 2021-11-18T10:31:24.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_instance=cluster1 2021-11-18T10:31:24.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:31:24.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:31:24.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance=cluster1 2021-11-18T10:31:24.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local loop_instance 2021-11-18T10:31:24.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for s in 0 1 2 4 8 8 8 8 8 8 8 8 16 16 2021-11-18T10:31:24.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sleep 0 2021-11-18T10:31:24.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' cluster1 '!=' cluster1 ']' 2021-11-18T10:31:24.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ seq 0 3 2021-11-18T10:31:24.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:31:24.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:0 rbd mirror status mirror/test 2021-11-18T10:31:24.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:0 2021-11-18T10:31:24.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:31:24.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:31:24.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:0 cluster instance 2021-11-18T10:31:24.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:0 2021-11-18T10:31:24.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:31:24.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:31:24.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:31:24.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=0 2021-11-18T10:31:24.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 0 = cluster1:0 ']' 2021-11-18T10:31:24.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:31:24.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:24.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=0 2021-11-18T10:31:24.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:31:24.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:0 cluster1 2021-11-18T10:31:24.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:0 2021-11-18T10:31:24.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:31:24.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:31:24.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:0 local_cluster instance 2021-11-18T10:31:24.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:0 2021-11-18T10:31:24.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:31:24.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:31:24.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:24.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=0 2021-11-18T10:31:24.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 0 = cluster1:0 ']' 2021-11-18T10:31:24.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:31:24.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:31:24.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=0 2021-11-18T10:31:24.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=0 2021-11-18T10:31:24.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.0 'admin socket' 2021-11-18T10:31:24.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:31:24.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:31:24.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok 2021-11-18T10:31:24.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.0.asok rbd mirror status mirror/test 2021-11-18T10:31:24.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:31:24.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:31:24.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:31:24.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:31:24.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:1 rbd mirror status mirror/test 2021-11-18T10:31:24.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:1 2021-11-18T10:31:24.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:31:24.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:31:24.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:1 cluster instance 2021-11-18T10:31:24.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:1 2021-11-18T10:31:24.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:31:24.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:31:24.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:31:24.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=1 2021-11-18T10:31:24.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 1 = cluster1:1 ']' 2021-11-18T10:31:24.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:31:24.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:24.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=1 2021-11-18T10:31:24.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:31:24.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:1 cluster1 2021-11-18T10:31:24.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:1 2021-11-18T10:31:24.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:31:24.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:31:24.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:1 local_cluster instance 2021-11-18T10:31:24.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:1 2021-11-18T10:31:24.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:31:24.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:31:24.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:24.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=1 2021-11-18T10:31:24.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 1 = cluster1:1 ']' 2021-11-18T10:31:24.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:31:24.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:31:24.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=1 2021-11-18T10:31:24.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=1 2021-11-18T10:31:24.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.1 'admin socket' 2021-11-18T10:31:24.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:31:24.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:31:24.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok 2021-11-18T10:31:24.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.1.asok rbd mirror status mirror/test 2021-11-18T10:31:24.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:31:24.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:31:24.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:31:24.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:31:24.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:2 rbd mirror status mirror/test 2021-11-18T10:31:24.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:2 2021-11-18T10:31:24.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:31:24.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:31:24.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:2 cluster instance 2021-11-18T10:31:25.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:2 2021-11-18T10:31:25.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:31:25.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:31:25.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:31:25.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=2 2021-11-18T10:31:25.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 2 = cluster1:2 ']' 2021-11-18T10:31:25.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:31:25.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:25.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=2 2021-11-18T10:31:25.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:31:25.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:2 cluster1 2021-11-18T10:31:25.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:2 2021-11-18T10:31:25.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:31:25.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:31:25.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:2 local_cluster instance 2021-11-18T10:31:25.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:2 2021-11-18T10:31:25.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:31:25.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:31:25.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:25.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=2 2021-11-18T10:31:25.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 2 = cluster1:2 ']' 2021-11-18T10:31:25.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:31:25.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:31:25.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=2 2021-11-18T10:31:25.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=2 2021-11-18T10:31:25.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.2 'admin socket' 2021-11-18T10:31:25.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:31:25.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:31:25.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok 2021-11-18T10:31:25.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.2.asok rbd mirror status mirror/test 2021-11-18T10:31:25.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Invalid command: unused arguments: ['mirror/test'] 2021-11-18T10:31:25.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd mirror status : get status for rbd mirror 2021-11-18T10:31:25.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:admin_socket: invalid command 2021-11-18T10:31:25.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for loop_instance in `seq 0 ${LAST_MIRROR_INSTANCE}` 2021-11-18T10:31:25.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ admin_daemon cluster1:3 rbd mirror status mirror/test 2021-11-18T10:31:25.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1:3 2021-11-18T10:31:25.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ shift 2021-11-18T10:31:25.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance 2021-11-18T10:31:25.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set_cluster_instance cluster1:3 cluster instance 2021-11-18T10:31:25.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local val=cluster1:3 2021-11-18T10:31:25.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster_var_name=cluster 2021-11-18T10:31:25.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local instance_var_name=instance 2021-11-18T10:31:25.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cluster=cluster1 2021-11-18T10:31:25.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ instance=3 2021-11-18T10:31:25.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 3 = cluster1:3 ']' 2021-11-18T10:31:25.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval cluster=cluster1 2021-11-18T10:31:25.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:25.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ eval instance=3 2021-11-18T10:31:25.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:31:25.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ daemon_asok_file cluster1:3 cluster1 2021-11-18T10:31:25.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local local_cluster=cluster1:3 2021-11-18T10:31:25.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster=cluster1 2021-11-18T10:31:25.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance 2021-11-18T10:31:25.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ set_cluster_instance cluster1:3 local_cluster instance 2021-11-18T10:31:25.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local val=cluster1:3 2021-11-18T10:31:25.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local cluster_var_name=local_cluster 2021-11-18T10:31:25.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ local instance_var_name=instance 2021-11-18T10:31:25.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ cluster=cluster1 2021-11-18T10:31:25.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ instance=3 2021-11-18T10:31:25.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ '[' 3 = cluster1:3 ']' 2021-11-18T10:31:25.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval local_cluster=cluster1 2021-11-18T10:31:25.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ local_cluster=cluster1 2021-11-18T10:31:25.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ eval instance=3 2021-11-18T10:31:25.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ instance=3 2021-11-18T10:31:25.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++++ ceph-conf --cluster cluster1 --name client.mirror.3 'admin socket' 2021-11-18T10:31:25.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ echo /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:31:25.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local asok_file=/var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:31:25.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ test -S /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok 2021-11-18T10:31:25.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --admin-daemon /var/run/ceph/rbd-mirror.cluster1-client.mirror.3.asok rbd mirror status mirror/test 2021-11-18T10:31:25.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ return 0 2021-11-18T10:31:25.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ status_result=' "state": "Replaying"' 2021-11-18T10:31:25.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo ' "state": "Replaying"' 2021-11-18T10:31:25.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ grep -i Replaying 2021-11-18T10:31:25.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: "state": "Replaying" 2021-11-18T10:31:25.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=started 2021-11-18T10:31:25.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test started = started 2021-11-18T10:31:25.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:25.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_replay_complete cluster1 cluster2 mirror test 2021-11-18T10:31:25.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:31:25.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:25.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:25.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:25.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = journal ']' 2021-11-18T10:31:25.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' snapshot = snapshot ']' 2021-11-18T10:31:25.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snapshot_sync_complete cluster1 cluster2 mirror test 2021-11-18T10:31:25.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_cluster=cluster1 2021-11-18T10:31:25.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:25.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:25.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:25.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster2-mirror-test.status 2021-11-18T10:31:25.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster2-mirror-test.status 2021-11-18T10:31:25.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:31:25.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local status_log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:31:25.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ mkfname cluster1-mirror-test.status 2021-11-18T10:31:25.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo cluster1-mirror-test.status 2021-11-18T10:31:25.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -e 's|[/ ]|_|g' 2021-11-18T10:31:25.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local local_status_log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:25.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ mirror_image_snapshot cluster2 mirror test 2021-11-18T10:31:25.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:25.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:25.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:25.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 mirror image snapshot mirror/test 2021-11-18T10:31:25.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Snapshot ID: 45 2021-11-18T10:31:25.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster2 mirror test /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:31:25.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:25.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:25.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:25.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.status 2021-11-18T10:31:25.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap list --all mirror/test --format xml 2021-11-18T10:31:25.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:31:25.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/id 2021-11-18T10:31:25.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snapshot_id=45 2021-11-18T10:31:25.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:31:25.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:31:25.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.2 2021-11-18T10:31:26.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:26.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:26.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:26.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:26.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:26.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:31:26.091 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:31:26.133 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:31:26.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=42 2021-11-18T10:31:26.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 45 = 42 2021-11-18T10:31:26.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:31:26.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.4 2021-11-18T10:31:26.536 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:26.537 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:26.537 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:26.538 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:26.538 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:26.538 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:31:26.538 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:31:26.577 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ true 2021-11-18T10:31:26.577 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:31:26.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:-:1.1: Document is empty 2021-11-18T10:31:26.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: 2021-11-18T10:31:26.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:^ 2021-11-18T10:31:26.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id= 2021-11-18T10:31:26.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 45 = '' 2021-11-18T10:31:26.581 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.2 0.4 0.8 1.6 2 2 4 4 8 8 16 16 32 32 2021-11-18T10:31:26.581 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.8 2021-11-18T10:31:27.379 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ get_newest_mirror_snapshot cluster1 mirror test /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:27.379 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:27.379 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:27.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:27.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local log=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.status 2021-11-18T10:31:27.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 snap list --all mirror/test --format xml 2021-11-18T10:31:27.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ xmlstarlet sel -t -c '//snapshots/snapshot[namespace/complete='\''true'\'' and position()=last()]' 2021-11-18T10:31:27.418 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ xmlstarlet sel -t -v //snapshot/namespace/primary_snap_id 2021-11-18T10:31:27.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local primary_snapshot_id=45 2021-11-18T10:31:27.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test 45 = 45 2021-11-18T10:31:27.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:27.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_snap_present cluster1 mirror test snap10-clean 2021-11-18T10:31:27.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:31:27.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:27.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:27.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap10-clean 2021-11-18T10:31:27.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:31:27.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 1 2 4 8 8 8 8 8 8 8 8 16 16 16 16 32 32 32 32 2021-11-18T10:31:27.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:31:28.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 info mirror/test@snap10-clean 2021-11-18T10:31:28.454 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'test': 2021-11-18T10:31:28.455 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 512 MiB in 128 objects 2021-11-18T10:31:28.455 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:31:28.455 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 21 2021-11-18T10:31:28.456 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 10acfb4eccf5 2021-11-18T10:31:28.456 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.10acfb4eccf5 2021-11-18T10:31:28.456 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:31:28.457 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock, non-primary 2021-11-18T10:31:28.457 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:31:28.457 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:31:28.457 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:31:28.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:31:20 2021 2021-11-18T10:31:28.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:22:50 2021 2021-11-18T10:31:28.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: protected: False 2021-11-18T10:31:28.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:31:28.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:31:28.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 042930fc-34fb-4dc4-885a-67b1a7f96e9d 2021-11-18T10:31:28.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: false 2021-11-18T10:31:28.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:28.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ seq 1 10 2021-11-18T10:31:28.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:28.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap1 2021-11-18T10:31:28.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap1 2021-11-18T10:31:28.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:28.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:28.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap1 2021-11-18T10:31:28.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:28.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:28.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:28.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:28.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap1 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:28.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:28.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap1 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:29.484 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:29.487 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:29.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:29.716 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:29.716 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap1-clean 2021-11-18T10:31:29.716 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap1-clean 2021-11-18T10:31:29.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:29.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:29.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap1-clean 2021-11-18T10:31:29.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:29.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:29.718 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:29.718 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:29.718 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap1-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:30.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:30.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap1-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:30.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:30.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:30.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:31.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:31.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:31.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap2 2021-11-18T10:31:31.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap2 2021-11-18T10:31:31.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:31.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:31.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap2 2021-11-18T10:31:31.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:31.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:31.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:31.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:31.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap2 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:31.548 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:31.551 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap2 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:32.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:32.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:32.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:32.313 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:32.313 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap2-clean 2021-11-18T10:31:32.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap2-clean 2021-11-18T10:31:32.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:32.315 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:32.315 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap2-clean 2021-11-18T10:31:32.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:32.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:32.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:32.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:32.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap2-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:32.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:32.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap2-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:33.439 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:33.441 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:33.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:33.667 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:33.667 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:33.668 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap3 2021-11-18T10:31:33.668 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap3 2021-11-18T10:31:33.668 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:33.668 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:33.669 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap3 2021-11-18T10:31:33.669 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:33.669 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:33.669 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:33.669 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:33.670 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap3 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:34.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:34.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap3 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:34.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:34.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:34.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:35.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:35.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap3-clean 2021-11-18T10:31:35.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap3-clean 2021-11-18T10:31:35.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:35.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:35.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap3-clean 2021-11-18T10:31:35.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:35.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:35.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:35.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:35.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap3-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:35.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:35.495 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap3-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:36.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:36.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:36.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:36.356 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:36.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:36.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap4 2021-11-18T10:31:36.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap4 2021-11-18T10:31:36.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:36.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:36.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap4 2021-11-18T10:31:36.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:36.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:36.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:36.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:36.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap4 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:36.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:36.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap4 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:37.481 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:37.487 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:37.614 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:37.710 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:37.711 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap4-clean 2021-11-18T10:31:37.711 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap4-clean 2021-11-18T10:31:37.711 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:37.711 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:37.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap4-clean 2021-11-18T10:31:37.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:37.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:37.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:37.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:37.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap4-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:38.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:38.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap4-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:38.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:38.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:38.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:39.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:39.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:39.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap5 2021-11-18T10:31:39.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap5 2021-11-18T10:31:39.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:39.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:39.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap5 2021-11-18T10:31:39.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:39.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:39.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:39.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:39.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap5 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:39.519 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:39.522 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap5 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:40.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:40.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:40.292 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:40.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:40.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap5-clean 2021-11-18T10:31:40.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap5-clean 2021-11-18T10:31:40.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:40.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:40.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap5-clean 2021-11-18T10:31:40.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:40.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:40.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:40.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:40.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap5-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:40.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:40.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap5-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:41.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:41.383 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:41.513 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:41.610 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:41.610 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:41.610 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap6 2021-11-18T10:31:41.610 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap6 2021-11-18T10:31:41.611 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:41.611 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:41.611 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap6 2021-11-18T10:31:41.611 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:41.612 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:41.612 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:41.612 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:41.612 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap6 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:42.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:42.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap6 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:42.672 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:42.675 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:42.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:42.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:42.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap6-clean 2021-11-18T10:31:42.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap6-clean 2021-11-18T10:31:42.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:42.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:42.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap6-clean 2021-11-18T10:31:42.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:42.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:42.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:42.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:42.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap6-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:43.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:43.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap6-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:43.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:43.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:44.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:44.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:44.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:44.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap7 2021-11-18T10:31:44.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap7 2021-11-18T10:31:44.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:44.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:44.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap7 2021-11-18T10:31:44.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:44.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:44.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:44.196 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:44.196 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap7 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:44.654 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:44.657 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap7 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:45.303 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:45.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:45.436 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:45.531 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:45.531 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap7-clean 2021-11-18T10:31:45.532 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap7-clean 2021-11-18T10:31:45.532 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:45.532 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:45.532 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap7-clean 2021-11-18T10:31:45.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:45.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:45.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:45.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:45.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap7-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:45.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:45.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap7-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:46.549 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:46.552 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:46.684 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:46.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:46.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:46.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap8 2021-11-18T10:31:46.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap8 2021-11-18T10:31:46.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:46.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:46.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap8 2021-11-18T10:31:46.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:46.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:46.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:46.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:46.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap8 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:47.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:47.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap8 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:47.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:47.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:47.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:48.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:48.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap8-clean 2021-11-18T10:31:48.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap8-clean 2021-11-18T10:31:48.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:48.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:48.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap8-clean 2021-11-18T10:31:48.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:48.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:48.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:48.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:48.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap8-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:48.523 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:48.526 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap8-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:49.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:49.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:49.286 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:49.383 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:49.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:49.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap9 2021-11-18T10:31:49.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap9 2021-11-18T10:31:49.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:49.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:49.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap9 2021-11-18T10:31:49.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:49.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:49.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:49.386 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:49.386 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap9 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:49.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:49.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap9 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:50.483 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2021-11-18T10:31:50.484 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2021-11-18T10:31:50.484 INFO:tasks.rbd_mirror_thrash:waiting for 0 secs before reviving daemons 2021-11-18T10:31:50.485 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2021-11-18T10:31:50.485 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:31:50.486 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba019.stderr:2021-11-18T10:31:50.487+0000 7fbdba85f700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 45183) UID: 1000 2021-11-18T10:31:50.542 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:50.545 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:50.679 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:50.685 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:31:50.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:50.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap9-clean 2021-11-18T10:31:50.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap9-clean 2021-11-18T10:31:50.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:50.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:50.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap9-clean 2021-11-18T10:31:50.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:50.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:50.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:50.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:50.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap9-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:51.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:51.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap9-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:51.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:51.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:52.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:52.111 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:52.112 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:52.112 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap10 2021-11-18T10:31:52.113 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap10 2021-11-18T10:31:52.113 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:52.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:52.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap10 2021-11-18T10:31:52.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:52.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:52.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:52.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:52.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap10 /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:52.585 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:52.588 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap10 /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:53.191 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:53.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:53.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:53.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:53.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap10-clean 2021-11-18T10:31:53.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ compare_image_snaps mirror test snap10-clean 2021-11-18T10:31:53.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:53.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:53.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap_name=snap10-clean 2021-11-18T10:31:53.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local ret=0 2021-11-18T10:31:53.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local rmt_export=/tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:53.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local loc_export=/tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:53.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:53.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 -p mirror export test@snap10-clean /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export 2021-11-18T10:31:53.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:53.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster1 -p mirror export test@snap10-clean /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:54.528 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Exporting image: 1% complete... Exporting image: 2% complete... Exporting image: 3% complete... Exporting image: 4% complete... Exporting image: 5% complete... Exporting image: 6% complete... Exporting image: 7% complete... Exporting image: 8% complete... Exporting image: 9% complete... Exporting image: 10% complete... Exporting image: 11% complete... Exporting image: 12% complete... Exporting image: 13% complete... Exporting image: 14% complete... Exporting image: 15% complete... Exporting image: 16% complete... Exporting image: 17% complete... Exporting image: 18% complete... Exporting image: 19% complete... Exporting image: 20% complete... Exporting image: 21% complete... Exporting image: 22% complete... Exporting image: 23% complete... Exporting image: 24% complete... Exporting image: 25% complete... Exporting image: 26% complete... Exporting image: 27% complete... Exporting image: 28% complete... Exporting image: 29% complete... Exporting image: 30% complete... Exporting image: 31% complete... Exporting image: 32% complete... Exporting image: 33% complete... Exporting image: 34% complete... Exporting image: 35% complete... Exporting image: 36% complete... Exporting image: 37% complete... Exporting image: 38% complete... Exporting image: 39% complete... Exporting image: 40% complete... Exporting image: 41% complete... Exporting image: 42% complete... Exporting image: 43% complete... Exporting image: 44% complete... Exporting image: 45% complete... Exporting image: 46% complete... Exporting image: 47% complete... Exporting image: 48% complete... Exporting image: 49% complete... Exporting image: 50% complete... Exporting image: 51% complete... Exporting image: 52% complete... Exporting image: 53% complete... Exporting image: 54% complete... Exporting image: 55% complete... Exporting image: 56% complete... Exporting image: 57% complete... Exporting image: 58% complete... Exporting image: 59% complete... Exporting image: 60% complete... Exporting image: 61% complete... Exporting image: 62% complete... Exporting image: 63% complete... Exporting image: 64% complete... Exporting image: 65% complete... Exporting image: 66% complete... Exporting image: 67% complete... Exporting image: 68% complete... Exporting image: 69% complete... Exporting image: 70% complete... Exporting image: 71% complete... Exporting image: 72% complete... Exporting image: 73% complete... Exporting image: 74% complete... Exporting image: 75% complete... Exporting image: 76% complete... Exporting image: 77% complete... Exporting image: 78% complete... Exporting image: 79% complete... Exporting image: 80% complete... Exporting image: 81% complete... Exporting image: 82% complete... Exporting image: 83% complete... Exporting image: 84% complete... Exporting image: 85% complete... Exporting image: 86% complete... Exporting image: 87% complete... Exporting image: 88% complete... Exporting image: 89% complete... Exporting image: 90% complete... Exporting image: 91% complete... Exporting image: 92% complete... Exporting image: 93% complete... Exporting image: 94% complete... Exporting image: 95% complete... Exporting image: 96% complete... Exporting image: 97% complete... Exporting image: 98% complete... Exporting image: 99% complete... Exporting image: 100% complete...done. 2021-11-18T10:31:54.531 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ cmp /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:54.665 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rm -f /tmp/tmp.S6ytW1uNG1/cluster2-mirror-test.export /tmp/tmp.S6ytW1uNG1/cluster1-mirror-test.export 2021-11-18T10:31:54.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:31:54.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ seq 1 10 2021-11-18T10:31:54.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:54.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap1 2021-11-18T10:31:54.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap1 2021-11-18T10:31:54.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:54.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:54.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:54.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap1 2021-11-18T10:31:54.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap1 2021-11-18T10:31:54.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:31:54.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap1-clean 2021-11-18T10:31:54.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap1-clean 2021-11-18T10:31:54.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:54.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:54.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:54.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap1-clean 2021-11-18T10:31:54.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap1-clean 2021-11-18T10:31:55.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:31:55.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:55.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap2 2021-11-18T10:31:55.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap2 2021-11-18T10:31:55.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:55.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:55.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:55.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap2 2021-11-18T10:31:55.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap2 2021-11-18T10:31:56.586 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:31:56.587 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2021-11-18T10:31:56.587 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2021-11-18T10:31:56.588 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2021-11-18T10:31:56.591 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2021-11-18T10:31:56.591 INFO:tasks.rbd_mirror_thrash:waiting for 95 secs before thrashing 2021-11-18T10:31:56.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:31:56.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap2-clean 2021-11-18T10:31:56.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap2-clean 2021-11-18T10:31:56.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:56.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:56.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:56.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap2-clean 2021-11-18T10:31:56.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap2-clean 2021-11-18T10:31:57.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:31:57.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:57.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap3 2021-11-18T10:31:57.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap3 2021-11-18T10:31:57.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:57.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:57.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:57.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap3 2021-11-18T10:31:57.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap3 2021-11-18T10:31:58.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:31:58.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap3-clean 2021-11-18T10:31:58.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap3-clean 2021-11-18T10:31:58.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:58.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:58.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:58.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap3-clean 2021-11-18T10:31:58.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap3-clean 2021-11-18T10:31:59.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:31:59.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:31:59.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap4 2021-11-18T10:31:59.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap4 2021-11-18T10:31:59.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:31:59.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:31:59.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:31:59.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap4 2021-11-18T10:31:59.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap4 2021-11-18T10:32:00.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:00.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap4-clean 2021-11-18T10:32:00.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap4-clean 2021-11-18T10:32:00.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:00.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:00.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:00.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap4-clean 2021-11-18T10:32:00.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap4-clean 2021-11-18T10:32:01.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:01.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:32:01.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap5 2021-11-18T10:32:01.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap5 2021-11-18T10:32:01.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:01.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:01.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:01.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap5 2021-11-18T10:32:01.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap5 2021-11-18T10:32:02.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:02.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap5-clean 2021-11-18T10:32:02.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap5-clean 2021-11-18T10:32:02.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:02.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:02.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:02.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap5-clean 2021-11-18T10:32:02.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap5-clean 2021-11-18T10:32:03.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:03.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:32:03.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap6 2021-11-18T10:32:03.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap6 2021-11-18T10:32:03.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:03.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:03.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:03.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap6 2021-11-18T10:32:03.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap6 2021-11-18T10:32:04.790 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:04.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap6-clean 2021-11-18T10:32:04.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap6-clean 2021-11-18T10:32:04.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:04.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:04.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:04.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap6-clean 2021-11-18T10:32:04.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap6-clean 2021-11-18T10:32:05.794 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:05.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:32:05.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap7 2021-11-18T10:32:05.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap7 2021-11-18T10:32:05.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:05.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:05.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:05.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap7 2021-11-18T10:32:05.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap7 2021-11-18T10:32:06.794 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:06.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap7-clean 2021-11-18T10:32:06.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap7-clean 2021-11-18T10:32:06.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:06.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:06.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:06.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap7-clean 2021-11-18T10:32:06.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap7-clean 2021-11-18T10:32:07.800 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:07.813 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:32:07.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap8 2021-11-18T10:32:07.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap8 2021-11-18T10:32:07.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:07.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:07.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:07.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap8 2021-11-18T10:32:07.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap8 2021-11-18T10:32:08.802 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:08.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap8-clean 2021-11-18T10:32:08.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap8-clean 2021-11-18T10:32:08.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:08.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:08.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:08.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap8-clean 2021-11-18T10:32:08.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap8-clean 2021-11-18T10:32:09.802 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:09.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:32:09.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap9 2021-11-18T10:32:09.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap9 2021-11-18T10:32:09.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:09.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:09.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:09.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap9 2021-11-18T10:32:09.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap9 2021-11-18T10:32:10.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:10.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap9-clean 2021-11-18T10:32:10.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap9-clean 2021-11-18T10:32:10.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:10.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:10.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:10.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap9-clean 2021-11-18T10:32:10.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap9-clean 2021-11-18T10:32:11.813 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:11.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 10` 2021-11-18T10:32:11.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap10 2021-11-18T10:32:11.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap10 2021-11-18T10:32:11.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:11.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:11.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:11.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap10 2021-11-18T10:32:11.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap10 2021-11-18T10:32:12.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:12.824 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap10-clean 2021-11-18T10:32:12.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_snapshot cluster2 mirror test snap10-clean 2021-11-18T10:32:12.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:12.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:12.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:12.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local snap=snap10-clean 2021-11-18T10:32:12.826 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 snap rm mirror/test@snap10-clean 2021-11-18T10:32:13.789 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing snap: 100% complete...done. 2021-11-18T10:32:13.801 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_image_retry cluster2 mirror test 2021-11-18T10:32:13.801 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:13.802 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:13.802 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:13.802 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0 1 2 4 8 16 32 2021-11-18T10:32:13.802 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0 2021-11-18T10:32:13.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ remove_image cluster2 mirror test 2021-11-18T10:32:13.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:13.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:13.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:13.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 snap purge mirror/test 2021-11-18T10:32:13.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 rm mirror/test 2021-11-18T10:32:15.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr: Removing image: 1% complete... Removing image: 2% complete... Removing image: 3% complete... Removing image: 4% complete... Removing image: 5% complete... Removing image: 6% complete... Removing image: 7% complete... Removing image: 8% complete... Removing image: 9% complete... Removing image: 10% complete... Removing image: 11% complete... Removing image: 12% complete... Removing image: 13% complete... Removing image: 14% complete... Removing image: 15% complete... Removing image: 16% complete... Removing image: 17% complete... Removing image: 18% complete... Removing image: 19% complete... Removing image: 20% complete... Removing image: 21% complete... Removing image: 22% complete... Removing image: 23% complete... Removing image: 24% complete... Removing image: 25% complete... Removing image: 26% complete... Removing image: 27% complete... Removing image: 28% complete... Removing image: 29% complete... Removing image: 30% complete... Removing image: 31% complete... Removing image: 32% complete... Removing image: 33% complete... Removing image: 34% complete... Removing image: 35% complete... Removing image: 36% complete... Removing image: 37% complete... Removing image: 38% complete... Removing image: 39% complete... Removing image: 40% complete... Removing image: 41% complete... Removing image: 42% complete... Removing image: 43% complete... Removing image: 44% complete... Removing image: 45% complete... Removing image: 46% complete... Removing image: 47% complete... Removing image: 48% complete... Removing image: 49% complete... Removing image: 50% complete... Removing image: 51% complete... Removing image: 52% complete... Removing image: 53% complete... Removing image: 54% complete... Removing image: 55% complete... Removing image: 56% complete... Removing image: 57% complete... Removing image: 58% complete... Removing image: 59% complete... Removing image: 60% complete... Removing image: 61% complete... Removing image: 62% complete... Removing image: 63% complete... Removing image: 64% complete... Removing image: 65% complete... Removing image: 66% complete... Removing image: 67% complete... Removing image: 68% complete... Removing image: 69% complete... Removing image: 70% complete... Removing image: 71% complete... Removing image: 72% complete... Removing image: 73% complete... Removing image: 74% complete... Removing image: 75% complete... Removing image: 76% complete... Removing image: 77% complete... Removing image: 78% complete... Removing image: 79% complete... Removing image: 80% complete... Removing image: 81% complete... Removing image: 82% complete... Removing image: 83% complete... Removing image: 84% complete... Removing image: 85% complete... Removing image: 86% complete... Removing image: 87% complete... Removing image: 88% complete... Removing image: 89% complete... Removing image: 90% complete... Removing image: 91% complete... Removing image: 92% complete... Removing image: 93% complete... Removing image: 94% complete... Removing image: 95% complete... Removing image: 96% complete... Removing image: 97% complete... Removing image: 98% complete... Removing image: 99% complete... Removing image: 100% complete...done. 2021-11-18T10:32:15.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:32:15.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ wait_for_image_present cluster1 mirror test deleted 2021-11-18T10:32:15.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:32:15.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:15.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:15.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local state=deleted 2021-11-18T10:32:15.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image_id= 2021-11-18T10:32:15.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local s 2021-11-18T10:32:15.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n '' 2021-11-18T10:32:15.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ get_image_id cluster1 mirror test 2021-11-18T10:32:15.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:32:15.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local pool=mirror 2021-11-18T10:32:15.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local image=test 2021-11-18T10:32:15.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ rbd --cluster=cluster1 info mirror/test 2021-11-18T10:32:15.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -ne 's/^.*block_name_prefix: rbd_data\.//p' 2021-11-18T10:32:15.113 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image_id=10acfb4eccf5 2021-11-18T10:32:15.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.1 1 2 4 8 8 8 8 8 8 8 8 16 16 32 32 2021-11-18T10:32:15.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 0.1 2021-11-18T10:32:15.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_present cluster1 mirror test deleted 10acfb4eccf5 2021-11-18T10:32:15.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:32:15.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:15.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:15.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=deleted 2021-11-18T10:32:15.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image_id=10acfb4eccf5 2021-11-18T10:32:15.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=deleted 2021-11-18T10:32:15.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_image_id 2021-11-18T10:32:15.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ get_image_id cluster1 mirror test 2021-11-18T10:32:15.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:32:15.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local pool=mirror 2021-11-18T10:32:15.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local image=test 2021-11-18T10:32:15.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ rbd --cluster=cluster1 info mirror/test 2021-11-18T10:32:15.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -ne 's/^.*block_name_prefix: rbd_data\.//p' 2021-11-18T10:32:15.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_image_id=10acfb4eccf5 2021-11-18T10:32:15.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n 10acfb4eccf5 2021-11-18T10:32:15.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -z 10acfb4eccf5 -o 10acfb4eccf5 = 10acfb4eccf5 2021-11-18T10:32:15.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=present 2021-11-18T10:32:15.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test deleted = present 2021-11-18T10:32:15.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.1 1 2 4 8 8 8 8 8 8 8 8 16 16 32 32 2021-11-18T10:32:15.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 1 2021-11-18T10:32:16.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_present cluster1 mirror test deleted 10acfb4eccf5 2021-11-18T10:32:16.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:32:16.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:16.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:16.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=deleted 2021-11-18T10:32:16.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image_id=10acfb4eccf5 2021-11-18T10:32:16.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=deleted 2021-11-18T10:32:16.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_image_id 2021-11-18T10:32:16.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ get_image_id cluster1 mirror test 2021-11-18T10:32:16.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:32:16.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local pool=mirror 2021-11-18T10:32:16.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local image=test 2021-11-18T10:32:16.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ rbd --cluster=cluster1 info mirror/test 2021-11-18T10:32:16.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -ne 's/^.*block_name_prefix: rbd_data\.//p' 2021-11-18T10:32:16.294 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_image_id=10acfb4eccf5 2021-11-18T10:32:16.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n 10acfb4eccf5 2021-11-18T10:32:16.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -z 10acfb4eccf5 -o 10acfb4eccf5 = 10acfb4eccf5 2021-11-18T10:32:16.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_state=present 2021-11-18T10:32:16.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test deleted = present 2021-11-18T10:32:16.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for s in 0.1 1 2 4 8 8 8 8 8 8 8 8 16 16 32 32 2021-11-18T10:32:16.296 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ sleep 2 2021-11-18T10:32:18.296 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test_image_present cluster1 mirror test deleted 10acfb4eccf5 2021-11-18T10:32:18.297 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster1 2021-11-18T10:32:18.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:18.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=test 2021-11-18T10:32:18.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local test_state=deleted 2021-11-18T10:32:18.299 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image_id=10acfb4eccf5 2021-11-18T10:32:18.299 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_state=deleted 2021-11-18T10:32:18.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local current_image_id 2021-11-18T10:32:18.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ get_image_id cluster1 mirror test 2021-11-18T10:32:18.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster=cluster1 2021-11-18T10:32:18.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local pool=mirror 2021-11-18T10:32:18.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local image=test 2021-11-18T10:32:18.302 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ rbd --cluster=cluster1 info mirror/test 2021-11-18T10:32:18.302 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ sed -ne 's/^.*block_name_prefix: rbd_data\.//p' 2021-11-18T10:32:18.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: error opening image test: (2) No such file or directory 2021-11-18T10:32:18.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ current_image_id= 2021-11-18T10:32:18.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test -n '' 2021-11-18T10:32:18.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ test deleted = deleted 2021-11-18T10:32:18.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:32:18.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ testlog 'TEST: create many images' 2021-11-18T10:32:18.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ tee -a /tmp/tmp.S6ytW1uNG1/rbd-mirror.test.log 2021-11-18T10:32:18.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ date '+%F %T' 2021-11-18T10:32:18.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ echo 2021-11-18 10:32:18 TEST: create many images 2021-11-18T10:32:18.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18 10:32:18 TEST: create many images 2021-11-18T10:32:18.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ snap_name=snap 2021-11-18T10:32:18.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ seq 1 50 2021-11-18T10:32:18.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:32:18.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_1 2021-11-18T10:32:18.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_1 snapshot 128M 2021-11-18T10:32:18.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:18.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:18.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:18.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:18.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_1 2021-11-18T10:32:18.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:18.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:32:18.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:32:18.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:18.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_1 128M 2021-11-18T10:32:18.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:18.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:18.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:18.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:18.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_1 2021-11-18T10:32:18.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:18.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:32:18.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:32:18.332 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:32:18.332 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:18.332 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_1 2021-11-18T10:32:18.375 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:32:18.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_1 snapshot 2021-11-18T10:32:18.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:18.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:18.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_1 2021-11-18T10:32:18.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:32:18.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_1 snapshot 2021-11-18T10:32:18.846 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:32:18.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_1 2021-11-18T10:32:18.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_1': 2021-11-18T10:32:18.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:32:18.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:32:18.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:32:18.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 1286165b8d81 2021-11-18T10:32:18.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.1286165b8d81 2021-11-18T10:32:18.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:32:18.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:32:18.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:32:18.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:32:18.888 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:32:18 2021 2021-11-18T10:32:18.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:32:18 2021 2021-11-18T10:32:18.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:32:18 2021 2021-11-18T10:32:18.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:32:18.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:32:18.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 594323f5-296d-4da8-afa5-582228239ebd 2021-11-18T10:32:18.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:32:18.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:32:18.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_1 2021-11-18T10:32:18.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:18.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:18.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_1 2021-11-18T10:32:18.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:32:18.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=7 2021-11-18T10:32:18.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:32:18.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 7s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_1 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:32:19.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 62136320 bytes 2021-11-18T10:32:19.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 110021632 bytes 2021-11-18T10:32:19.381 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 128798720 bytes 2021-11-18T10:32:19.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 179795968 bytes 2021-11-18T10:32:19.673 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 223404032 bytes 2021-11-18T10:32:19.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 292973568 bytes 2021-11-18T10:32:19.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 325662720 bytes 2021-11-18T10:32:20.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 332499968 bytes 2021-11-18T10:32:20.265 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 423750656 bytes 2021-11-18T10:32:20.403 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 458664960 bytes 2021-11-18T10:32:20.545 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 488952832 bytes 2021-11-18T10:32:20.667 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 518969344 bytes 2021-11-18T10:32:20.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 551593984 bytes 2021-11-18T10:32:20.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 583690240 bytes 2021-11-18T10:32:21.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 627358720 bytes 2021-11-18T10:32:21.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 665592832 bytes 2021-11-18T10:32:21.386 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 698777600 bytes 2021-11-18T10:32:21.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 720504832 bytes 2021-11-18T10:32:21.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 782273536 bytes 2021-11-18T10:32:21.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 833723392 bytes 2021-11-18T10:32:21.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 856176640 bytes 2021-11-18T10:32:22.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 865021952 bytes 2021-11-18T10:32:22.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 917655552 bytes 2021-11-18T10:32:22.373 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.5584001681419594) > weight (0.25) 2021-11-18T10:32:22.373 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.9861190668881327) > weight (0.25) 2021-11-18T10:32:22.374 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.3557252992747493) > weight (0.25) 2021-11-18T10:32:22.374 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.7777008657308427) > weight (0.25) 2021-11-18T10:32:22.374 INFO:tasks.rbd_mirror_thrash:waiting for 114 secs before thrashing 2021-11-18T10:32:22.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 992349184 bytes 2021-11-18T10:32:22.600 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1053158400 bytes 2021-11-18T10:32:22.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1142309888 bytes 2021-11-18T10:32:22.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1160970240 bytes 2021-11-18T10:32:23.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1161586688 bytes 2021-11-18T10:32:23.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1194744832 bytes 2021-11-18T10:32:23.292 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1213148160 bytes 2021-11-18T10:32:23.444 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1256383488 bytes 2021-11-18T10:32:23.587 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1281763328 bytes 2021-11-18T10:32:23.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1331953664 bytes 2021-11-18T10:32:23.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1425537024 bytes 2021-11-18T10:32:24.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1442229248 bytes 2021-11-18T10:32:24.220 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1503488000 bytes 2021-11-18T10:32:24.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1556699136 bytes 2021-11-18T10:32:24.539 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1594663936 bytes 2021-11-18T10:32:24.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1656177664 bytes 2021-11-18T10:32:24.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1685936128 bytes 2021-11-18T10:32:25.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1706552320 bytes 2021-11-18T10:32:25.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1767501824 bytes 2021-11-18T10:32:25.290 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1794477056 bytes 2021-11-18T10:32:25.454 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1851914240 bytes 2021-11-18T10:32:25.635 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1921213440 bytes 2021-11-18T10:32:25.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1939619840 bytes 2021-11-18T10:32:25.894 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:32:25.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:32:25.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:32:25.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:32:25.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:32:25.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_2 2021-11-18T10:32:25.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_2 snapshot 128M 2021-11-18T10:32:25.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:25.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:25.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:25.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:25.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_2 2021-11-18T10:32:25.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:25.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:32:25.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:32:25.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:25.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_2 128M 2021-11-18T10:32:25.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:25.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:25.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:25.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:25.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_2 2021-11-18T10:32:25.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:25.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:32:25.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:32:25.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:32:25.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:25.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_2 2021-11-18T10:32:25.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:32:25.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_2 snapshot 2021-11-18T10:32:25.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:25.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:25.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_2 2021-11-18T10:32:25.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:32:25.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_2 snapshot 2021-11-18T10:32:26.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:32:26.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_2 2021-11-18T10:32:26.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_2': 2021-11-18T10:32:26.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:32:26.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:32:26.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:32:26.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 1291275cf372 2021-11-18T10:32:26.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.1291275cf372 2021-11-18T10:32:26.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:32:26.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:32:26.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:32:26.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:32:26.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:32:25 2021 2021-11-18T10:32:26.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:32:25 2021 2021-11-18T10:32:26.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:32:25 2021 2021-11-18T10:32:26.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:32:26.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:32:26.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: e1b17467-07c6-4704-b8d5-35feabb9f739 2021-11-18T10:32:26.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:32:26.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:32:26.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_2 2021-11-18T10:32:26.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:26.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:26.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_2 2021-11-18T10:32:26.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:32:26.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=6 2021-11-18T10:32:26.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:32:26.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 6s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_2 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:32:27.271 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 65370112 bytes 2021-11-18T10:32:27.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 70493184 bytes 2021-11-18T10:32:27.527 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 93293568 bytes 2021-11-18T10:32:27.671 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 107918336 bytes 2021-11-18T10:32:27.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 153631744 bytes 2021-11-18T10:32:27.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 183254016 bytes 2021-11-18T10:32:28.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 202369024 bytes 2021-11-18T10:32:28.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 274148352 bytes 2021-11-18T10:32:28.440 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 324593664 bytes 2021-11-18T10:32:28.591 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 353098752 bytes 2021-11-18T10:32:28.724 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 375344128 bytes 2021-11-18T10:32:28.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 424485888 bytes 2021-11-18T10:32:29.034 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 489193472 bytes 2021-11-18T10:32:29.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 587692032 bytes 2021-11-18T10:32:29.449 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 655870976 bytes 2021-11-18T10:32:29.592 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 689868800 bytes 2021-11-18T10:32:29.747 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 727418880 bytes 2021-11-18T10:32:29.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 805477376 bytes 2021-11-18T10:32:30.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 819994624 bytes 2021-11-18T10:32:30.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 857636864 bytes 2021-11-18T10:32:30.352 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 873792512 bytes 2021-11-18T10:32:30.512 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 922115072 bytes 2021-11-18T10:32:30.655 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 952794112 bytes 2021-11-18T10:32:30.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1018033152 bytes 2021-11-18T10:32:31.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1076661248 bytes 2021-11-18T10:32:31.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1127968768 bytes 2021-11-18T10:32:31.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1165880320 bytes 2021-11-18T10:32:31.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1193229312 bytes 2021-11-18T10:32:31.623 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1237079040 bytes 2021-11-18T10:32:31.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1310930944 bytes 2021-11-18T10:32:31.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1376314368 bytes 2021-11-18T10:32:32.133 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1417603072 bytes 2021-11-18T10:32:32.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1466352640 bytes 2021-11-18T10:32:32.507 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1555650560 bytes 2021-11-18T10:32:32.629 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1556262912 bytes 2021-11-18T10:32:32.802 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1629087744 bytes 2021-11-18T10:32:32.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:32:32.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:32:32.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:32:32.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:32:32.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:32:32.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_3 2021-11-18T10:32:32.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_3 snapshot 128M 2021-11-18T10:32:32.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:32.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:32.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:32.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:32.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_3 2021-11-18T10:32:32.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:32.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:32:32.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:32:32.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:32.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_3 128M 2021-11-18T10:32:32.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:32.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:32.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:32.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:32.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_3 2021-11-18T10:32:32.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:32.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:32:32.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:32:32.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:32:32.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:32.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_3 2021-11-18T10:32:32.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:32:32.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_3 snapshot 2021-11-18T10:32:32.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:32.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:32.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_3 2021-11-18T10:32:32.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:32:32.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_3 snapshot 2021-11-18T10:32:33.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:32:33.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_3 2021-11-18T10:32:33.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_3': 2021-11-18T10:32:33.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:32:33.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:32:33.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:32:33.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 129d84c32052 2021-11-18T10:32:33.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.129d84c32052 2021-11-18T10:32:33.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:32:33.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:32:33.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:32:33.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:32:33.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:32:32 2021 2021-11-18T10:32:33.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:32:32 2021 2021-11-18T10:32:33.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:32:32 2021 2021-11-18T10:32:33.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:32:33.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:32:33.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 8b695cca-64db-4241-8fde-2e4bc1dc9ce9 2021-11-18T10:32:33.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:32:33.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:32:33.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_3 2021-11-18T10:32:33.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:33.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:33.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_3 2021-11-18T10:32:33.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:32:33.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=13 2021-11-18T10:32:33.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:32:33.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 13s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_3 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:32:34.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 6098944 bytes 2021-11-18T10:32:34.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 35862528 bytes 2021-11-18T10:32:34.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 82292736 bytes 2021-11-18T10:32:34.583 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 148358144 bytes 2021-11-18T10:32:34.725 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 166625280 bytes 2021-11-18T10:32:34.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 197601280 bytes 2021-11-18T10:32:35.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 235239424 bytes 2021-11-18T10:32:35.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 245378048 bytes 2021-11-18T10:32:35.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 291317760 bytes 2021-11-18T10:32:35.455 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 319322112 bytes 2021-11-18T10:32:35.604 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 357998592 bytes 2021-11-18T10:32:35.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 418846720 bytes 2021-11-18T10:32:35.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 457267200 bytes 2021-11-18T10:32:36.111 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 505958400 bytes 2021-11-18T10:32:36.264 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 554236928 bytes 2021-11-18T10:32:36.296 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:32:36.298+0000 7f46d0e3c700 -1 reset not still connected to 0x556ef74a8270 2021-11-18T10:32:36.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 577114112 bytes 2021-11-18T10:32:36.549 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 620024832 bytes 2021-11-18T10:32:36.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 694223872 bytes 2021-11-18T10:32:36.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 760996864 bytes 2021-11-18T10:32:37.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 863744000 bytes 2021-11-18T10:32:37.275 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 922750976 bytes 2021-11-18T10:32:37.468 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 1020923904 bytes 2021-11-18T10:32:37.617 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1050553344 bytes 2021-11-18T10:32:37.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1070701568 bytes 2021-11-18T10:32:37.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1080416256 bytes 2021-11-18T10:32:38.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1118565376 bytes 2021-11-18T10:32:38.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1134541824 bytes 2021-11-18T10:32:38.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1154162688 bytes 2021-11-18T10:32:38.516 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1257129984 bytes 2021-11-18T10:32:38.659 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1257798656 bytes 2021-11-18T10:32:38.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1342931968 bytes 2021-11-18T10:32:38.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1369655296 bytes 2021-11-18T10:32:39.487 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1428832256 bytes 2021-11-18T10:32:39.488 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1437987840 bytes 2021-11-18T10:32:39.488 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1523277824 bytes 2021-11-18T10:32:39.661 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1650904064 bytes 2021-11-18T10:32:39.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1705113600 bytes 2021-11-18T10:32:40.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1748250624 bytes 2021-11-18T10:32:40.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1783257088 bytes 2021-11-18T10:32:40.293 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1786060800 bytes 2021-11-18T10:32:40.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1817245696 bytes 2021-11-18T10:32:40.584 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1838815232 bytes 2021-11-18T10:32:40.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1853760512 bytes 2021-11-18T10:32:40.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1937235968 bytes 2021-11-18T10:32:41.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1998922752 bytes 2021-11-18T10:32:41.236 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2043661312 bytes 2021-11-18T10:32:41.368 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2070742016 bytes 2021-11-18T10:32:41.519 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2119351296 bytes 2021-11-18T10:32:41.676 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2153341952 bytes 2021-11-18T10:32:41.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2166468608 bytes 2021-11-18T10:32:42.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2236988416 bytes 2021-11-18T10:32:42.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2277965824 bytes 2021-11-18T10:32:42.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2340185088 bytes 2021-11-18T10:32:42.530 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2434758656 bytes 2021-11-18T10:32:42.685 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2474284032 bytes 2021-11-18T10:32:42.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2474906624 bytes 2021-11-18T10:32:42.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2505499648 bytes 2021-11-18T10:32:43.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2551124992 bytes 2021-11-18T10:32:43.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2572754944 bytes 2021-11-18T10:32:43.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2573373440 bytes 2021-11-18T10:32:43.510 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2604203008 bytes 2021-11-18T10:32:43.690 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2672179200 bytes 2021-11-18T10:32:43.823 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2678076416 bytes 2021-11-18T10:32:44.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2756545536 bytes 2021-11-18T10:32:44.146 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2757167104 bytes 2021-11-18T10:32:44.259 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2759384064 bytes 2021-11-18T10:32:44.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2760018944 bytes 2021-11-18T10:32:44.515 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2779177984 bytes 2021-11-18T10:32:44.672 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2820811776 bytes 2021-11-18T10:32:44.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2891502592 bytes 2021-11-18T10:32:45.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2935925760 bytes 2021-11-18T10:32:45.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2991564800 bytes 2021-11-18T10:32:45.351 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3042125824 bytes 2021-11-18T10:32:45.495 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3078053888 bytes 2021-11-18T10:32:45.617 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3078659072 bytes 2021-11-18T10:32:45.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3118961664 bytes 2021-11-18T10:32:45.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3159659520 bytes 2021-11-18T10:32:46.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3173351424 bytes 2021-11-18T10:32:46.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3245955072 bytes 2021-11-18T10:32:46.441 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3317240832 bytes 2021-11-18T10:32:46.597 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3350470656 bytes 2021-11-18T10:32:46.774 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3436614656 bytes 2021-11-18T10:32:46.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:32:46.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:32:46.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:32:46.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:32:46.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:32:46.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_4 2021-11-18T10:32:46.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_4 snapshot 128M 2021-11-18T10:32:46.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:46.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:46.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:46.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:46.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_4 2021-11-18T10:32:46.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:46.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:32:46.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:32:46.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:46.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_4 128M 2021-11-18T10:32:46.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:46.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:46.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:46.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:46.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_4 2021-11-18T10:32:46.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:46.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:32:46.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:32:46.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:32:46.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:46.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_4 2021-11-18T10:32:46.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:32:46.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_4 snapshot 2021-11-18T10:32:46.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:46.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:46.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_4 2021-11-18T10:32:46.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:32:46.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_4 snapshot 2021-11-18T10:32:47.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:32:47.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_4 2021-11-18T10:32:47.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_4': 2021-11-18T10:32:47.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:32:47.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:32:47.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:32:47.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 12a9f608ea05 2021-11-18T10:32:47.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.12a9f608ea05 2021-11-18T10:32:47.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:32:47.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:32:47.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:32:47.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:32:47.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:32:46 2021 2021-11-18T10:32:47.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:32:46 2021 2021-11-18T10:32:47.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:32:46 2021 2021-11-18T10:32:47.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:32:47.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:32:47.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: a09e37ac-81b3-4032-8476-700227be644d 2021-11-18T10:32:47.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:32:47.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:32:47.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_4 2021-11-18T10:32:47.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:47.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:47.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_4 2021-11-18T10:32:47.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:32:47.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=6 2021-11-18T10:32:47.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:32:47.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 6s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_4 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:32:48.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 34424832 bytes 2021-11-18T10:32:48.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 63702016 bytes 2021-11-18T10:32:48.467 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 152942592 bytes 2021-11-18T10:32:48.610 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 176311296 bytes 2021-11-18T10:32:48.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 236304384 bytes 2021-11-18T10:32:48.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 273206272 bytes 2021-11-18T10:32:49.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 372462592 bytes 2021-11-18T10:32:49.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 429579264 bytes 2021-11-18T10:32:49.457 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 473163776 bytes 2021-11-18T10:32:49.600 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 500625408 bytes 2021-11-18T10:32:49.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 547388416 bytes 2021-11-18T10:32:49.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 553003008 bytes 2021-11-18T10:32:50.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 638166016 bytes 2021-11-18T10:32:50.238 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 675166208 bytes 2021-11-18T10:32:50.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 736456704 bytes 2021-11-18T10:32:50.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 757524480 bytes 2021-11-18T10:32:50.565 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 809089024 bytes 2021-11-18T10:32:50.675 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 828290048 bytes 2021-11-18T10:32:50.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 889815040 bytes 2021-11-18T10:32:50.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 958939136 bytes 2021-11-18T10:32:51.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 967198720 bytes 2021-11-18T10:32:51.187 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 1081839616 bytes 2021-11-18T10:32:51.278 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1104479232 bytes 2021-11-18T10:32:51.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1160192000 bytes 2021-11-18T10:32:51.522 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1204665344 bytes 2021-11-18T10:32:51.596 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1208621056 bytes 2021-11-18T10:32:51.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1241508864 bytes 2021-11-18T10:32:51.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1288963072 bytes 2021-11-18T10:32:51.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1328571392 bytes 2021-11-18T10:32:52.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1384427520 bytes 2021-11-18T10:32:52.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1425979392 bytes 2021-11-18T10:32:52.236 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1460343808 bytes 2021-11-18T10:32:52.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1483426816 bytes 2021-11-18T10:32:52.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1484039168 bytes 2021-11-18T10:32:52.517 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1531466752 bytes 2021-11-18T10:32:52.650 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1598479360 bytes 2021-11-18T10:32:52.796 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1672414208 bytes 2021-11-18T10:32:52.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1686535168 bytes 2021-11-18T10:32:52.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1725854720 bytes 2021-11-18T10:32:53.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1786074112 bytes 2021-11-18T10:32:53.236 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1828639744 bytes 2021-11-18T10:32:53.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1902416896 bytes 2021-11-18T10:32:53.496 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1962494976 bytes 2021-11-18T10:32:53.594 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1999900672 bytes 2021-11-18T10:32:53.727 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 2046240768 bytes 2021-11-18T10:32:53.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2073180160 bytes 2021-11-18T10:32:53.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:32:53.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:32:53.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:32:53.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:32:53.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:32:53.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_5 2021-11-18T10:32:53.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_5 snapshot 128M 2021-11-18T10:32:53.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:53.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:53.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:53.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:53.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_5 2021-11-18T10:32:53.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:53.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:32:53.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:32:53.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:53.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_5 128M 2021-11-18T10:32:53.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:53.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:53.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:53.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:53.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_5 2021-11-18T10:32:53.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:53.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:32:53.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:32:53.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:32:53.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:32:53.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_5 2021-11-18T10:32:53.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:32:53.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_5 snapshot 2021-11-18T10:32:53.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:53.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:53.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_5 2021-11-18T10:32:53.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:32:53.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_5 snapshot 2021-11-18T10:32:54.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:32:54.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_5 2021-11-18T10:32:54.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_5': 2021-11-18T10:32:54.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:32:54.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:32:54.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:32:54.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 12b4439a580f 2021-11-18T10:32:54.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.12b4439a580f 2021-11-18T10:32:54.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:32:54.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:32:54.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:32:54.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:32:54.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:32:53 2021 2021-11-18T10:32:54.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:32:53 2021 2021-11-18T10:32:54.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:32:53 2021 2021-11-18T10:32:54.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:32:54.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:32:54.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 0aceae44-f31e-4014-9515-086786de4c66 2021-11-18T10:32:54.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:32:54.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:32:54.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_5 2021-11-18T10:32:54.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:32:54.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:32:54.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_5 2021-11-18T10:32:54.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:32:54.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=14 2021-11-18T10:32:54.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:32:54.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 14s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_5 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:32:55.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 35129344 bytes 2021-11-18T10:32:55.133 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 68471808 bytes 2021-11-18T10:32:55.292 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 161762304 bytes 2021-11-18T10:32:55.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 258116608 bytes 2021-11-18T10:32:55.547 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 299589632 bytes 2021-11-18T10:32:55.660 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 335397888 bytes 2021-11-18T10:32:55.797 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 416272384 bytes 2021-11-18T10:32:55.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 452386816 bytes 2021-11-18T10:32:56.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 479226880 bytes 2021-11-18T10:32:56.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 501275648 bytes 2021-11-18T10:32:56.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 574134272 bytes 2021-11-18T10:32:56.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 576587776 bytes 2021-11-18T10:32:56.465 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 636374016 bytes 2021-11-18T10:32:56.602 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 724032512 bytes 2021-11-18T10:32:56.759 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 777144320 bytes 2021-11-18T10:32:56.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 807723008 bytes 2021-11-18T10:32:56.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 852174848 bytes 2021-11-18T10:32:57.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 895329280 bytes 2021-11-18T10:32:57.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 900654080 bytes 2021-11-18T10:32:57.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 910484480 bytes 2021-11-18T10:32:57.345 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 942108672 bytes 2021-11-18T10:32:57.466 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 993303552 bytes 2021-11-18T10:32:57.595 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1048357888 bytes 2021-11-18T10:32:57.685 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1061364736 bytes 2021-11-18T10:32:57.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1090162688 bytes 2021-11-18T10:32:57.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1126872064 bytes 2021-11-18T10:32:57.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1135087616 bytes 2021-11-18T10:32:58.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1171881984 bytes 2021-11-18T10:32:58.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1193118720 bytes 2021-11-18T10:32:58.262 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1222478848 bytes 2021-11-18T10:32:58.298 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:32:58.300+0000 7fc5ccfe3700 -1 reset not still connected to 0x561963d015f0 2021-11-18T10:32:58.299 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:32:58.301+0000 7fc5ccfe3700 -1 reset not still connected to 0x5619643215f0 2021-11-18T10:32:58.299 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:32:58.301+0000 7fc5ccfe3700 -1 reset not still connected to 0x56196b937d40 2021-11-18T10:32:58.343 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1230935040 bytes 2021-11-18T10:32:58.418 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1231535104 bytes 2021-11-18T10:32:58.546 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1288267776 bytes 2021-11-18T10:32:58.720 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1400452096 bytes 2021-11-18T10:32:58.824 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1432865792 bytes 2021-11-18T10:32:58.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1517254656 bytes 2021-11-18T10:32:59.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1519558656 bytes 2021-11-18T10:32:59.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1549861888 bytes 2021-11-18T10:32:59.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1601803264 bytes 2021-11-18T10:32:59.410 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1641138176 bytes 2021-11-18T10:32:59.543 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1711160320 bytes 2021-11-18T10:32:59.625 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1722960896 bytes 2021-11-18T10:32:59.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1797075968 bytes 2021-11-18T10:32:59.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1811893248 bytes 2021-11-18T10:32:59.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1840485376 bytes 2021-11-18T10:33:00.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1887262720 bytes 2021-11-18T10:33:00.191 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1937731584 bytes 2021-11-18T10:33:00.294 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1962942464 bytes 2021-11-18T10:33:00.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2017798144 bytes 2021-11-18T10:33:00.514 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2047444992 bytes 2021-11-18T10:33:00.613 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2075790336 bytes 2021-11-18T10:33:00.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2131740672 bytes 2021-11-18T10:33:00.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2160772096 bytes 2021-11-18T10:33:00.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2201055232 bytes 2021-11-18T10:33:01.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2201666560 bytes 2021-11-18T10:33:01.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2220754944 bytes 2021-11-18T10:33:01.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2259479552 bytes 2021-11-18T10:33:01.302 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2271358976 bytes 2021-11-18T10:33:01.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2291406848 bytes 2021-11-18T10:33:01.500 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2328567808 bytes 2021-11-18T10:33:01.634 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2401198080 bytes 2021-11-18T10:33:01.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2455994368 bytes 2021-11-18T10:33:01.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2478452736 bytes 2021-11-18T10:33:01.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2511584256 bytes 2021-11-18T10:33:02.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2512184320 bytes 2021-11-18T10:33:02.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2562094080 bytes 2021-11-18T10:33:02.322 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2658258944 bytes 2021-11-18T10:33:02.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2691308544 bytes 2021-11-18T10:33:02.545 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2724529152 bytes 2021-11-18T10:33:02.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2758132736 bytes 2021-11-18T10:33:02.733 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2762278912 bytes 2021-11-18T10:33:02.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2770686976 bytes 2021-11-18T10:33:02.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2797831168 bytes 2021-11-18T10:33:03.043 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2849321984 bytes 2021-11-18T10:33:03.143 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 2873223168 bytes 2021-11-18T10:33:03.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 2873820160 bytes 2021-11-18T10:33:03.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 2915707904 bytes 2021-11-18T10:33:03.417 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 2928945152 bytes 2021-11-18T10:33:03.600 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3040353280 bytes 2021-11-18T10:33:03.691 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3059389440 bytes 2021-11-18T10:33:03.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3120713728 bytes 2021-11-18T10:33:03.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3161030656 bytes 2021-11-18T10:33:04.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3190481920 bytes 2021-11-18T10:33:04.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3228370944 bytes 2021-11-18T10:33:04.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3269790720 bytes 2021-11-18T10:33:04.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3316240384 bytes 2021-11-18T10:33:04.455 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3352526848 bytes 2021-11-18T10:33:04.586 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3368034304 bytes 2021-11-18T10:33:04.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3424585728 bytes 2021-11-18T10:33:04.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3474250752 bytes 2021-11-18T10:33:04.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3478347776 bytes 2021-11-18T10:33:05.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3570926592 bytes 2021-11-18T10:33:05.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3599279104 bytes 2021-11-18T10:33:05.309 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3660042240 bytes 2021-11-18T10:33:05.409 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3682344960 bytes 2021-11-18T10:33:05.488 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3690311680 bytes 2021-11-18T10:33:05.602 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 3727284224 bytes 2021-11-18T10:33:05.688 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 3740690432 bytes 2021-11-18T10:33:05.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 3777930240 bytes 2021-11-18T10:33:05.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 3873486848 bytes 2021-11-18T10:33:06.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 3933920256 bytes 2021-11-18T10:33:06.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 3934534656 bytes 2021-11-18T10:33:06.343 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4046887936 bytes 2021-11-18T10:33:06.439 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4081538048 bytes 2021-11-18T10:33:06.574 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4153574400 bytes 2021-11-18T10:33:06.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4194291712 bytes 2021-11-18T10:33:06.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4242378752 bytes 2021-11-18T10:33:06.955 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4277109760 bytes 2021-11-18T10:33:07.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4349054976 bytes 2021-11-18T10:33:07.229 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4413177856 bytes 2021-11-18T10:33:07.337 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4459947008 bytes 2021-11-18T10:33:07.466 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4504188928 bytes 2021-11-18T10:33:07.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4540089344 bytes 2021-11-18T10:33:07.673 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4562931712 bytes 2021-11-18T10:33:07.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4594167808 bytes 2021-11-18T10:33:07.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4640818176 bytes 2021-11-18T10:33:08.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 4697953280 bytes 2021-11-18T10:33:08.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 4720337920 bytes 2021-11-18T10:33:08.289 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 4775345152 bytes 2021-11-18T10:33:08.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 4800940032 bytes 2021-11-18T10:33:08.501 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 4834539520 bytes 2021-11-18T10:33:08.597 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 4855383040 bytes 2021-11-18T10:33:08.749 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 4958425088 bytes 2021-11-18T10:33:08.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 4963901440 bytes 2021-11-18T10:33:08.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:33:08.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:33:08.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:33:08.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:33:08.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:33:08.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_6 2021-11-18T10:33:08.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_6 snapshot 128M 2021-11-18T10:33:08.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:08.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:08.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:08.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:08.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_6 2021-11-18T10:33:08.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:08.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:33:08.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:33:08.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:08.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_6 128M 2021-11-18T10:33:08.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:08.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:08.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:08.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:08.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_6 2021-11-18T10:33:08.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:08.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:33:08.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:33:08.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:33:08.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:08.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_6 2021-11-18T10:33:08.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:33:08.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_6 snapshot 2021-11-18T10:33:08.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:08.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:08.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_6 2021-11-18T10:33:08.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:33:08.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_6 snapshot 2021-11-18T10:33:09.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:33:09.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_6 2021-11-18T10:33:09.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_6': 2021-11-18T10:33:09.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:33:09.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:33:09.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:33:09.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 12c0101ac26b 2021-11-18T10:33:09.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.12c0101ac26b 2021-11-18T10:33:09.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:33:09.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:33:09.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:33:09.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:33:09.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:33:08 2021 2021-11-18T10:33:09.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:33:08 2021 2021-11-18T10:33:09.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:33:08 2021 2021-11-18T10:33:09.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:33:09.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:33:09.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: c3495c85-8c68-4110-a44b-cc0f5e897402 2021-11-18T10:33:09.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:33:09.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:33:09.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_6 2021-11-18T10:33:09.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:09.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:09.953 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_6 2021-11-18T10:33:09.953 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:33:09.953 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=6 2021-11-18T10:33:09.953 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:33:09.953 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 6s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_6 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:33:10.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 14656512 bytes 2021-11-18T10:33:10.192 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 59746304 bytes 2021-11-18T10:33:10.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 116296704 bytes 2021-11-18T10:33:10.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 127306752 bytes 2021-11-18T10:33:10.488 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 141534208 bytes 2021-11-18T10:33:10.591 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 174922752 bytes 2021-11-18T10:33:10.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 215648256 bytes 2021-11-18T10:33:10.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 274960384 bytes 2021-11-18T10:33:11.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 348941312 bytes 2021-11-18T10:33:11.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 391076864 bytes 2021-11-18T10:33:11.262 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 453587968 bytes 2021-11-18T10:33:11.365 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 484759552 bytes 2021-11-18T10:33:11.456 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 507431936 bytes 2021-11-18T10:33:11.572 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 559817728 bytes 2021-11-18T10:33:11.673 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 595158016 bytes 2021-11-18T10:33:11.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 629875712 bytes 2021-11-18T10:33:11.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 651934720 bytes 2021-11-18T10:33:12.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 707246080 bytes 2021-11-18T10:33:12.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 746563584 bytes 2021-11-18T10:33:12.259 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 790549504 bytes 2021-11-18T10:33:12.381 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 833504256 bytes 2021-11-18T10:33:12.495 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 869042176 bytes 2021-11-18T10:33:12.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 920932352 bytes 2021-11-18T10:33:12.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 965607424 bytes 2021-11-18T10:33:12.863 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1001552896 bytes 2021-11-18T10:33:12.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1002164224 bytes 2021-11-18T10:33:13.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1032249344 bytes 2021-11-18T10:33:13.200 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1109983232 bytes 2021-11-18T10:33:13.276 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1110595584 bytes 2021-11-18T10:33:13.407 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1154952192 bytes 2021-11-18T10:33:13.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1166393344 bytes 2021-11-18T10:33:13.617 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1204228096 bytes 2021-11-18T10:33:13.747 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1260959744 bytes 2021-11-18T10:33:13.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1326498816 bytes 2021-11-18T10:33:13.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1335780352 bytes 2021-11-18T10:33:14.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1345825792 bytes 2021-11-18T10:33:14.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1435926528 bytes 2021-11-18T10:33:14.344 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1493340160 bytes 2021-11-18T10:33:14.476 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1534806016 bytes 2021-11-18T10:33:14.588 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1563033600 bytes 2021-11-18T10:33:14.690 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1589132288 bytes 2021-11-18T10:33:14.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1647887360 bytes 2021-11-18T10:33:14.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1648512000 bytes 2021-11-18T10:33:15.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1714652160 bytes 2021-11-18T10:33:15.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1754652672 bytes 2021-11-18T10:33:15.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1828734976 bytes 2021-11-18T10:33:15.402 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1858844672 bytes 2021-11-18T10:33:15.517 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1909482496 bytes 2021-11-18T10:33:15.666 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1964786688 bytes 2021-11-18T10:33:15.794 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2036816896 bytes 2021-11-18T10:33:15.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2058419200 bytes 2021-11-18T10:33:15.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:33:15.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:33:15.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:33:15.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:33:15.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:33:15.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_7 2021-11-18T10:33:15.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_7 snapshot 128M 2021-11-18T10:33:15.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:15.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:15.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:15.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:15.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_7 2021-11-18T10:33:15.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:15.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:33:15.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:33:15.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:15.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_7 128M 2021-11-18T10:33:15.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:15.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:15.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:15.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:15.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_7 2021-11-18T10:33:15.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:15.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:33:15.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:33:15.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:33:15.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:15.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_7 2021-11-18T10:33:15.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:33:15.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_7 snapshot 2021-11-18T10:33:15.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:15.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:15.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_7 2021-11-18T10:33:15.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:33:15.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_7 snapshot 2021-11-18T10:33:16.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:33:16.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_7 2021-11-18T10:33:16.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_7': 2021-11-18T10:33:16.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:33:16.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:33:16.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:33:16.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 12cc9e1a39f4 2021-11-18T10:33:16.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.12cc9e1a39f4 2021-11-18T10:33:16.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:33:16.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:33:16.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:33:16.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:33:16.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:33:15 2021 2021-11-18T10:33:16.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:33:15 2021 2021-11-18T10:33:16.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:33:15 2021 2021-11-18T10:33:16.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:33:16.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:33:16.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 684710c4-de7e-4a0e-b505-3a9e6482f9ea 2021-11-18T10:33:16.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:33:16.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:33:16.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_7 2021-11-18T10:33:16.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:16.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:16.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_7 2021-11-18T10:33:16.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:33:16.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=7 2021-11-18T10:33:16.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:33:16.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 7s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_7 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:33:17.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 39076864 bytes 2021-11-18T10:33:17.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 143798272 bytes 2021-11-18T10:33:17.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 198031360 bytes 2021-11-18T10:33:17.466 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 214726656 bytes 2021-11-18T10:33:17.596 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 271360000 bytes 2021-11-18T10:33:17.672 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 277108736 bytes 2021-11-18T10:33:17.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 295316480 bytes 2021-11-18T10:33:17.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 315145216 bytes 2021-11-18T10:33:17.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 362368000 bytes 2021-11-18T10:33:18.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 385235968 bytes 2021-11-18T10:33:18.181 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 412755968 bytes 2021-11-18T10:33:18.264 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 418769920 bytes 2021-11-18T10:33:18.378 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 460455936 bytes 2021-11-18T10:33:18.506 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 511350784 bytes 2021-11-18T10:33:18.588 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 537840640 bytes 2021-11-18T10:33:18.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 596128768 bytes 2021-11-18T10:33:18.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 641305600 bytes 2021-11-18T10:33:18.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 664955904 bytes 2021-11-18T10:33:19.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 700995584 bytes 2021-11-18T10:33:19.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 785753088 bytes 2021-11-18T10:33:19.308 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 786365440 bytes 2021-11-18T10:33:19.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 803995648 bytes 2021-11-18T10:33:19.555 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 871067648 bytes 2021-11-18T10:33:19.667 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 915440640 bytes 2021-11-18T10:33:19.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 967535616 bytes 2021-11-18T10:33:19.920 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1017934848 bytes 2021-11-18T10:33:20.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1020678144 bytes 2021-11-18T10:33:20.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1068598272 bytes 2021-11-18T10:33:20.290 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1132148736 bytes 2021-11-18T10:33:20.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1192053760 bytes 2021-11-18T10:33:20.558 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1254017024 bytes 2021-11-18T10:33:20.699 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1304767488 bytes 2021-11-18T10:33:20.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1349677056 bytes 2021-11-18T10:33:20.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1377281024 bytes 2021-11-18T10:33:21.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1478173696 bytes 2021-11-18T10:33:21.239 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1498283008 bytes 2021-11-18T10:33:21.339 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1517706240 bytes 2021-11-18T10:33:21.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1552770048 bytes 2021-11-18T10:33:21.606 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1615180800 bytes 2021-11-18T10:33:21.729 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1651421184 bytes 2021-11-18T10:33:21.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1673085952 bytes 2021-11-18T10:33:21.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1704243200 bytes 2021-11-18T10:33:22.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1708025856 bytes 2021-11-18T10:33:22.187 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1763767296 bytes 2021-11-18T10:33:22.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1810935808 bytes 2021-11-18T10:33:22.488 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1893453824 bytes 2021-11-18T10:33:22.606 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1934160896 bytes 2021-11-18T10:33:22.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1960967168 bytes 2021-11-18T10:33:22.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2021747712 bytes 2021-11-18T10:33:22.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2083047424 bytes 2021-11-18T10:33:23.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2169545728 bytes 2021-11-18T10:33:23.307 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2231279616 bytes 2021-11-18T10:33:23.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2245617664 bytes 2021-11-18T10:33:23.510 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2278511616 bytes 2021-11-18T10:33:23.622 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2320039936 bytes 2021-11-18T10:33:23.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2353049600 bytes 2021-11-18T10:33:23.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2369556480 bytes 2021-11-18T10:33:23.954 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:33:23.955 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:33:23.955 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:33:23.955 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:33:23.955 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:33:23.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_8 2021-11-18T10:33:23.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_8 snapshot 128M 2021-11-18T10:33:23.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:23.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:23.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:23.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:23.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_8 2021-11-18T10:33:23.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:23.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:33:23.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:33:23.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:23.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_8 128M 2021-11-18T10:33:23.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:23.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:23.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:23.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:23.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_8 2021-11-18T10:33:23.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:23.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:33:23.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:33:23.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:33:23.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:23.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_8 2021-11-18T10:33:23.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:33:23.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_8 snapshot 2021-11-18T10:33:23.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:23.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:23.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_8 2021-11-18T10:33:23.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:33:23.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_8 snapshot 2021-11-18T10:33:24.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:33:24.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_8 2021-11-18T10:33:24.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_8': 2021-11-18T10:33:24.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:33:24.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:33:24.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:33:24.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 12d8edf03df0 2021-11-18T10:33:24.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.12d8edf03df0 2021-11-18T10:33:24.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:33:24.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:33:24.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:33:24.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:33:24.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:33:23 2021 2021-11-18T10:33:24.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:33:23 2021 2021-11-18T10:33:24.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:33:23 2021 2021-11-18T10:33:24.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:33:24.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:33:24.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 41aeafc4-185c-466a-9d7f-656b036bc6cf 2021-11-18T10:33:24.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:33:24.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:33:24.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_8 2021-11-18T10:33:24.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:24.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:24.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_8 2021-11-18T10:33:24.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:33:24.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=13 2021-11-18T10:33:24.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:33:24.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 13s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_8 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:33:25.109 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 41744384 bytes 2021-11-18T10:33:25.338 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 126009344 bytes 2021-11-18T10:33:25.339 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 145737728 bytes 2021-11-18T10:33:25.448 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 196535296 bytes 2021-11-18T10:33:25.534 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 224804864 bytes 2021-11-18T10:33:25.635 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 263733248 bytes 2021-11-18T10:33:25.745 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 308632576 bytes 2021-11-18T10:33:25.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 323631104 bytes 2021-11-18T10:33:25.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 419735552 bytes 2021-11-18T10:33:26.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 439399424 bytes 2021-11-18T10:33:26.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 464198656 bytes 2021-11-18T10:33:26.243 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 494678016 bytes 2021-11-18T10:33:26.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 513468416 bytes 2021-11-18T10:33:26.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 550618112 bytes 2021-11-18T10:33:26.499 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 557662208 bytes 2021-11-18T10:33:26.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 570497024 bytes 2021-11-18T10:33:26.677 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 617910272 bytes 2021-11-18T10:33:26.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 642329600 bytes 2021-11-18T10:33:26.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 722453504 bytes 2021-11-18T10:33:27.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 776313856 bytes 2021-11-18T10:33:27.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 776930304 bytes 2021-11-18T10:33:27.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 777888768 bytes 2021-11-18T10:33:27.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 813312000 bytes 2021-11-18T10:33:27.338 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 829844480 bytes 2021-11-18T10:33:27.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 842559488 bytes 2021-11-18T10:33:27.485 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 843164672 bytes 2021-11-18T10:33:27.658 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 960577536 bytes 2021-11-18T10:33:27.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 989955072 bytes 2021-11-18T10:33:27.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1016628224 bytes 2021-11-18T10:33:27.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1121154048 bytes 2021-11-18T10:33:28.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1143250944 bytes 2021-11-18T10:33:28.207 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1208883200 bytes 2021-11-18T10:33:28.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1270146048 bytes 2021-11-18T10:33:28.334 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:33:28.337+0000 7f788168a700 -1 reset not still connected to 0x55e0d7eca270 2021-11-18T10:33:28.335 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:33:28.337+0000 7f788168a700 -1 reset not still connected to 0x55e0e4dba5b0 2021-11-18T10:33:28.335 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:33:28.337+0000 7f788168a700 -1 reset not still connected to 0x55e0e4dbbad0 2021-11-18T10:33:28.418 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1290612736 bytes 2021-11-18T10:33:28.518 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1323947008 bytes 2021-11-18T10:33:28.620 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1360107520 bytes 2021-11-18T10:33:28.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1378451456 bytes 2021-11-18T10:33:28.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1460422656 bytes 2021-11-18T10:33:28.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1516512256 bytes 2021-11-18T10:33:29.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1563450368 bytes 2021-11-18T10:33:29.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1616458752 bytes 2021-11-18T10:33:29.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1678924800 bytes 2021-11-18T10:33:29.449 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1741808640 bytes 2021-11-18T10:33:29.516 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1742429184 bytes 2021-11-18T10:33:29.643 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1813804032 bytes 2021-11-18T10:33:29.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1826466816 bytes 2021-11-18T10:33:29.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1845430272 bytes 2021-11-18T10:33:29.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1895263232 bytes 2021-11-18T10:33:30.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1935098880 bytes 2021-11-18T10:33:30.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2007528448 bytes 2021-11-18T10:33:30.284 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2055372800 bytes 2021-11-18T10:33:30.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2084420608 bytes 2021-11-18T10:33:30.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2099728384 bytes 2021-11-18T10:33:30.560 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2136033280 bytes 2021-11-18T10:33:30.718 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2226282496 bytes 2021-11-18T10:33:30.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2255466496 bytes 2021-11-18T10:33:30.894 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2273134592 bytes 2021-11-18T10:33:31.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2388147200 bytes 2021-11-18T10:33:31.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2434384896 bytes 2021-11-18T10:33:31.275 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2461953024 bytes 2021-11-18T10:33:31.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2504454144 bytes 2021-11-18T10:33:31.517 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2555200512 bytes 2021-11-18T10:33:31.592 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.7726373261912036) > weight (0.25) 2021-11-18T10:33:31.593 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.519135439319277) > weight (0.25) 2021-11-18T10:33:31.593 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.2 with skip (0.9995042523052544) > weight (0.25) 2021-11-18T10:33:31.593 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.3 with skip (0.3242344422415233) > weight (0.25) 2021-11-18T10:33:31.594 INFO:tasks.rbd_mirror_thrash:waiting for 65 secs before thrashing 2021-11-18T10:33:31.655 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2636248064 bytes 2021-11-18T10:33:31.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2707860480 bytes 2021-11-18T10:33:31.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2742768640 bytes 2021-11-18T10:33:32.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2804790272 bytes 2021-11-18T10:33:32.119 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2844187648 bytes 2021-11-18T10:33:32.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2854164480 bytes 2021-11-18T10:33:32.308 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2908567552 bytes 2021-11-18T10:33:32.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2949192704 bytes 2021-11-18T10:33:32.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2971040768 bytes 2021-11-18T10:33:32.622 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3039568896 bytes 2021-11-18T10:33:32.691 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3043939328 bytes 2021-11-18T10:33:32.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3062170624 bytes 2021-11-18T10:33:32.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3099536384 bytes 2021-11-18T10:33:33.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3153499136 bytes 2021-11-18T10:33:33.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3171166208 bytes 2021-11-18T10:33:33.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3241060352 bytes 2021-11-18T10:33:33.355 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3302846464 bytes 2021-11-18T10:33:33.490 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3376617472 bytes 2021-11-18T10:33:33.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3397493760 bytes 2021-11-18T10:33:33.668 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3423429632 bytes 2021-11-18T10:33:33.742 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3452580864 bytes 2021-11-18T10:33:33.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3472792576 bytes 2021-11-18T10:33:33.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3490038784 bytes 2021-11-18T10:33:34.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3533157376 bytes 2021-11-18T10:33:34.210 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3635597312 bytes 2021-11-18T10:33:34.309 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3680924672 bytes 2021-11-18T10:33:34.438 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3763270656 bytes 2021-11-18T10:33:34.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3763887104 bytes 2021-11-18T10:33:34.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3820152832 bytes 2021-11-18T10:33:34.701 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3864127488 bytes 2021-11-18T10:33:34.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3912671232 bytes 2021-11-18T10:33:34.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3959467008 bytes 2021-11-18T10:33:34.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 4000116736 bytes 2021-11-18T10:33:35.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 4030786560 bytes 2021-11-18T10:33:35.144 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 4039916544 bytes 2021-11-18T10:33:35.287 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4147741696 bytes 2021-11-18T10:33:35.354 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4148352000 bytes 2021-11-18T10:33:35.430 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4172794880 bytes 2021-11-18T10:33:35.493 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4183458816 bytes 2021-11-18T10:33:35.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4288778240 bytes 2021-11-18T10:33:35.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4323562496 bytes 2021-11-18T10:33:35.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4338124800 bytes 2021-11-18T10:33:35.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4389438464 bytes 2021-11-18T10:33:36.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4419524608 bytes 2021-11-18T10:33:36.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4442387456 bytes 2021-11-18T10:33:36.229 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4474148864 bytes 2021-11-18T10:33:36.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4571831296 bytes 2021-11-18T10:33:36.474 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4612030464 bytes 2021-11-18T10:33:36.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4637631488 bytes 2021-11-18T10:33:36.636 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4677957632 bytes 2021-11-18T10:33:36.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4678577152 bytes 2021-11-18T10:33:36.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4718263296 bytes 2021-11-18T10:33:36.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4732332032 bytes 2021-11-18T10:33:36.955 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4780059648 bytes 2021-11-18T10:33:37.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 4812439552 bytes 2021-11-18T10:33:37.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 4826131456 bytes 2021-11-18T10:33:37.230 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 4863563776 bytes 2021-11-18T10:33:37.296 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 4878240768 bytes 2021-11-18T10:33:37.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 4930375680 bytes 2021-11-18T10:33:37.464 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 4943469568 bytes 2021-11-18T10:33:37.550 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 4977202176 bytes 2021-11-18T10:33:37.624 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 4995780608 bytes 2021-11-18T10:33:37.702 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12500 IOs, 5029820416 bytes 2021-11-18T10:33:37.827 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12600 IOs, 5096335360 bytes 2021-11-18T10:33:37.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12700 IOs, 5136153600 bytes 2021-11-18T10:33:37.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:33:37.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:33:37.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:33:37.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:33:37.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:33:37.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_9 2021-11-18T10:33:37.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_9 snapshot 128M 2021-11-18T10:33:37.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:37.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:37.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:37.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:37.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_9 2021-11-18T10:33:37.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:37.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:33:37.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:33:37.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:37.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_9 128M 2021-11-18T10:33:37.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:37.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:37.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:37.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:37.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_9 2021-11-18T10:33:37.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:37.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:33:37.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:33:37.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:33:37.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:37.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_9 2021-11-18T10:33:38.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:33:38.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_9 snapshot 2021-11-18T10:33:38.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:38.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:38.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_9 2021-11-18T10:33:38.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:33:38.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_9 snapshot 2021-11-18T10:33:38.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:33:38.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_9 2021-11-18T10:33:39.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_9': 2021-11-18T10:33:39.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:33:39.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:33:39.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:33:39.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 12e33ddef06c 2021-11-18T10:33:39.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.12e33ddef06c 2021-11-18T10:33:39.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:33:39.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:33:39.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:33:39.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:33:39.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:33:38 2021 2021-11-18T10:33:39.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:33:38 2021 2021-11-18T10:33:39.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:33:38 2021 2021-11-18T10:33:39.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:33:39.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:33:39.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 09484e09-985b-43dc-9d7e-bc876c322641 2021-11-18T10:33:39.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:33:39.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:33:39.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_9 2021-11-18T10:33:39.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:39.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:39.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_9 2021-11-18T10:33:39.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:33:39.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=12 2021-11-18T10:33:39.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:33:39.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 12s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_9 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:33:39.145 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 58542080 bytes 2021-11-18T10:33:39.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 168449024 bytes 2021-11-18T10:33:39.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 201652224 bytes 2021-11-18T10:33:39.485 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 244274176 bytes 2021-11-18T10:33:39.597 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 309680128 bytes 2021-11-18T10:33:39.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 361918464 bytes 2021-11-18T10:33:39.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 378631168 bytes 2021-11-18T10:33:39.823 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 390295552 bytes 2021-11-18T10:33:39.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 420783104 bytes 2021-11-18T10:33:39.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 458608640 bytes 2021-11-18T10:33:40.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 524438528 bytes 2021-11-18T10:33:40.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 529574912 bytes 2021-11-18T10:33:40.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 580654080 bytes 2021-11-18T10:33:40.313 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 596322304 bytes 2021-11-18T10:33:40.441 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 678671360 bytes 2021-11-18T10:33:40.512 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 706849792 bytes 2021-11-18T10:33:40.615 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 766799872 bytes 2021-11-18T10:33:40.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 815720448 bytes 2021-11-18T10:33:40.797 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 862482432 bytes 2021-11-18T10:33:40.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 874327040 bytes 2021-11-18T10:33:40.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 894252032 bytes 2021-11-18T10:33:41.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 916118528 bytes 2021-11-18T10:33:41.109 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 972178432 bytes 2021-11-18T10:33:41.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 980436992 bytes 2021-11-18T10:33:41.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1068542976 bytes 2021-11-18T10:33:41.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1096512512 bytes 2021-11-18T10:33:41.480 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1144850432 bytes 2021-11-18T10:33:41.552 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1168169984 bytes 2021-11-18T10:33:41.609 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1175860224 bytes 2021-11-18T10:33:41.669 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1209707520 bytes 2021-11-18T10:33:41.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1257597952 bytes 2021-11-18T10:33:41.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1261777920 bytes 2021-11-18T10:33:41.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1315699712 bytes 2021-11-18T10:33:42.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1359128576 bytes 2021-11-18T10:33:42.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1376782336 bytes 2021-11-18T10:33:42.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1431055360 bytes 2021-11-18T10:33:42.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1460180992 bytes 2021-11-18T10:33:42.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1514178560 bytes 2021-11-18T10:33:42.512 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1575002112 bytes 2021-11-18T10:33:42.569 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1591781376 bytes 2021-11-18T10:33:42.646 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1606742016 bytes 2021-11-18T10:33:42.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1679123456 bytes 2021-11-18T10:33:42.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1745025024 bytes 2021-11-18T10:33:42.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1790829568 bytes 2021-11-18T10:33:43.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1810980864 bytes 2021-11-18T10:33:43.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1865322496 bytes 2021-11-18T10:33:43.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1900083200 bytes 2021-11-18T10:33:43.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1919413248 bytes 2021-11-18T10:33:43.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2016944128 bytes 2021-11-18T10:33:43.593 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2104344576 bytes 2021-11-18T10:33:43.672 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2141860864 bytes 2021-11-18T10:33:43.744 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2153489408 bytes 2021-11-18T10:33:43.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2161812480 bytes 2021-11-18T10:33:43.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2193830912 bytes 2021-11-18T10:33:43.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2220929024 bytes 2021-11-18T10:33:44.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2260034560 bytes 2021-11-18T10:33:44.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2321256448 bytes 2021-11-18T10:33:44.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2360553472 bytes 2021-11-18T10:33:44.356 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2415483904 bytes 2021-11-18T10:33:44.430 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2437317632 bytes 2021-11-18T10:33:44.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2446166016 bytes 2021-11-18T10:33:44.576 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2478219264 bytes 2021-11-18T10:33:44.698 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2549781504 bytes 2021-11-18T10:33:44.786 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2592484352 bytes 2021-11-18T10:33:44.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2628234240 bytes 2021-11-18T10:33:44.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2680053760 bytes 2021-11-18T10:33:45.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2712425472 bytes 2021-11-18T10:33:45.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2768709632 bytes 2021-11-18T10:33:45.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2797484032 bytes 2021-11-18T10:33:45.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2822530048 bytes 2021-11-18T10:33:45.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2859036672 bytes 2021-11-18T10:33:45.526 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2907183104 bytes 2021-11-18T10:33:45.610 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2937739264 bytes 2021-11-18T10:33:45.696 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2972980224 bytes 2021-11-18T10:33:45.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3098115072 bytes 2021-11-18T10:33:46.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3185468416 bytes 2021-11-18T10:33:46.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3199769600 bytes 2021-11-18T10:33:46.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3212766208 bytes 2021-11-18T10:33:46.220 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3229440000 bytes 2021-11-18T10:33:46.343 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3316603904 bytes 2021-11-18T10:33:46.472 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3374159872 bytes 2021-11-18T10:33:46.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3384946688 bytes 2021-11-18T10:33:46.668 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3466076160 bytes 2021-11-18T10:33:46.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3514172416 bytes 2021-11-18T10:33:46.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3521829888 bytes 2021-11-18T10:33:46.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3576522752 bytes 2021-11-18T10:33:47.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3616624640 bytes 2021-11-18T10:33:47.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3661627392 bytes 2021-11-18T10:33:47.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3677954048 bytes 2021-11-18T10:33:47.283 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3711415296 bytes 2021-11-18T10:33:47.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3762618368 bytes 2021-11-18T10:33:47.445 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3763231744 bytes 2021-11-18T10:33:47.534 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3796212736 bytes 2021-11-18T10:33:47.664 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3873439744 bytes 2021-11-18T10:33:47.728 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3880398848 bytes 2021-11-18T10:33:47.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3947256832 bytes 2021-11-18T10:33:47.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 3990506496 bytes 2021-11-18T10:33:48.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4038270976 bytes 2021-11-18T10:33:48.139 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4081937408 bytes 2021-11-18T10:33:48.286 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4159235072 bytes 2021-11-18T10:33:48.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4235851776 bytes 2021-11-18T10:33:48.508 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4281636864 bytes 2021-11-18T10:33:48.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4285375488 bytes 2021-11-18T10:33:48.655 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4308337664 bytes 2021-11-18T10:33:48.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4352787456 bytes 2021-11-18T10:33:48.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4389416960 bytes 2021-11-18T10:33:48.953 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4445847552 bytes 2021-11-18T10:33:49.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4463467520 bytes 2021-11-18T10:33:49.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4514703360 bytes 2021-11-18T10:33:49.182 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4515304448 bytes 2021-11-18T10:33:49.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4574140416 bytes 2021-11-18T10:33:49.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4628151296 bytes 2021-11-18T10:33:49.515 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4684454912 bytes 2021-11-18T10:33:49.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4698161152 bytes 2021-11-18T10:33:49.666 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4729686016 bytes 2021-11-18T10:33:49.769 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4784759808 bytes 2021-11-18T10:33:49.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 4791881728 bytes 2021-11-18T10:33:49.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 4883307520 bytes 2021-11-18T10:33:50.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 4930769920 bytes 2021-11-18T10:33:50.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 4952768512 bytes 2021-11-18T10:33:50.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 4990364672 bytes 2021-11-18T10:33:50.334 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 5023602688 bytes 2021-11-18T10:33:50.502 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 5127609344 bytes 2021-11-18T10:33:50.612 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 5187605504 bytes 2021-11-18T10:33:50.719 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12500 IOs, 5244032000 bytes 2021-11-18T10:33:50.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12600 IOs, 5280295936 bytes 2021-11-18T10:33:50.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12700 IOs, 5378215936 bytes 2021-11-18T10:33:51.034 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:33:51.034 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:33:51.034 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:33:51.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:33:51.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:33:51.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_10 2021-11-18T10:33:51.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_10 snapshot 128M 2021-11-18T10:33:51.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:51.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:51.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:51.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:51.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_10 2021-11-18T10:33:51.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:51.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:33:51.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:33:51.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:51.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_10 128M 2021-11-18T10:33:51.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:51.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:51.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:51.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:51.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_10 2021-11-18T10:33:51.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:51.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:33:51.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:33:51.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:33:51.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:33:51.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_10 2021-11-18T10:33:51.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:33:51.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_10 snapshot 2021-11-18T10:33:51.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:51.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:51.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_10 2021-11-18T10:33:51.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:33:51.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_10 snapshot 2021-11-18T10:33:52.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:33:52.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_10 2021-11-18T10:33:52.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_10': 2021-11-18T10:33:52.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:33:52.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:33:52.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:33:52.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 12ee4c3701c5 2021-11-18T10:33:52.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.12ee4c3701c5 2021-11-18T10:33:52.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:33:52.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:33:52.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:33:52.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:33:52.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:33:51 2021 2021-11-18T10:33:52.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:33:51 2021 2021-11-18T10:33:52.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:33:51 2021 2021-11-18T10:33:52.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:33:52.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:33:52.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 0f823b94-0604-4135-8693-f0a9e469f77c 2021-11-18T10:33:52.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:33:52.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:33:52.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_10 2021-11-18T10:33:52.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:33:52.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:33:52.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_10 2021-11-18T10:33:52.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:33:52.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=10 2021-11-18T10:33:52.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:33:52.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 10s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_10 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:33:52.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 32885760 bytes 2021-11-18T10:33:52.238 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 54658048 bytes 2021-11-18T10:33:52.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 74409984 bytes 2021-11-18T10:33:52.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 125050880 bytes 2021-11-18T10:33:52.501 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 150775808 bytes 2021-11-18T10:33:52.645 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 246615040 bytes 2021-11-18T10:33:52.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 340885504 bytes 2021-11-18T10:33:52.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 367969280 bytes 2021-11-18T10:33:52.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 424518656 bytes 2021-11-18T10:33:53.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 464761856 bytes 2021-11-18T10:33:53.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 493580288 bytes 2021-11-18T10:33:53.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 513442816 bytes 2021-11-18T10:33:53.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 547202048 bytes 2021-11-18T10:33:53.410 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 584053760 bytes 2021-11-18T10:33:53.529 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 635580416 bytes 2021-11-18T10:33:53.628 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 676241408 bytes 2021-11-18T10:33:53.731 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 711207936 bytes 2021-11-18T10:33:53.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 748124160 bytes 2021-11-18T10:33:53.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 849355776 bytes 2021-11-18T10:33:54.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 878080000 bytes 2021-11-18T10:33:54.140 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 897424384 bytes 2021-11-18T10:33:54.288 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 988836864 bytes 2021-11-18T10:33:54.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1016920064 bytes 2021-11-18T10:33:54.431 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1031037952 bytes 2021-11-18T10:33:54.513 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1076767744 bytes 2021-11-18T10:33:54.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1108996096 bytes 2021-11-18T10:33:54.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1139791872 bytes 2021-11-18T10:33:54.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1153982464 bytes 2021-11-18T10:33:54.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1279594496 bytes 2021-11-18T10:33:55.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1285228544 bytes 2021-11-18T10:33:55.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1308510208 bytes 2021-11-18T10:33:55.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1314045952 bytes 2021-11-18T10:33:55.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1361140736 bytes 2021-11-18T10:33:55.352 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1392205824 bytes 2021-11-18T10:33:55.418 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1402943488 bytes 2021-11-18T10:33:55.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1461225472 bytes 2021-11-18T10:33:55.626 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1496998912 bytes 2021-11-18T10:33:55.720 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1545385984 bytes 2021-11-18T10:33:55.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1591928832 bytes 2021-11-18T10:33:55.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1635591168 bytes 2021-11-18T10:33:56.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1752297472 bytes 2021-11-18T10:33:56.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1817156608 bytes 2021-11-18T10:33:56.349 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1872985088 bytes 2021-11-18T10:33:56.451 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1923053568 bytes 2021-11-18T10:33:56.549 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1961135104 bytes 2021-11-18T10:33:56.657 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2012046336 bytes 2021-11-18T10:33:56.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2081990656 bytes 2021-11-18T10:33:56.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2114521088 bytes 2021-11-18T10:33:56.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2198939648 bytes 2021-11-18T10:33:57.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2230472704 bytes 2021-11-18T10:33:57.188 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2268090368 bytes 2021-11-18T10:33:57.281 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2308061184 bytes 2021-11-18T10:33:57.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2359146496 bytes 2021-11-18T10:33:57.555 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2477099008 bytes 2021-11-18T10:33:57.629 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2488629248 bytes 2021-11-18T10:33:57.737 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2544035840 bytes 2021-11-18T10:33:57.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2574908416 bytes 2021-11-18T10:33:57.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2642015232 bytes 2021-11-18T10:33:58.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2728123392 bytes 2021-11-18T10:33:58.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2737062912 bytes 2021-11-18T10:33:58.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2751174656 bytes 2021-11-18T10:33:58.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2806437888 bytes 2021-11-18T10:33:58.446 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2858374144 bytes 2021-11-18T10:33:58.543 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2899155968 bytes 2021-11-18T10:33:58.672 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2969261056 bytes 2021-11-18T10:33:58.794 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 3035211776 bytes 2021-11-18T10:33:58.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 3064506368 bytes 2021-11-18T10:33:58.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 3083443200 bytes 2021-11-18T10:33:59.034 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 3105716224 bytes 2021-11-18T10:33:59.189 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 3209771008 bytes 2021-11-18T10:33:59.276 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3229813760 bytes 2021-11-18T10:33:59.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3254126592 bytes 2021-11-18T10:33:59.431 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3267421184 bytes 2021-11-18T10:33:59.513 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3288771584 bytes 2021-11-18T10:33:59.626 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3343775744 bytes 2021-11-18T10:33:59.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3451745280 bytes 2021-11-18T10:33:59.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3481267200 bytes 2021-11-18T10:33:59.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3513734144 bytes 2021-11-18T10:34:00.043 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3549776896 bytes 2021-11-18T10:34:00.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3564542976 bytes 2021-11-18T10:34:00.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3597564928 bytes 2021-11-18T10:34:00.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3614104576 bytes 2021-11-18T10:34:00.375 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3625880576 bytes 2021-11-18T10:34:00.501 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3700855808 bytes 2021-11-18T10:34:00.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3775373312 bytes 2021-11-18T10:34:00.727 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3805838336 bytes 2021-11-18T10:34:00.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3828956160 bytes 2021-11-18T10:34:00.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3849321472 bytes 2021-11-18T10:34:01.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3894961152 bytes 2021-11-18T10:34:01.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3937398784 bytes 2021-11-18T10:34:01.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3994595328 bytes 2021-11-18T10:34:01.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 4046671872 bytes 2021-11-18T10:34:01.442 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 4109755392 bytes 2021-11-18T10:34:01.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 4139669504 bytes 2021-11-18T10:34:01.679 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 4226814976 bytes 2021-11-18T10:34:01.753 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 4244713472 bytes 2021-11-18T10:34:01.845 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 4281060352 bytes 2021-11-18T10:34:01.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4299444224 bytes 2021-11-18T10:34:02.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4336715776 bytes 2021-11-18T10:34:02.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:34:02.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:34:02.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:34:02.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:34:02.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:34:02.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_11 2021-11-18T10:34:02.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_11 snapshot 128M 2021-11-18T10:34:02.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:02.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:02.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:02.074 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:02.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_11 2021-11-18T10:34:02.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:02.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:02.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:34:02.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:02.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_11 128M 2021-11-18T10:34:02.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:02.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:02.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:02.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:02.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_11 2021-11-18T10:34:02.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:02.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:34:02.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:34:02.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:34:02.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:02.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_11 2021-11-18T10:34:02.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:34:02.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_11 snapshot 2021-11-18T10:34:02.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:02.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:02.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_11 2021-11-18T10:34:02.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:02.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_11 snapshot 2021-11-18T10:34:03.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:34:03.058 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_11 2021-11-18T10:34:03.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_11': 2021-11-18T10:34:03.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:34:03.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:34:03.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:34:03.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 12f9b966441b 2021-11-18T10:34:03.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.12f9b966441b 2021-11-18T10:34:03.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:34:03.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:34:03.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:34:03.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:34:03.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:34:02 2021 2021-11-18T10:34:03.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:34:02 2021 2021-11-18T10:34:03.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:34:02 2021 2021-11-18T10:34:03.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:34:03.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:34:03.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 867b9ce9-4c79-4fd3-aa13-aac15a130fb1 2021-11-18T10:34:03.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:34:03.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:34:03.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_11 2021-11-18T10:34:03.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:03.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:03.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_11 2021-11-18T10:34:03.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:34:03.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=11 2021-11-18T10:34:03.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:34:03.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 11s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_11 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:34:03.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 78799872 bytes 2021-11-18T10:34:03.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 108238848 bytes 2021-11-18T10:34:03.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 141640704 bytes 2021-11-18T10:34:03.488 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 142245888 bytes 2021-11-18T10:34:03.550 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 142881792 bytes 2021-11-18T10:34:03.684 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 212775936 bytes 2021-11-18T10:34:03.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 250181632 bytes 2021-11-18T10:34:04.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 259053568 bytes 2021-11-18T10:34:04.148 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 294582272 bytes 2021-11-18T10:34:04.270 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 365816832 bytes 2021-11-18T10:34:04.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 419004416 bytes 2021-11-18T10:34:04.445 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 428088320 bytes 2021-11-18T10:34:04.564 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 489141248 bytes 2021-11-18T10:34:04.644 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 517686272 bytes 2021-11-18T10:34:04.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 520485888 bytes 2021-11-18T10:34:04.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 580884480 bytes 2021-11-18T10:34:04.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 592617472 bytes 2021-11-18T10:34:04.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 626765824 bytes 2021-11-18T10:34:05.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 679777280 bytes 2021-11-18T10:34:05.207 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 733821952 bytes 2021-11-18T10:34:05.369 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 787549184 bytes 2021-11-18T10:34:05.485 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 848534528 bytes 2021-11-18T10:34:05.635 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 947775488 bytes 2021-11-18T10:34:05.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1029326848 bytes 2021-11-18T10:34:05.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1110898688 bytes 2021-11-18T10:34:05.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1111507968 bytes 2021-11-18T10:34:06.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1139497984 bytes 2021-11-18T10:34:06.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1189049344 bytes 2021-11-18T10:34:06.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1238768640 bytes 2021-11-18T10:34:06.390 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1307001856 bytes 2021-11-18T10:34:06.472 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1326831616 bytes 2021-11-18T10:34:06.583 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1367667712 bytes 2021-11-18T10:34:06.660 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1391161344 bytes 2021-11-18T10:34:06.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1424834560 bytes 2021-11-18T10:34:06.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1439132672 bytes 2021-11-18T10:34:06.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1500187648 bytes 2021-11-18T10:34:07.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1585333248 bytes 2021-11-18T10:34:07.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1605209088 bytes 2021-11-18T10:34:07.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1635383296 bytes 2021-11-18T10:34:07.373 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1699461120 bytes 2021-11-18T10:34:07.476 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1737900032 bytes 2021-11-18T10:34:07.576 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1768918016 bytes 2021-11-18T10:34:07.639 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1770548224 bytes 2021-11-18T10:34:07.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1815248896 bytes 2021-11-18T10:34:07.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1833753600 bytes 2021-11-18T10:34:07.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1834383360 bytes 2021-11-18T10:34:08.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1902089216 bytes 2021-11-18T10:34:08.111 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1936790528 bytes 2021-11-18T10:34:08.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1951806464 bytes 2021-11-18T10:34:08.272 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 1983802368 bytes 2021-11-18T10:34:08.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2045126656 bytes 2021-11-18T10:34:08.471 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2076379136 bytes 2021-11-18T10:34:08.547 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2097281024 bytes 2021-11-18T10:34:08.666 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2147918848 bytes 2021-11-18T10:34:08.746 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2171020288 bytes 2021-11-18T10:34:08.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2232626176 bytes 2021-11-18T10:34:08.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2297388032 bytes 2021-11-18T10:34:09.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2344827904 bytes 2021-11-18T10:34:09.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2367166464 bytes 2021-11-18T10:34:09.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2373622784 bytes 2021-11-18T10:34:09.349 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2419189760 bytes 2021-11-18T10:34:09.466 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2468466688 bytes 2021-11-18T10:34:09.545 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2490220544 bytes 2021-11-18T10:34:09.644 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2530889728 bytes 2021-11-18T10:34:09.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2636719104 bytes 2021-11-18T10:34:09.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2718893056 bytes 2021-11-18T10:34:10.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2745091072 bytes 2021-11-18T10:34:10.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2790291456 bytes 2021-11-18T10:34:10.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2897755136 bytes 2021-11-18T10:34:10.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2946720768 bytes 2021-11-18T10:34:10.526 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3006992384 bytes 2021-11-18T10:34:10.625 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3029125120 bytes 2021-11-18T10:34:10.731 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3079624704 bytes 2021-11-18T10:34:10.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3150374912 bytes 2021-11-18T10:34:10.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3152313344 bytes 2021-11-18T10:34:10.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3167594496 bytes 2021-11-18T10:34:11.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3182701568 bytes 2021-11-18T10:34:11.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3224582144 bytes 2021-11-18T10:34:11.277 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3278158848 bytes 2021-11-18T10:34:11.354 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3296157696 bytes 2021-11-18T10:34:11.437 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3316035584 bytes 2021-11-18T10:34:11.511 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3340483584 bytes 2021-11-18T10:34:11.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3389489152 bytes 2021-11-18T10:34:11.748 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3445366784 bytes 2021-11-18T10:34:11.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3459949568 bytes 2021-11-18T10:34:11.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3535790080 bytes 2021-11-18T10:34:12.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3581064192 bytes 2021-11-18T10:34:12.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3628774400 bytes 2021-11-18T10:34:12.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3649644544 bytes 2021-11-18T10:34:12.337 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3679392768 bytes 2021-11-18T10:34:12.497 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3774565376 bytes 2021-11-18T10:34:12.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3837481984 bytes 2021-11-18T10:34:12.740 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3905307648 bytes 2021-11-18T10:34:12.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3905925120 bytes 2021-11-18T10:34:12.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3952100352 bytes 2021-11-18T10:34:13.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3975806976 bytes 2021-11-18T10:34:13.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 4023208960 bytes 2021-11-18T10:34:13.207 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4071023616 bytes 2021-11-18T10:34:13.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4129000448 bytes 2021-11-18T10:34:13.405 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4146186240 bytes 2021-11-18T10:34:13.529 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4224874496 bytes 2021-11-18T10:34:13.677 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4303907840 bytes 2021-11-18T10:34:13.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4381024256 bytes 2021-11-18T10:34:13.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4455066624 bytes 2021-11-18T10:34:14.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4505802752 bytes 2021-11-18T10:34:14.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:34:14.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:34:14.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:34:14.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:34:14.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:34:14.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_12 2021-11-18T10:34:14.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_12 snapshot 128M 2021-11-18T10:34:14.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:14.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:14.096 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:14.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:14.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_12 2021-11-18T10:34:14.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:14.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:14.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:34:14.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:14.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_12 128M 2021-11-18T10:34:14.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:14.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:14.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:14.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:14.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_12 2021-11-18T10:34:14.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:14.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:34:14.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:34:14.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:34:14.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:14.101 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_12 2021-11-18T10:34:14.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:34:14.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_12 snapshot 2021-11-18T10:34:14.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:14.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:14.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_12 2021-11-18T10:34:14.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:14.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_12 snapshot 2021-11-18T10:34:15.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:34:15.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_12 2021-11-18T10:34:15.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_12': 2021-11-18T10:34:15.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:34:15.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:34:15.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:34:15.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 130540c323c8 2021-11-18T10:34:15.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.130540c323c8 2021-11-18T10:34:15.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:34:15.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:34:15.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:34:15.124 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:34:15.124 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:34:14 2021 2021-11-18T10:34:15.124 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:34:14 2021 2021-11-18T10:34:15.124 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:34:14 2021 2021-11-18T10:34:15.124 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:34:15.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:34:15.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 9b44fc73-6234-471a-a199-acdb0f5143bc 2021-11-18T10:34:15.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:34:15.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:34:15.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_12 2021-11-18T10:34:15.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:15.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:15.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_12 2021-11-18T10:34:15.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:34:15.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=14 2021-11-18T10:34:15.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:34:15.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 14s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_12 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:34:15.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 32261120 bytes 2021-11-18T10:34:15.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 133995520 bytes 2021-11-18T10:34:15.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 138681344 bytes 2021-11-18T10:34:15.518 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 141087744 bytes 2021-11-18T10:34:15.622 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 190655488 bytes 2021-11-18T10:34:15.710 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 238543872 bytes 2021-11-18T10:34:15.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 269175808 bytes 2021-11-18T10:34:15.953 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 338781184 bytes 2021-11-18T10:34:16.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 367827968 bytes 2021-11-18T10:34:16.136 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 407642112 bytes 2021-11-18T10:34:16.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 472710144 bytes 2021-11-18T10:34:16.342 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 497112064 bytes 2021-11-18T10:34:16.375 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.8927050708587024) > weight (0.25) 2021-11-18T10:34:16.376 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.8031077322512293) > weight (0.25) 2021-11-18T10:34:16.376 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.2 2021-11-18T10:34:16.377 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Sent signal 15 2021-11-18T10:34:16.378 INFO:tasks.rbd_mirror_thrash:waiting for 6 secs before reviving daemons 2021-11-18T10:34:16.379 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.gibba019.stderr:2021-11-18T10:34:16.380+0000 7faf2a03e700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 (PID: 42914) UID: 1000 2021-11-18T10:34:16.442 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 543374336 bytes 2021-11-18T10:34:16.548 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 577792000 bytes 2021-11-18T10:34:16.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.2.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:34:16.625 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 614614016 bytes 2021-11-18T10:34:16.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 686337024 bytes 2021-11-18T10:34:16.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 704933888 bytes 2021-11-18T10:34:16.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 751757312 bytes 2021-11-18T10:34:17.057 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 810137600 bytes 2021-11-18T10:34:17.119 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 827406336 bytes 2021-11-18T10:34:17.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 866421760 bytes 2021-11-18T10:34:17.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 892071936 bytes 2021-11-18T10:34:17.386 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 908991488 bytes 2021-11-18T10:34:17.466 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 927081472 bytes 2021-11-18T10:34:17.557 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 953955328 bytes 2021-11-18T10:34:17.644 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 986991616 bytes 2021-11-18T10:34:17.722 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1025854464 bytes 2021-11-18T10:34:17.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1087456256 bytes 2021-11-18T10:34:17.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1115883520 bytes 2021-11-18T10:34:18.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1147864064 bytes 2021-11-18T10:34:18.146 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1195995136 bytes 2021-11-18T10:34:18.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1198642176 bytes 2021-11-18T10:34:18.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1243611136 bytes 2021-11-18T10:34:18.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1250859008 bytes 2021-11-18T10:34:18.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1263954944 bytes 2021-11-18T10:34:18.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1376138240 bytes 2021-11-18T10:34:18.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1475487744 bytes 2021-11-18T10:34:18.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1509028864 bytes 2021-11-18T10:34:18.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1526589440 bytes 2021-11-18T10:34:19.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1539654656 bytes 2021-11-18T10:34:19.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1588492288 bytes 2021-11-18T10:34:19.235 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1618952192 bytes 2021-11-18T10:34:19.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1619558400 bytes 2021-11-18T10:34:19.396 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1656753152 bytes 2021-11-18T10:34:19.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1751187456 bytes 2021-11-18T10:34:19.660 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1798081536 bytes 2021-11-18T10:34:19.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1847123968 bytes 2021-11-18T10:34:19.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1883333632 bytes 2021-11-18T10:34:19.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1952463872 bytes 2021-11-18T10:34:20.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 1973816320 bytes 2021-11-18T10:34:20.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2019398656 bytes 2021-11-18T10:34:20.264 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2051600384 bytes 2021-11-18T10:34:20.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2102639616 bytes 2021-11-18T10:34:20.527 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2177597440 bytes 2021-11-18T10:34:20.635 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2231297024 bytes 2021-11-18T10:34:20.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2287613952 bytes 2021-11-18T10:34:20.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2288216064 bytes 2021-11-18T10:34:20.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2318017536 bytes 2021-11-18T10:34:21.046 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2370809856 bytes 2021-11-18T10:34:21.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2434947072 bytes 2021-11-18T10:34:21.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2449240064 bytes 2021-11-18T10:34:21.373 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2488972288 bytes 2021-11-18T10:34:21.454 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2503038976 bytes 2021-11-18T10:34:21.642 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2646990848 bytes 2021-11-18T10:34:21.796 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2714087424 bytes 2021-11-18T10:34:21.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2801435648 bytes 2021-11-18T10:34:22.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2821260288 bytes 2021-11-18T10:34:22.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2839822336 bytes 2021-11-18T10:34:22.206 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2860442624 bytes 2021-11-18T10:34:22.322 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2912262144 bytes 2021-11-18T10:34:22.379 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.2 2021-11-18T10:34:22.379 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:34:22.380 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:34:22.380 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.2 2021-11-18T10:34:22.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Restarting daemon 2021-11-18T10:34:22.381 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.2 2021-11-18T10:34:22.384 INFO:tasks.rbd_mirror.cluster1.client.mirror.2:Started 2021-11-18T10:34:22.385 INFO:tasks.rbd_mirror_thrash:waiting for 73 secs before thrashing 2021-11-18T10:34:22.449 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2961293312 bytes 2021-11-18T10:34:22.550 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2993682432 bytes 2021-11-18T10:34:22.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3071184896 bytes 2021-11-18T10:34:22.776 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3088145408 bytes 2021-11-18T10:34:22.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3097888768 bytes 2021-11-18T10:34:22.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3145524224 bytes 2021-11-18T10:34:23.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3195507712 bytes 2021-11-18T10:34:23.150 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3196125184 bytes 2021-11-18T10:34:23.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3306236928 bytes 2021-11-18T10:34:23.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3343574016 bytes 2021-11-18T10:34:23.522 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3368982528 bytes 2021-11-18T10:34:23.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3428082688 bytes 2021-11-18T10:34:23.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3469523968 bytes 2021-11-18T10:34:23.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3489233920 bytes 2021-11-18T10:34:23.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3524003840 bytes 2021-11-18T10:34:24.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3584163840 bytes 2021-11-18T10:34:24.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3649013760 bytes 2021-11-18T10:34:24.279 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3669218304 bytes 2021-11-18T10:34:24.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3720071168 bytes 2021-11-18T10:34:24.511 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3766605824 bytes 2021-11-18T10:34:24.594 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3782553600 bytes 2021-11-18T10:34:24.675 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3803048960 bytes 2021-11-18T10:34:24.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3837253632 bytes 2021-11-18T10:34:24.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3882560512 bytes 2021-11-18T10:34:25.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3939121152 bytes 2021-11-18T10:34:25.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3958038528 bytes 2021-11-18T10:34:25.205 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 3983346688 bytes 2021-11-18T10:34:25.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4016080896 bytes 2021-11-18T10:34:25.436 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4070100992 bytes 2021-11-18T10:34:25.531 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4102148096 bytes 2021-11-18T10:34:25.653 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4162486272 bytes 2021-11-18T10:34:25.744 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4185140224 bytes 2021-11-18T10:34:25.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4252049408 bytes 2021-11-18T10:34:25.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4281504768 bytes 2021-11-18T10:34:26.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4315888640 bytes 2021-11-18T10:34:26.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4354310144 bytes 2021-11-18T10:34:26.275 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4395216896 bytes 2021-11-18T10:34:26.345 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4403887104 bytes 2021-11-18T10:34:26.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4414866432 bytes 2021-11-18T10:34:26.551 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4473643008 bytes 2021-11-18T10:34:26.662 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4511987712 bytes 2021-11-18T10:34:26.812 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4599891968 bytes 2021-11-18T10:34:26.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4618953728 bytes 2021-11-18T10:34:27.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4691909632 bytes 2021-11-18T10:34:27.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4727815168 bytes 2021-11-18T10:34:27.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4728428544 bytes 2021-11-18T10:34:27.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 4759974912 bytes 2021-11-18T10:34:27.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 4787400704 bytes 2021-11-18T10:34:27.525 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 4824755200 bytes 2021-11-18T10:34:27.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 4948472832 bytes 2021-11-18T10:34:27.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 4975116288 bytes 2021-11-18T10:34:27.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 4987859968 bytes 2021-11-18T10:34:27.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 4993128448 bytes 2021-11-18T10:34:28.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 5006355456 bytes 2021-11-18T10:34:28.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12500 IOs, 5049533440 bytes 2021-11-18T10:34:28.275 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12600 IOs, 5103938560 bytes 2021-11-18T10:34:28.349 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12700 IOs, 5104558080 bytes 2021-11-18T10:34:28.467 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12800 IOs, 5176675328 bytes 2021-11-18T10:34:28.567 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12900 IOs, 5192076288 bytes 2021-11-18T10:34:28.711 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13000 IOs, 5265245184 bytes 2021-11-18T10:34:28.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13100 IOs, 5321014272 bytes 2021-11-18T10:34:28.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13200 IOs, 5362795520 bytes 2021-11-18T10:34:29.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13300 IOs, 5364998144 bytes 2021-11-18T10:34:29.119 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13400 IOs, 5399444480 bytes 2021-11-18T10:34:29.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:34:29.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:34:29.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:34:29.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:34:29.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:34:29.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_13 2021-11-18T10:34:29.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_13 snapshot 128M 2021-11-18T10:34:29.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:29.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:29.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:29.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:29.133 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_13 2021-11-18T10:34:29.133 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:29.133 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:29.134 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:34:29.134 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:29.134 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_13 128M 2021-11-18T10:34:29.134 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:29.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:29.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:29.136 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:29.136 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_13 2021-11-18T10:34:29.136 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:29.137 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:34:29.137 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:34:29.137 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:34:29.137 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:29.138 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_13 2021-11-18T10:34:29.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:34:29.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_13 snapshot 2021-11-18T10:34:29.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:29.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:29.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_13 2021-11-18T10:34:29.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:29.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_13 snapshot 2021-11-18T10:34:30.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:34:30.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_13 2021-11-18T10:34:30.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_13': 2021-11-18T10:34:30.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:34:30.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:34:30.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:34:30.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 1317dc31b03d 2021-11-18T10:34:30.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.1317dc31b03d 2021-11-18T10:34:30.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:34:30.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:34:30.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:34:30.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:34:30.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:34:29 2021 2021-11-18T10:34:30.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:34:29 2021 2021-11-18T10:34:30.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:34:29 2021 2021-11-18T10:34:30.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:34:30.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:34:30.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 091b4dc9-8488-4c49-b994-2e37628f9686 2021-11-18T10:34:30.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:34:30.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:34:30.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_13 2021-11-18T10:34:30.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:30.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:30.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_13 2021-11-18T10:34:30.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:34:30.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=8 2021-11-18T10:34:30.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:34:30.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 8s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_13 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:34:30.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 64818176 bytes 2021-11-18T10:34:30.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 78627840 bytes 2021-11-18T10:34:30.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 126650368 bytes 2021-11-18T10:34:30.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 141235200 bytes 2021-11-18T10:34:30.660 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 163939328 bytes 2021-11-18T10:34:30.741 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 189209600 bytes 2021-11-18T10:34:30.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 218357760 bytes 2021-11-18T10:34:30.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 238941184 bytes 2021-11-18T10:34:31.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 312685568 bytes 2021-11-18T10:34:31.206 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 397484032 bytes 2021-11-18T10:34:31.343 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 481933312 bytes 2021-11-18T10:34:31.432 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 512198656 bytes 2021-11-18T10:34:31.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 585027584 bytes 2021-11-18T10:34:31.690 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 637571072 bytes 2021-11-18T10:34:31.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 649843712 bytes 2021-11-18T10:34:31.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 663766016 bytes 2021-11-18T10:34:31.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 708395008 bytes 2021-11-18T10:34:32.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 734041088 bytes 2021-11-18T10:34:32.136 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 771141632 bytes 2021-11-18T10:34:32.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 798695424 bytes 2021-11-18T10:34:32.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 816780288 bytes 2021-11-18T10:34:32.383 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 828420096 bytes 2021-11-18T10:34:32.504 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 905443328 bytes 2021-11-18T10:34:32.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 917366784 bytes 2021-11-18T10:34:32.682 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 947340288 bytes 2021-11-18T10:34:32.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1038925824 bytes 2021-11-18T10:34:32.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1039560704 bytes 2021-11-18T10:34:33.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1144445952 bytes 2021-11-18T10:34:33.137 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1155757056 bytes 2021-11-18T10:34:33.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1199209472 bytes 2021-11-18T10:34:33.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1203715072 bytes 2021-11-18T10:34:33.429 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1254046720 bytes 2021-11-18T10:34:33.509 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1268170752 bytes 2021-11-18T10:34:33.591 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1286460416 bytes 2021-11-18T10:34:33.676 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1308403712 bytes 2021-11-18T10:34:33.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1368690688 bytes 2021-11-18T10:34:34.059 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1423429632 bytes 2021-11-18T10:34:34.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1466337280 bytes 2021-11-18T10:34:34.141 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1521613824 bytes 2021-11-18T10:34:34.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1552503808 bytes 2021-11-18T10:34:34.332 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1583039488 bytes 2021-11-18T10:34:34.429 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1621874688 bytes 2021-11-18T10:34:34.516 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1627154432 bytes 2021-11-18T10:34:34.600 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1641451520 bytes 2021-11-18T10:34:34.685 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1665756160 bytes 2021-11-18T10:34:34.774 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1689348096 bytes 2021-11-18T10:34:34.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1733075968 bytes 2021-11-18T10:34:35.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1829778432 bytes 2021-11-18T10:34:35.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1885156352 bytes 2021-11-18T10:34:35.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 1958925312 bytes 2021-11-18T10:34:35.503 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2009784320 bytes 2021-11-18T10:34:35.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2028569600 bytes 2021-11-18T10:34:35.659 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2054205440 bytes 2021-11-18T10:34:35.759 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2080614400 bytes 2021-11-18T10:34:35.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2101097472 bytes 2021-11-18T10:34:35.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2118520832 bytes 2021-11-18T10:34:36.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2139696128 bytes 2021-11-18T10:34:36.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2189442048 bytes 2021-11-18T10:34:36.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2303101952 bytes 2021-11-18T10:34:36.594 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.6812319468758641) > weight (0.25) 2021-11-18T10:34:36.595 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2021-11-18T10:34:36.596 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2021-11-18T10:34:36.596 INFO:tasks.rbd_mirror_thrash:waiting for 4 secs before reviving daemons 2021-11-18T10:34:36.597 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:2021-11-18T10:34:36.599+0000 7fb4df7f8700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 46164) UID: 1000 2021-11-18T10:34:36.619 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2352665600 bytes 2021-11-18T10:34:36.640 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:34:36.642+0000 7fc5ccfe3700 -1 reset not still connected to 0x561975c90f70 2021-11-18T10:34:36.725 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2387660800 bytes 2021-11-18T10:34:36.797 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:34:36.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2426314752 bytes 2021-11-18T10:34:36.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2464446464 bytes 2021-11-18T10:34:37.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2529778688 bytes 2021-11-18T10:34:37.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2551682048 bytes 2021-11-18T10:34:37.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2568710144 bytes 2021-11-18T10:34:37.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2662450176 bytes 2021-11-18T10:34:37.502 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2706502656 bytes 2021-11-18T10:34:37.607 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2747806720 bytes 2021-11-18T10:34:37.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2777541632 bytes 2021-11-18T10:34:37.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2813673472 bytes 2021-11-18T10:34:37.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2815753216 bytes 2021-11-18T10:34:37.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2833593344 bytes 2021-11-18T10:34:38.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2853657600 bytes 2021-11-18T10:34:38.120 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 2870857728 bytes 2021-11-18T10:34:38.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:34:38.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:34:38.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:34:38.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:34:38.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:34:38.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_14 2021-11-18T10:34:38.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_14 snapshot 128M 2021-11-18T10:34:38.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:38.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:38.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:38.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:38.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_14 2021-11-18T10:34:38.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:38.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:38.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:34:38.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:38.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_14 128M 2021-11-18T10:34:38.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:38.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:38.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:38.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:38.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_14 2021-11-18T10:34:38.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:38.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:34:38.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:34:38.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:34:38.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:38.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_14 2021-11-18T10:34:38.200 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:34:38.201 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_14 snapshot 2021-11-18T10:34:38.201 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:38.201 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:38.201 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_14 2021-11-18T10:34:38.202 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:38.202 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_14 snapshot 2021-11-18T10:34:39.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:34:39.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_14 2021-11-18T10:34:39.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_14': 2021-11-18T10:34:39.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:34:39.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:34:39.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:34:39.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 1323e37ba75b 2021-11-18T10:34:39.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.1323e37ba75b 2021-11-18T10:34:39.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:34:39.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:34:39.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:34:39.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:34:39.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:34:38 2021 2021-11-18T10:34:39.187 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:34:38 2021 2021-11-18T10:34:39.187 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:34:38 2021 2021-11-18T10:34:39.187 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:34:39.187 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:34:39.187 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: c5145030-d3fd-4f57-a3da-5f2cb13f79a5 2021-11-18T10:34:39.188 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:34:39.189 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:34:39.189 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_14 2021-11-18T10:34:39.189 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:39.189 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:39.190 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_14 2021-11-18T10:34:39.190 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:34:39.190 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=8 2021-11-18T10:34:39.190 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:34:39.191 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 8s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_14 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:34:39.297 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 22974464 bytes 2021-11-18T10:34:39.405 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 73507840 bytes 2021-11-18T10:34:39.486 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 95861760 bytes 2021-11-18T10:34:39.551 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 106207232 bytes 2021-11-18T10:34:39.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 132670464 bytes 2021-11-18T10:34:39.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 178686976 bytes 2021-11-18T10:34:39.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 200159232 bytes 2021-11-18T10:34:39.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 274314240 bytes 2021-11-18T10:34:40.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 303264768 bytes 2021-11-18T10:34:40.108 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 335930368 bytes 2021-11-18T10:34:40.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 356815872 bytes 2021-11-18T10:34:40.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 365747200 bytes 2021-11-18T10:34:40.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 386444288 bytes 2021-11-18T10:34:40.403 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 407012352 bytes 2021-11-18T10:34:40.589 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 534935552 bytes 2021-11-18T10:34:40.597 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2021-11-18T10:34:40.597 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:34:40.598 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:34:40.598 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2021-11-18T10:34:40.598 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2021-11-18T10:34:40.599 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2021-11-18T10:34:40.601 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2021-11-18T10:34:40.601 INFO:tasks.rbd_mirror_thrash:waiting for 106 secs before thrashing 2021-11-18T10:34:40.696 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 590115840 bytes 2021-11-18T10:34:40.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 666076160 bytes 2021-11-18T10:34:40.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 719271936 bytes 2021-11-18T10:34:41.145 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 856705024 bytes 2021-11-18T10:34:41.268 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 921890816 bytes 2021-11-18T10:34:41.373 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 968889344 bytes 2021-11-18T10:34:41.466 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 1006471168 bytes 2021-11-18T10:34:41.591 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1068463104 bytes 2021-11-18T10:34:41.690 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1117873152 bytes 2021-11-18T10:34:41.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1143619584 bytes 2021-11-18T10:34:41.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1158850560 bytes 2021-11-18T10:34:42.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1271532544 bytes 2021-11-18T10:34:42.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1318025216 bytes 2021-11-18T10:34:42.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1345654784 bytes 2021-11-18T10:34:42.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1389531136 bytes 2021-11-18T10:34:42.431 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1442318336 bytes 2021-11-18T10:34:42.541 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1501990912 bytes 2021-11-18T10:34:42.679 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1571947520 bytes 2021-11-18T10:34:42.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1637023744 bytes 2021-11-18T10:34:42.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1691000832 bytes 2021-11-18T10:34:43.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1749523456 bytes 2021-11-18T10:34:43.113 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1771304960 bytes 2021-11-18T10:34:43.204 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1805065216 bytes 2021-11-18T10:34:43.304 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1849987072 bytes 2021-11-18T10:34:43.405 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1890827264 bytes 2021-11-18T10:34:43.519 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1965277184 bytes 2021-11-18T10:34:43.636 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 2014910464 bytes 2021-11-18T10:34:43.725 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 2052388864 bytes 2021-11-18T10:34:43.835 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 2084411392 bytes 2021-11-18T10:34:43.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 2116827136 bytes 2021-11-18T10:34:44.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2144906240 bytes 2021-11-18T10:34:44.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2154190848 bytes 2021-11-18T10:34:44.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2187124736 bytes 2021-11-18T10:34:44.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2218368000 bytes 2021-11-18T10:34:44.349 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2243639296 bytes 2021-11-18T10:34:44.445 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2300695552 bytes 2021-11-18T10:34:44.540 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2317633536 bytes 2021-11-18T10:34:44.614 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2346223616 bytes 2021-11-18T10:34:44.685 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2346864640 bytes 2021-11-18T10:34:44.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2448831488 bytes 2021-11-18T10:34:44.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2476176384 bytes 2021-11-18T10:34:45.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2532603904 bytes 2021-11-18T10:34:45.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2553427968 bytes 2021-11-18T10:34:45.234 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2598560768 bytes 2021-11-18T10:34:45.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2648396800 bytes 2021-11-18T10:34:45.450 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2705737728 bytes 2021-11-18T10:34:45.559 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2768724992 bytes 2021-11-18T10:34:45.684 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2817729536 bytes 2021-11-18T10:34:45.822 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2901353472 bytes 2021-11-18T10:34:45.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2960299008 bytes 2021-11-18T10:34:46.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2994568192 bytes 2021-11-18T10:34:46.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 3060400128 bytes 2021-11-18T10:34:46.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 3061016576 bytes 2021-11-18T10:34:46.344 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 3116989440 bytes 2021-11-18T10:34:46.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 3144821760 bytes 2021-11-18T10:34:46.512 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3170421760 bytes 2021-11-18T10:34:46.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3226980352 bytes 2021-11-18T10:34:46.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3310844928 bytes 2021-11-18T10:34:46.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3327508480 bytes 2021-11-18T10:34:46.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3351143424 bytes 2021-11-18T10:34:47.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3402828800 bytes 2021-11-18T10:34:47.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3420890112 bytes 2021-11-18T10:34:47.190 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:34:47.190 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:34:47.191 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:34:47.191 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:34:47.191 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:34:47.191 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_15 2021-11-18T10:34:47.192 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_15 snapshot 128M 2021-11-18T10:34:47.192 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:47.192 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:47.192 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:47.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:47.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_15 2021-11-18T10:34:47.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:47.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:47.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:34:47.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:47.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_15 128M 2021-11-18T10:34:47.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:47.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:47.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:47.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:47.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_15 2021-11-18T10:34:47.196 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:47.196 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:34:47.196 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:34:47.196 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:34:47.197 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:47.197 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_15 2021-11-18T10:34:47.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:34:47.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_15 snapshot 2021-11-18T10:34:47.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:47.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:47.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_15 2021-11-18T10:34:47.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:47.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_15 snapshot 2021-11-18T10:34:48.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:34:48.188 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_15 2021-11-18T10:34:48.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_15': 2021-11-18T10:34:48.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:34:48.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:34:48.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:34:48.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 13384ffab06c 2021-11-18T10:34:48.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.13384ffab06c 2021-11-18T10:34:48.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:34:48.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:34:48.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:34:48.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:34:48.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:34:47 2021 2021-11-18T10:34:48.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:34:47 2021 2021-11-18T10:34:48.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:34:47 2021 2021-11-18T10:34:48.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:34:48.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:34:48.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 0599ffbd-5690-4865-8b6f-f4a945bac97d 2021-11-18T10:34:48.220 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:34:48.221 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:34:48.221 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_15 2021-11-18T10:34:48.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:48.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:48.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_15 2021-11-18T10:34:48.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:34:48.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=9 2021-11-18T10:34:48.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:34:48.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 9s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_15 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:34:48.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 21829632 bytes 2021-11-18T10:34:48.432 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 59866112 bytes 2021-11-18T10:34:48.522 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 94465024 bytes 2021-11-18T10:34:48.590 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 110458880 bytes 2021-11-18T10:34:48.683 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 133975040 bytes 2021-11-18T10:34:48.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 172553216 bytes 2021-11-18T10:34:48.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 221748224 bytes 2021-11-18T10:34:48.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 264019968 bytes 2021-11-18T10:34:49.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 276207616 bytes 2021-11-18T10:34:49.137 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 306913280 bytes 2021-11-18T10:34:49.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 355794944 bytes 2021-11-18T10:34:49.383 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 428354560 bytes 2021-11-18T10:34:49.500 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 481697792 bytes 2021-11-18T10:34:49.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 495497216 bytes 2021-11-18T10:34:49.642 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 496107520 bytes 2021-11-18T10:34:49.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 586568704 bytes 2021-11-18T10:34:49.876 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 604242944 bytes 2021-11-18T10:34:49.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 626221056 bytes 2021-11-18T10:34:50.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 726258688 bytes 2021-11-18T10:34:50.239 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 790484992 bytes 2021-11-18T10:34:50.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 820315136 bytes 2021-11-18T10:34:50.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 828689408 bytes 2021-11-18T10:34:50.507 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 875930624 bytes 2021-11-18T10:34:50.605 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 920323072 bytes 2021-11-18T10:34:50.722 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 971016192 bytes 2021-11-18T10:34:50.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1002441728 bytes 2021-11-18T10:34:50.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1033697280 bytes 2021-11-18T10:34:51.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1073137664 bytes 2021-11-18T10:34:51.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1171813376 bytes 2021-11-18T10:34:51.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1186162688 bytes 2021-11-18T10:34:51.352 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1225083904 bytes 2021-11-18T10:34:51.418 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1228150784 bytes 2021-11-18T10:34:51.540 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1334542336 bytes 2021-11-18T10:34:51.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1356339200 bytes 2021-11-18T10:34:51.758 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1379575808 bytes 2021-11-18T10:34:51.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1409122304 bytes 2021-11-18T10:34:51.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1423655936 bytes 2021-11-18T10:34:52.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1465934848 bytes 2021-11-18T10:34:52.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1569121280 bytes 2021-11-18T10:34:52.341 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1656186880 bytes 2021-11-18T10:34:52.408 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1656779776 bytes 2021-11-18T10:34:52.520 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1722276864 bytes 2021-11-18T10:34:52.611 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1722871808 bytes 2021-11-18T10:34:52.690 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1737000960 bytes 2021-11-18T10:34:52.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1792776192 bytes 2021-11-18T10:34:52.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1839130624 bytes 2021-11-18T10:34:52.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1860104192 bytes 2021-11-18T10:34:53.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1890554880 bytes 2021-11-18T10:34:53.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1912577024 bytes 2021-11-18T10:34:53.279 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 1957222400 bytes 2021-11-18T10:34:53.386 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2014951424 bytes 2021-11-18T10:34:53.499 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2041771008 bytes 2021-11-18T10:34:53.674 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2167859200 bytes 2021-11-18T10:34:53.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2242021376 bytes 2021-11-18T10:34:53.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2286720000 bytes 2021-11-18T10:34:54.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2308434944 bytes 2021-11-18T10:34:54.110 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2367470592 bytes 2021-11-18T10:34:54.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2413640704 bytes 2021-11-18T10:34:54.341 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2459753472 bytes 2021-11-18T10:34:54.445 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2502190080 bytes 2021-11-18T10:34:54.599 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2607774720 bytes 2021-11-18T10:34:54.667 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2628363264 bytes 2021-11-18T10:34:54.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2667815936 bytes 2021-11-18T10:34:54.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2679902208 bytes 2021-11-18T10:34:54.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2734058496 bytes 2021-11-18T10:34:54.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2745237504 bytes 2021-11-18T10:34:55.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2754567168 bytes 2021-11-18T10:34:55.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2777703424 bytes 2021-11-18T10:34:55.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2786887680 bytes 2021-11-18T10:34:55.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2797100032 bytes 2021-11-18T10:34:55.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2891672576 bytes 2021-11-18T10:34:55.503 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2971156480 bytes 2021-11-18T10:34:55.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2981165056 bytes 2021-11-18T10:34:55.631 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3003233280 bytes 2021-11-18T10:34:55.699 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3029358592 bytes 2021-11-18T10:34:55.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3086945280 bytes 2021-11-18T10:34:55.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3089534976 bytes 2021-11-18T10:34:55.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3149253632 bytes 2021-11-18T10:34:56.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3152445440 bytes 2021-11-18T10:34:56.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3177153536 bytes 2021-11-18T10:34:56.197 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3225095168 bytes 2021-11-18T10:34:56.245 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3225824256 bytes 2021-11-18T10:34:56.352 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3291747328 bytes 2021-11-18T10:34:56.513 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3395411968 bytes 2021-11-18T10:34:56.614 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3444069376 bytes 2021-11-18T10:34:56.719 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3497627648 bytes 2021-11-18T10:34:56.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3565488128 bytes 2021-11-18T10:34:56.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3589429248 bytes 2021-11-18T10:34:56.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3590048768 bytes 2021-11-18T10:34:57.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3600714752 bytes 2021-11-18T10:34:57.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3615201280 bytes 2021-11-18T10:34:57.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3661758464 bytes 2021-11-18T10:34:57.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:34:57.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:34:57.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:34:57.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:34:57.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:34:57.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_16 2021-11-18T10:34:57.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_16 snapshot 128M 2021-11-18T10:34:57.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:57.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:57.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:57.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:57.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_16 2021-11-18T10:34:57.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:57.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:57.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:34:57.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:57.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_16 128M 2021-11-18T10:34:57.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:57.230 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:57.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:57.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:57.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_16 2021-11-18T10:34:57.232 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:57.232 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:34:57.232 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:34:57.232 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:34:57.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:34:57.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_16 2021-11-18T10:34:57.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:34:57.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_16 snapshot 2021-11-18T10:34:57.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:57.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:57.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_16 2021-11-18T10:34:57.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:34:57.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_16 snapshot 2021-11-18T10:34:58.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:34:58.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_16 2021-11-18T10:34:58.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_16': 2021-11-18T10:34:58.213 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:34:58.213 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:34:58.213 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:34:58.213 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 134464f02de8 2021-11-18T10:34:58.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.134464f02de8 2021-11-18T10:34:58.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:34:58.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:34:58.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:34:58.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:34:58.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:34:57 2021 2021-11-18T10:34:58.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:34:57 2021 2021-11-18T10:34:58.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:34:57 2021 2021-11-18T10:34:58.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:34:58.216 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:34:58.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: dd684a3b-7d34-402e-b757-1dd5ceb1f3f3 2021-11-18T10:34:58.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:34:58.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:34:58.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_16 2021-11-18T10:34:58.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:34:58.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:34:58.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_16 2021-11-18T10:34:58.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:34:58.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=14 2021-11-18T10:34:58.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:34:58.220 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 14s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_16 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:34:58.294 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 624640 bytes 2021-11-18T10:34:58.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 26670080 bytes 2021-11-18T10:34:58.453 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 66832384 bytes 2021-11-18T10:34:58.560 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 129462272 bytes 2021-11-18T10:34:58.625 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 148892672 bytes 2021-11-18T10:34:58.722 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 201780224 bytes 2021-11-18T10:34:58.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 292362240 bytes 2021-11-18T10:34:58.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 347146240 bytes 2021-11-18T10:34:59.043 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 373460992 bytes 2021-11-18T10:34:59.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 452746240 bytes 2021-11-18T10:34:59.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 469043200 bytes 2021-11-18T10:34:59.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 504396800 bytes 2021-11-18T10:34:59.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 538343424 bytes 2021-11-18T10:34:59.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 582865920 bytes 2021-11-18T10:34:59.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 600714240 bytes 2021-11-18T10:34:59.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 631475200 bytes 2021-11-18T10:34:59.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 687414272 bytes 2021-11-18T10:34:59.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 692969472 bytes 2021-11-18T10:34:59.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 767176704 bytes 2021-11-18T10:34:59.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 775976960 bytes 2021-11-18T10:35:00.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 797407232 bytes 2021-11-18T10:35:00.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 816034816 bytes 2021-11-18T10:35:00.191 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 879401984 bytes 2021-11-18T10:35:00.272 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 903496704 bytes 2021-11-18T10:35:00.372 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 944808960 bytes 2021-11-18T10:35:00.439 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 969752576 bytes 2021-11-18T10:35:00.486 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 970361856 bytes 2021-11-18T10:35:00.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1015068672 bytes 2021-11-18T10:35:00.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1118360576 bytes 2021-11-18T10:35:00.794 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1127902208 bytes 2021-11-18T10:35:00.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1202766848 bytes 2021-11-18T10:35:00.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1208678400 bytes 2021-11-18T10:35:01.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1258296320 bytes 2021-11-18T10:35:01.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1261367296 bytes 2021-11-18T10:35:01.244 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1286505472 bytes 2021-11-18T10:35:01.353 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1344381952 bytes 2021-11-18T10:35:01.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1398981632 bytes 2021-11-18T10:35:01.564 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1453168640 bytes 2021-11-18T10:35:01.651 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1488792576 bytes 2021-11-18T10:35:01.698 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1489418240 bytes 2021-11-18T10:35:01.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1514542080 bytes 2021-11-18T10:35:01.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1574866944 bytes 2021-11-18T10:35:01.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1607928832 bytes 2021-11-18T10:35:02.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1680384000 bytes 2021-11-18T10:35:02.208 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1742145536 bytes 2021-11-18T10:35:02.296 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1786862592 bytes 2021-11-18T10:35:02.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1826292736 bytes 2021-11-18T10:35:02.498 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1890144256 bytes 2021-11-18T10:35:02.572 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1918918656 bytes 2021-11-18T10:35:02.682 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 1985007616 bytes 2021-11-18T10:35:02.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2014561280 bytes 2021-11-18T10:35:02.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2020375552 bytes 2021-11-18T10:35:02.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2078694400 bytes 2021-11-18T10:35:03.108 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2192833536 bytes 2021-11-18T10:35:03.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2217520128 bytes 2021-11-18T10:35:03.259 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2248134656 bytes 2021-11-18T10:35:03.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2259685376 bytes 2021-11-18T10:35:03.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2282206208 bytes 2021-11-18T10:35:03.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2301292544 bytes 2021-11-18T10:35:03.527 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2334907392 bytes 2021-11-18T10:35:03.658 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2397353984 bytes 2021-11-18T10:35:03.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2496978944 bytes 2021-11-18T10:35:03.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2516895744 bytes 2021-11-18T10:35:03.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2575666176 bytes 2021-11-18T10:35:04.058 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2613396480 bytes 2021-11-18T10:35:04.134 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2650551296 bytes 2021-11-18T10:35:04.284 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2726120448 bytes 2021-11-18T10:35:04.346 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2739454976 bytes 2021-11-18T10:35:04.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2771518464 bytes 2021-11-18T10:35:04.559 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2847193088 bytes 2021-11-18T10:35:04.634 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2867837952 bytes 2021-11-18T10:35:04.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2900874240 bytes 2021-11-18T10:35:04.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2940220416 bytes 2021-11-18T10:35:04.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2944746496 bytes 2021-11-18T10:35:04.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 2978949120 bytes 2021-11-18T10:35:05.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3051490304 bytes 2021-11-18T10:35:05.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3131814912 bytes 2021-11-18T10:35:05.278 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3157792768 bytes 2021-11-18T10:35:05.407 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3231139840 bytes 2021-11-18T10:35:05.481 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3267721216 bytes 2021-11-18T10:35:05.616 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3321041920 bytes 2021-11-18T10:35:05.692 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3342190592 bytes 2021-11-18T10:35:05.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3428783104 bytes 2021-11-18T10:35:05.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3442519040 bytes 2021-11-18T10:35:05.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3474197504 bytes 2021-11-18T10:35:06.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3493233664 bytes 2021-11-18T10:35:06.140 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3546038272 bytes 2021-11-18T10:35:06.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3575592960 bytes 2021-11-18T10:35:06.287 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3590076416 bytes 2021-11-18T10:35:06.390 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3635321856 bytes 2021-11-18T10:35:06.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3653080064 bytes 2021-11-18T10:35:06.561 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3701945344 bytes 2021-11-18T10:35:06.617 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3706951680 bytes 2021-11-18T10:35:06.730 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3764283392 bytes 2021-11-18T10:35:06.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3789754368 bytes 2021-11-18T10:35:06.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3852951552 bytes 2021-11-18T10:35:07.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 3891802112 bytes 2021-11-18T10:35:07.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 3908096000 bytes 2021-11-18T10:35:07.182 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 3958170624 bytes 2021-11-18T10:35:07.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4014725120 bytes 2021-11-18T10:35:07.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4061648896 bytes 2021-11-18T10:35:07.455 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4065972224 bytes 2021-11-18T10:35:07.525 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4086265856 bytes 2021-11-18T10:35:07.591 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4114069504 bytes 2021-11-18T10:35:07.745 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4198416384 bytes 2021-11-18T10:35:07.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4280892416 bytes 2021-11-18T10:35:07.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4294773760 bytes 2021-11-18T10:35:08.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4379382784 bytes 2021-11-18T10:35:08.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4384232448 bytes 2021-11-18T10:35:08.237 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4438632448 bytes 2021-11-18T10:35:08.342 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4478041088 bytes 2021-11-18T10:35:08.407 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4505108480 bytes 2021-11-18T10:35:08.534 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4576563200 bytes 2021-11-18T10:35:08.640 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4623107072 bytes 2021-11-18T10:35:08.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4705986560 bytes 2021-11-18T10:35:08.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4771490816 bytes 2021-11-18T10:35:08.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 4790045696 bytes 2021-11-18T10:35:09.042 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 4819528704 bytes 2021-11-18T10:35:09.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 4859052032 bytes 2021-11-18T10:35:09.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 4869343232 bytes 2021-11-18T10:35:09.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 4878110720 bytes 2021-11-18T10:35:09.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 4990230528 bytes 2021-11-18T10:35:09.562 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 5076737024 bytes 2021-11-18T10:35:09.646 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 5116043264 bytes 2021-11-18T10:35:09.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12500 IOs, 5256913920 bytes 2021-11-18T10:35:09.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12600 IOs, 5284997120 bytes 2021-11-18T10:35:10.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12700 IOs, 5338498048 bytes 2021-11-18T10:35:10.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12800 IOs, 5374162944 bytes 2021-11-18T10:35:10.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12900 IOs, 5388063744 bytes 2021-11-18T10:35:10.237 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13000 IOs, 5394452480 bytes 2021-11-18T10:35:10.349 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13100 IOs, 5451372544 bytes 2021-11-18T10:35:10.418 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13200 IOs, 5465903104 bytes 2021-11-18T10:35:10.555 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13300 IOs, 5546851328 bytes 2021-11-18T10:35:10.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13400 IOs, 5580343296 bytes 2021-11-18T10:35:10.728 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13500 IOs, 5614826496 bytes 2021-11-18T10:35:10.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13600 IOs, 5668720640 bytes 2021-11-18T10:35:10.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13700 IOs, 5706178560 bytes 2021-11-18T10:35:11.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13800 IOs, 5749511168 bytes 2021-11-18T10:35:11.112 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13900 IOs, 5778568192 bytes 2021-11-18T10:35:11.210 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14000 IOs, 5826490368 bytes 2021-11-18T10:35:11.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14100 IOs, 5952077824 bytes 2021-11-18T10:35:11.452 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14200 IOs, 5952695296 bytes 2021-11-18T10:35:11.542 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14300 IOs, 5987170304 bytes 2021-11-18T10:35:11.639 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14400 IOs, 6028618752 bytes 2021-11-18T10:35:11.753 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14500 IOs, 6090435584 bytes 2021-11-18T10:35:11.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14600 IOs, 6128228352 bytes 2021-11-18T10:35:11.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14700 IOs, 6144189440 bytes 2021-11-18T10:35:12.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14800 IOs, 6191837184 bytes 2021-11-18T10:35:12.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14900 IOs, 6251671552 bytes 2021-11-18T10:35:12.221 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:35:12.221 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:35:12.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:35:12.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:35:12.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:35:12.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_17 2021-11-18T10:35:12.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_17 snapshot 128M 2021-11-18T10:35:12.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:12.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:12.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:12.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:12.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_17 2021-11-18T10:35:12.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:12.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:12.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:35:12.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:12.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_17 128M 2021-11-18T10:35:12.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:12.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:12.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:12.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:12.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_17 2021-11-18T10:35:12.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:12.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:35:12.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:35:12.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:35:12.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:12.229 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_17 2021-11-18T10:35:12.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:35:12.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_17 snapshot 2021-11-18T10:35:12.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:12.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:12.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_17 2021-11-18T10:35:12.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:12.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_17 snapshot 2021-11-18T10:35:12.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:35:12.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_17 2021-11-18T10:35:12.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_17': 2021-11-18T10:35:12.896 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:35:12.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:35:12.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:35:12.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 1350db75eefc 2021-11-18T10:35:12.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.1350db75eefc 2021-11-18T10:35:12.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:35:12.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:35:12.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:35:12.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:35:12.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:35:12 2021 2021-11-18T10:35:12.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:35:12 2021 2021-11-18T10:35:12.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:35:12 2021 2021-11-18T10:35:12.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:35:12.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:35:12.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 2b24c850-b99c-4405-b3b7-0b3ffd9d81cf 2021-11-18T10:35:12.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:35:12.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:35:12.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_17 2021-11-18T10:35:12.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:12.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:12.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_17 2021-11-18T10:35:12.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:35:12.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=6 2021-11-18T10:35:12.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:35:12.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 6s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_17 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:35:13.058 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 83992576 bytes 2021-11-18T10:35:13.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 107943936 bytes 2021-11-18T10:35:13.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 170108928 bytes 2021-11-18T10:35:13.341 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 231179264 bytes 2021-11-18T10:35:13.487 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 339013632 bytes 2021-11-18T10:35:13.623 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 425875456 bytes 2021-11-18T10:35:13.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 456342528 bytes 2021-11-18T10:35:13.789 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 492887040 bytes 2021-11-18T10:35:13.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 573276160 bytes 2021-11-18T10:35:14.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 637586432 bytes 2021-11-18T10:35:14.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 683018240 bytes 2021-11-18T10:35:14.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 756709376 bytes 2021-11-18T10:35:14.345 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 828780544 bytes 2021-11-18T10:35:14.441 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 865141760 bytes 2021-11-18T10:35:14.549 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 926447616 bytes 2021-11-18T10:35:14.614 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 943440896 bytes 2021-11-18T10:35:14.684 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 963277824 bytes 2021-11-18T10:35:14.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 988089344 bytes 2021-11-18T10:35:14.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 1027557376 bytes 2021-11-18T10:35:14.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 1029586944 bytes 2021-11-18T10:35:14.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 1065724928 bytes 2021-11-18T10:35:15.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 1097912320 bytes 2021-11-18T10:35:15.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1151714304 bytes 2021-11-18T10:35:15.272 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1205002240 bytes 2021-11-18T10:35:15.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1214010368 bytes 2021-11-18T10:35:15.405 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1244365824 bytes 2021-11-18T10:35:15.545 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1330619392 bytes 2021-11-18T10:35:15.618 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1354451968 bytes 2021-11-18T10:35:15.745 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1430707200 bytes 2021-11-18T10:35:15.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1506825216 bytes 2021-11-18T10:35:15.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1567324160 bytes 2021-11-18T10:35:16.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1589180416 bytes 2021-11-18T10:35:16.154 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1644160000 bytes 2021-11-18T10:35:16.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1668159488 bytes 2021-11-18T10:35:16.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1707416576 bytes 2021-11-18T10:35:16.441 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1786762240 bytes 2021-11-18T10:35:16.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1870793728 bytes 2021-11-18T10:35:16.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1913520128 bytes 2021-11-18T10:35:16.733 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1936284672 bytes 2021-11-18T10:35:16.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1957995520 bytes 2021-11-18T10:35:16.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 2026119168 bytes 2021-11-18T10:35:17.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 2054245376 bytes 2021-11-18T10:35:17.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 2162968576 bytes 2021-11-18T10:35:17.286 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 2232265728 bytes 2021-11-18T10:35:17.356 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 2256342016 bytes 2021-11-18T10:35:17.434 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2287547392 bytes 2021-11-18T10:35:17.506 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2309978112 bytes 2021-11-18T10:35:17.616 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2403987456 bytes 2021-11-18T10:35:17.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2404584448 bytes 2021-11-18T10:35:17.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2474770432 bytes 2021-11-18T10:35:17.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2520635392 bytes 2021-11-18T10:35:17.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2547284992 bytes 2021-11-18T10:35:18.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2575249408 bytes 2021-11-18T10:35:18.143 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2600786944 bytes 2021-11-18T10:35:18.279 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2685025280 bytes 2021-11-18T10:35:18.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2760164352 bytes 2021-11-18T10:35:18.470 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2780662784 bytes 2021-11-18T10:35:18.528 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2788305920 bytes 2021-11-18T10:35:18.625 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2835204096 bytes 2021-11-18T10:35:18.725 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2896137216 bytes 2021-11-18T10:35:18.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2903863296 bytes 2021-11-18T10:35:18.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2932278272 bytes 2021-11-18T10:35:18.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:35:18.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:35:18.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:35:18.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:35:18.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:35:18.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_18 2021-11-18T10:35:18.909 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_18 snapshot 128M 2021-11-18T10:35:18.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:18.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:18.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:18.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:18.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_18 2021-11-18T10:35:18.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:18.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:18.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:35:18.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:18.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_18 128M 2021-11-18T10:35:18.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:18.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:18.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:18.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:18.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_18 2021-11-18T10:35:18.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:18.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:35:18.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:35:18.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:35:18.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:18.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_18 2021-11-18T10:35:18.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:35:18.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_18 snapshot 2021-11-18T10:35:18.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:18.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:18.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_18 2021-11-18T10:35:18.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:18.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_18 snapshot 2021-11-18T10:35:19.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:35:19.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_18 2021-11-18T10:35:19.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_18': 2021-11-18T10:35:19.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:35:19.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:35:19.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:35:19.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 135ceb04ed4e 2021-11-18T10:35:19.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.135ceb04ed4e 2021-11-18T10:35:19.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:35:19.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:35:19.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:35:19.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:35:19.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:35:18 2021 2021-11-18T10:35:19.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:35:18 2021 2021-11-18T10:35:19.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:35:18 2021 2021-11-18T10:35:19.926 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:35:19.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:35:19.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: ac2f10ad-e67f-4150-af1b-e21683eadc98 2021-11-18T10:35:19.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:35:19.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:35:19.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_18 2021-11-18T10:35:19.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:19.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:19.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_18 2021-11-18T10:35:19.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:35:19.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=11 2021-11-18T10:35:19.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:35:19.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 11s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_18 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:35:20.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 5028864 bytes 2021-11-18T10:35:20.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 26995712 bytes 2021-11-18T10:35:20.145 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 50135040 bytes 2021-11-18T10:35:20.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 96976896 bytes 2021-11-18T10:35:20.309 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 120600576 bytes 2021-11-18T10:35:20.403 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 175533056 bytes 2021-11-18T10:35:20.468 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 194061312 bytes 2021-11-18T10:35:20.526 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 204619776 bytes 2021-11-18T10:35:20.576 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 207837184 bytes 2021-11-18T10:35:20.655 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 249700352 bytes 2021-11-18T10:35:20.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 321248256 bytes 2021-11-18T10:35:20.858 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 347599872 bytes 2021-11-18T10:35:20.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 405293056 bytes 2021-11-18T10:35:21.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 454388736 bytes 2021-11-18T10:35:21.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 484237312 bytes 2021-11-18T10:35:21.243 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 529148928 bytes 2021-11-18T10:35:21.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 565155840 bytes 2021-11-18T10:35:21.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 600765440 bytes 2021-11-18T10:35:21.474 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 618060800 bytes 2021-11-18T10:35:21.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 631812096 bytes 2021-11-18T10:35:21.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 675340288 bytes 2021-11-18T10:35:21.686 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 683203584 bytes 2021-11-18T10:35:21.773 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 734814208 bytes 2021-11-18T10:35:21.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 759117824 bytes 2021-11-18T10:35:21.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 762984448 bytes 2021-11-18T10:35:22.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 836109312 bytes 2021-11-18T10:35:22.166 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 914055168 bytes 2021-11-18T10:35:22.242 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 939143168 bytes 2021-11-18T10:35:22.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1002801152 bytes 2021-11-18T10:35:22.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1017882624 bytes 2021-11-18T10:35:22.530 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1074290688 bytes 2021-11-18T10:35:22.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1124854784 bytes 2021-11-18T10:35:22.710 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1149587456 bytes 2021-11-18T10:35:22.794 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1184320512 bytes 2021-11-18T10:35:22.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1221806080 bytes 2021-11-18T10:35:22.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1295238144 bytes 2021-11-18T10:35:23.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1379790848 bytes 2021-11-18T10:35:23.277 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1448386560 bytes 2021-11-18T10:35:23.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1530159104 bytes 2021-11-18T10:35:23.560 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1615159296 bytes 2021-11-18T10:35:23.666 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1666546688 bytes 2021-11-18T10:35:23.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1685046272 bytes 2021-11-18T10:35:23.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1753928704 bytes 2021-11-18T10:35:23.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1754526720 bytes 2021-11-18T10:35:23.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1777966080 bytes 2021-11-18T10:35:24.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1825102848 bytes 2021-11-18T10:35:24.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1882790912 bytes 2021-11-18T10:35:24.312 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1914336256 bytes 2021-11-18T10:35:24.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1914962944 bytes 2021-11-18T10:35:24.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 1933251584 bytes 2021-11-18T10:35:24.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 1986507776 bytes 2021-11-18T10:35:25.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2053488640 bytes 2021-11-18T10:35:25.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2134107136 bytes 2021-11-18T10:35:25.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2175686656 bytes 2021-11-18T10:35:25.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2185198592 bytes 2021-11-18T10:35:25.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2233123840 bytes 2021-11-18T10:35:25.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2253472768 bytes 2021-11-18T10:35:25.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2291642368 bytes 2021-11-18T10:35:25.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2360402944 bytes 2021-11-18T10:35:25.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2391024640 bytes 2021-11-18T10:35:25.463 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2391649280 bytes 2021-11-18T10:35:25.597 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2468881408 bytes 2021-11-18T10:35:25.655 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2474165248 bytes 2021-11-18T10:35:25.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2483763200 bytes 2021-11-18T10:35:25.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2551641088 bytes 2021-11-18T10:35:25.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2587811840 bytes 2021-11-18T10:35:25.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2617093120 bytes 2021-11-18T10:35:26.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2649307136 bytes 2021-11-18T10:35:26.187 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2717008896 bytes 2021-11-18T10:35:26.291 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2755542016 bytes 2021-11-18T10:35:26.351 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2771186688 bytes 2021-11-18T10:35:26.472 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2852409344 bytes 2021-11-18T10:35:26.588 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2908470272 bytes 2021-11-18T10:35:26.680 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2957004800 bytes 2021-11-18T10:35:26.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 2982742016 bytes 2021-11-18T10:35:26.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 2989244416 bytes 2021-11-18T10:35:26.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3066255360 bytes 2021-11-18T10:35:27.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3095071744 bytes 2021-11-18T10:35:27.110 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3129883648 bytes 2021-11-18T10:35:27.187 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3153662976 bytes 2021-11-18T10:35:27.292 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3207156736 bytes 2021-11-18T10:35:27.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3230459904 bytes 2021-11-18T10:35:27.484 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3294190592 bytes 2021-11-18T10:35:27.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3315243008 bytes 2021-11-18T10:35:27.678 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3386225664 bytes 2021-11-18T10:35:27.777 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3436230656 bytes 2021-11-18T10:35:27.894 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3500277760 bytes 2021-11-18T10:35:27.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3527044096 bytes 2021-11-18T10:35:28.044 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3546055680 bytes 2021-11-18T10:35:28.145 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3592380416 bytes 2021-11-18T10:35:28.264 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3670105088 bytes 2021-11-18T10:35:28.342 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3689334784 bytes 2021-11-18T10:35:28.484 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3785869312 bytes 2021-11-18T10:35:28.565 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3786457088 bytes 2021-11-18T10:35:28.619 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3793425408 bytes 2021-11-18T10:35:28.677 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3797483520 bytes 2021-11-18T10:35:28.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 3886565376 bytes 2021-11-18T10:35:28.918 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 3927201792 bytes 2021-11-18T10:35:29.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4066762752 bytes 2021-11-18T10:35:29.210 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4117696512 bytes 2021-11-18T10:35:29.289 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4158021632 bytes 2021-11-18T10:35:29.375 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4178527232 bytes 2021-11-18T10:35:29.480 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4229381120 bytes 2021-11-18T10:35:29.537 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4238105600 bytes 2021-11-18T10:35:29.662 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4311212032 bytes 2021-11-18T10:35:29.727 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4323536896 bytes 2021-11-18T10:35:29.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4352775168 bytes 2021-11-18T10:35:29.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4360310784 bytes 2021-11-18T10:35:29.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4419733504 bytes 2021-11-18T10:35:30.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4443674624 bytes 2021-11-18T10:35:30.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4444263424 bytes 2021-11-18T10:35:30.202 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4503443456 bytes 2021-11-18T10:35:30.270 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4509145088 bytes 2021-11-18T10:35:30.348 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4540110848 bytes 2021-11-18T10:35:30.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4567236608 bytes 2021-11-18T10:35:30.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4604466176 bytes 2021-11-18T10:35:30.597 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 4638159872 bytes 2021-11-18T10:35:30.684 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 4678563840 bytes 2021-11-18T10:35:30.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 4687385600 bytes 2021-11-18T10:35:30.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 4713881600 bytes 2021-11-18T10:35:30.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 4774983680 bytes 2021-11-18T10:35:30.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:35:30.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:35:30.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:35:30.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:35:30.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:35:30.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_19 2021-11-18T10:35:30.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_19 snapshot 128M 2021-11-18T10:35:30.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:30.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:30.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:30.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:30.934 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_19 2021-11-18T10:35:30.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:30.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:30.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:35:30.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:30.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_19 128M 2021-11-18T10:35:30.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:30.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:30.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:30.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:30.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_19 2021-11-18T10:35:30.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:30.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:35:30.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:35:30.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:35:30.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:30.940 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_19 2021-11-18T10:35:30.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:35:30.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_19 snapshot 2021-11-18T10:35:30.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:30.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:30.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_19 2021-11-18T10:35:30.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:30.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_19 snapshot 2021-11-18T10:35:31.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:35:31.935 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_19 2021-11-18T10:35:31.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_19': 2021-11-18T10:35:31.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:35:31.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:35:31.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:35:31.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 13684a341e9a 2021-11-18T10:35:31.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.13684a341e9a 2021-11-18T10:35:31.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:35:31.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:35:31.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:35:31.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:35:31.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:35:30 2021 2021-11-18T10:35:31.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:35:30 2021 2021-11-18T10:35:31.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:35:30 2021 2021-11-18T10:35:31.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:35:31.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:35:31.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: b64af3b0-7009-4ff0-b47a-a3286cee1dac 2021-11-18T10:35:31.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:35:31.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:35:31.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_19 2021-11-18T10:35:31.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:31.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:31.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_19 2021-11-18T10:35:31.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:35:31.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=7 2021-11-18T10:35:31.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:35:31.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 7s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_19 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:35:32.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 22415360 bytes 2021-11-18T10:35:32.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 77990912 bytes 2021-11-18T10:35:32.282 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 148978688 bytes 2021-11-18T10:35:32.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 188563456 bytes 2021-11-18T10:35:32.444 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 214275072 bytes 2021-11-18T10:35:32.491 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 217179136 bytes 2021-11-18T10:35:32.570 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 249848832 bytes 2021-11-18T10:35:32.629 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 263847936 bytes 2021-11-18T10:35:32.682 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 271838208 bytes 2021-11-18T10:35:32.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 283474944 bytes 2021-11-18T10:35:32.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 379337728 bytes 2021-11-18T10:35:32.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 405351424 bytes 2021-11-18T10:35:33.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 463755264 bytes 2021-11-18T10:35:33.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 501557248 bytes 2021-11-18T10:35:33.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 528630784 bytes 2021-11-18T10:35:33.469 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 547110912 bytes 2021-11-18T10:35:33.550 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 583546880 bytes 2021-11-18T10:35:33.595 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 584427520 bytes 2021-11-18T10:35:33.731 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 673313792 bytes 2021-11-18T10:35:33.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 720731136 bytes 2021-11-18T10:35:33.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 744980480 bytes 2021-11-18T10:35:34.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 824672256 bytes 2021-11-18T10:35:34.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 866365440 bytes 2021-11-18T10:35:34.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 920696832 bytes 2021-11-18T10:35:34.273 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 921295872 bytes 2021-11-18T10:35:34.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 983403520 bytes 2021-11-18T10:35:34.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1079733248 bytes 2021-11-18T10:35:34.655 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1155698688 bytes 2021-11-18T10:35:34.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1164494848 bytes 2021-11-18T10:35:34.759 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1166706688 bytes 2021-11-18T10:35:34.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1180237824 bytes 2021-11-18T10:35:34.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1236593664 bytes 2021-11-18T10:35:35.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1306448896 bytes 2021-11-18T10:35:35.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1346140160 bytes 2021-11-18T10:35:35.201 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1396358144 bytes 2021-11-18T10:35:35.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1456686080 bytes 2021-11-18T10:35:35.386 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.7760165062019614) > weight (0.25) 2021-11-18T10:35:35.386 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.1 2021-11-18T10:35:35.387 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Sent signal 15 2021-11-18T10:35:35.387 INFO:tasks.rbd_mirror_thrash:waiting for 6 secs before reviving daemons 2021-11-18T10:35:35.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba019.stderr:2021-11-18T10:35:35.390+0000 7efc42c13700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 (PID: 45705) UID: 1000 2021-11-18T10:35:35.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1471456256 bytes 2021-11-18T10:35:35.468 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1519624192 bytes 2021-11-18T10:35:35.542 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1541591040 bytes 2021-11-18T10:35:35.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.1.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:35:35.617 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1564016640 bytes 2021-11-18T10:35:35.768 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1665695744 bytes 2021-11-18T10:35:35.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1680953344 bytes 2021-11-18T10:35:35.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1716828160 bytes 2021-11-18T10:35:36.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1773191168 bytes 2021-11-18T10:35:36.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1788204032 bytes 2021-11-18T10:35:36.236 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1876041728 bytes 2021-11-18T10:35:36.311 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1900362752 bytes 2021-11-18T10:35:36.417 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1954798592 bytes 2021-11-18T10:35:36.485 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1973003264 bytes 2021-11-18T10:35:36.572 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2010212352 bytes 2021-11-18T10:35:36.642 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2034200576 bytes 2021-11-18T10:35:36.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2091830272 bytes 2021-11-18T10:35:36.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2132721664 bytes 2021-11-18T10:35:36.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2164211712 bytes 2021-11-18T10:35:36.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2171790336 bytes 2021-11-18T10:35:37.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2261076992 bytes 2021-11-18T10:35:37.204 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2283492352 bytes 2021-11-18T10:35:37.277 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2311183360 bytes 2021-11-18T10:35:37.341 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2320914432 bytes 2021-11-18T10:35:37.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2337760256 bytes 2021-11-18T10:35:37.504 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2384631808 bytes 2021-11-18T10:35:37.589 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2417325056 bytes 2021-11-18T10:35:37.677 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2455702528 bytes 2021-11-18T10:35:37.754 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2481202176 bytes 2021-11-18T10:35:37.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2481836032 bytes 2021-11-18T10:35:37.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2539697152 bytes 2021-11-18T10:35:38.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2573810688 bytes 2021-11-18T10:35:38.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2628237312 bytes 2021-11-18T10:35:38.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2683713536 bytes 2021-11-18T10:35:38.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2706034688 bytes 2021-11-18T10:35:38.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2716849152 bytes 2021-11-18T10:35:38.478 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2781882368 bytes 2021-11-18T10:35:38.568 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2818727936 bytes 2021-11-18T10:35:38.645 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2837898240 bytes 2021-11-18T10:35:38.711 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 2858978304 bytes 2021-11-18T10:35:38.821 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 2913882112 bytes 2021-11-18T10:35:38.883 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 2948088832 bytes 2021-11-18T10:35:38.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:35:38.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:35:38.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:35:38.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:35:38.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:35:38.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_20 2021-11-18T10:35:38.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_20 snapshot 128M 2021-11-18T10:35:38.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:38.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:38.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:38.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:38.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_20 2021-11-18T10:35:38.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:38.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:38.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:35:38.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:38.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_20 128M 2021-11-18T10:35:38.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:38.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:38.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:38.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:38.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_20 2021-11-18T10:35:38.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:38.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:35:38.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:35:38.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:35:38.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:38.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_20 2021-11-18T10:35:39.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:35:39.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_20 snapshot 2021-11-18T10:35:39.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:39.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:39.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_20 2021-11-18T10:35:39.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:39.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_20 snapshot 2021-11-18T10:35:39.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:35:39.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_20 2021-11-18T10:35:39.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_20': 2021-11-18T10:35:39.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:35:39.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:35:39.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:35:39.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 1374dc09b862 2021-11-18T10:35:39.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.1374dc09b862 2021-11-18T10:35:39.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:35:39.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:35:39.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:35:39.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:35:39.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:35:39 2021 2021-11-18T10:35:39.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:35:39 2021 2021-11-18T10:35:39.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:35:39 2021 2021-11-18T10:35:39.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:35:39.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:35:39.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 57e24eea-3c41-4a2c-9116-0e33e33894b7 2021-11-18T10:35:39.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:35:39.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:35:39.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_20 2021-11-18T10:35:39.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:39.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:39.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_20 2021-11-18T10:35:39.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:35:39.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=8 2021-11-18T10:35:39.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:35:39.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 8s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_20 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:35:40.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 61858816 bytes 2021-11-18T10:35:40.206 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 103870464 bytes 2021-11-18T10:35:40.278 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 160612352 bytes 2021-11-18T10:35:40.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 187772928 bytes 2021-11-18T10:35:40.493 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 253554688 bytes 2021-11-18T10:35:40.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 294460416 bytes 2021-11-18T10:35:40.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 362383360 bytes 2021-11-18T10:35:40.745 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 374416384 bytes 2021-11-18T10:35:40.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 446382080 bytes 2021-11-18T10:35:41.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 553676800 bytes 2021-11-18T10:35:41.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 589747200 bytes 2021-11-18T10:35:41.238 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 672906240 bytes 2021-11-18T10:35:41.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 722095104 bytes 2021-11-18T10:35:41.388 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.1 2021-11-18T10:35:41.389 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:35:41.389 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:35:41.389 INFO:tasks.rbd_mirror_thrash:reviving cluster1.client.mirror.1 2021-11-18T10:35:41.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Restarting daemon 2021-11-18T10:35:41.390 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.1 2021-11-18T10:35:41.393 INFO:tasks.rbd_mirror.cluster1.client.mirror.1:Started 2021-11-18T10:35:41.394 INFO:tasks.rbd_mirror_thrash:waiting for 113 secs before thrashing 2021-11-18T10:35:41.410 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 756433920 bytes 2021-11-18T10:35:41.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 814050304 bytes 2021-11-18T10:35:41.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 829511680 bytes 2021-11-18T10:35:41.641 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 858486784 bytes 2021-11-18T10:35:41.751 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 899922944 bytes 2021-11-18T10:35:41.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 947043328 bytes 2021-11-18T10:35:41.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 986144768 bytes 2021-11-18T10:35:42.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 1076849664 bytes 2021-11-18T10:35:42.197 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 1151944704 bytes 2021-11-18T10:35:42.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1174141952 bytes 2021-11-18T10:35:42.338 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1202892800 bytes 2021-11-18T10:35:42.439 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1251873792 bytes 2021-11-18T10:35:42.520 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1281499136 bytes 2021-11-18T10:35:42.610 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1336583168 bytes 2021-11-18T10:35:42.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1372968960 bytes 2021-11-18T10:35:42.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1432204288 bytes 2021-11-18T10:35:42.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1465912320 bytes 2021-11-18T10:35:42.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1524749312 bytes 2021-11-18T10:35:43.111 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1594078208 bytes 2021-11-18T10:35:43.181 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1615040512 bytes 2021-11-18T10:35:43.230 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1615631360 bytes 2021-11-18T10:35:43.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1654606848 bytes 2021-11-18T10:35:43.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1655238656 bytes 2021-11-18T10:35:43.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1660708864 bytes 2021-11-18T10:35:43.540 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1741960192 bytes 2021-11-18T10:35:43.634 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1799625728 bytes 2021-11-18T10:35:43.698 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1807720448 bytes 2021-11-18T10:35:43.801 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1860533248 bytes 2021-11-18T10:35:43.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1945679872 bytes 2021-11-18T10:35:44.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 2051848192 bytes 2021-11-18T10:35:44.139 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 2078305280 bytes 2021-11-18T10:35:44.259 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 2129418240 bytes 2021-11-18T10:35:44.352 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2172006400 bytes 2021-11-18T10:35:44.417 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2188862464 bytes 2021-11-18T10:35:44.536 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2261847040 bytes 2021-11-18T10:35:44.587 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2263600128 bytes 2021-11-18T10:35:44.650 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2288553984 bytes 2021-11-18T10:35:44.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2337127424 bytes 2021-11-18T10:35:44.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2362548224 bytes 2021-11-18T10:35:44.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2456979456 bytes 2021-11-18T10:35:45.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2498787328 bytes 2021-11-18T10:35:45.141 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2528088064 bytes 2021-11-18T10:35:45.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2574209024 bytes 2021-11-18T10:35:45.343 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2647842816 bytes 2021-11-18T10:35:45.410 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2656459776 bytes 2021-11-18T10:35:45.467 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2708271104 bytes 2021-11-18T10:35:45.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2723550208 bytes 2021-11-18T10:35:45.642 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2748695552 bytes 2021-11-18T10:35:45.736 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2786960384 bytes 2021-11-18T10:35:45.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2805871616 bytes 2021-11-18T10:35:45.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2806498304 bytes 2021-11-18T10:35:45.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2878200832 bytes 2021-11-18T10:35:46.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2938166272 bytes 2021-11-18T10:35:46.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2964909056 bytes 2021-11-18T10:35:46.244 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 3003545600 bytes 2021-11-18T10:35:46.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 3093790720 bytes 2021-11-18T10:35:46.512 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 3172783104 bytes 2021-11-18T10:35:46.600 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3211296768 bytes 2021-11-18T10:35:46.730 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3296915456 bytes 2021-11-18T10:35:46.800 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3320626176 bytes 2021-11-18T10:35:46.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3344276480 bytes 2021-11-18T10:35:46.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3398780928 bytes 2021-11-18T10:35:47.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3528635392 bytes 2021-11-18T10:35:47.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3551613952 bytes 2021-11-18T10:35:47.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3606874112 bytes 2021-11-18T10:35:47.441 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3657724928 bytes 2021-11-18T10:35:47.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3698627584 bytes 2021-11-18T10:35:47.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3728138240 bytes 2021-11-18T10:35:47.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3736224768 bytes 2021-11-18T10:35:47.807 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3825979392 bytes 2021-11-18T10:35:47.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3889868800 bytes 2021-11-18T10:35:47.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:35:47.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:35:47.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:35:47.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:35:47.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:35:47.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_21 2021-11-18T10:35:47.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_21 snapshot 128M 2021-11-18T10:35:47.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:47.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:47.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:47.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:47.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_21 2021-11-18T10:35:47.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:47.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:47.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:35:47.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:47.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_21 128M 2021-11-18T10:35:47.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:47.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:47.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:47.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:47.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_21 2021-11-18T10:35:47.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:47.989 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:35:47.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:35:47.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:35:47.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:47.990 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_21 2021-11-18T10:35:48.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:35:48.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_21 snapshot 2021-11-18T10:35:48.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:48.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:48.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_21 2021-11-18T10:35:48.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:48.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_21 snapshot 2021-11-18T10:35:48.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:35:48.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_21 2021-11-18T10:35:49.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_21': 2021-11-18T10:35:49.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:35:49.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:35:49.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:35:49.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 1386329e3b59 2021-11-18T10:35:49.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.1386329e3b59 2021-11-18T10:35:49.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:35:49.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:35:49.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:35:49.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:35:49.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:35:48 2021 2021-11-18T10:35:49.012 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:35:48 2021 2021-11-18T10:35:49.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:35:48 2021 2021-11-18T10:35:49.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:35:49.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:35:49.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: bd9c0bf5-def6-42ee-a48b-f69c64577aee 2021-11-18T10:35:49.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:35:49.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:35:49.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_21 2021-11-18T10:35:49.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:49.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:49.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_21 2021-11-18T10:35:49.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:35:49.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=5 2021-11-18T10:35:49.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:35:49.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 5s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_21 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:35:49.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 55328768 bytes 2021-11-18T10:35:49.242 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 107357184 bytes 2021-11-18T10:35:49.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 193717248 bytes 2021-11-18T10:35:49.434 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 229745664 bytes 2021-11-18T10:35:49.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 266654720 bytes 2021-11-18T10:35:49.617 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 283164672 bytes 2021-11-18T10:35:49.678 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 297372672 bytes 2021-11-18T10:35:49.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 348174336 bytes 2021-11-18T10:35:49.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 429996032 bytes 2021-11-18T10:35:49.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 472845312 bytes 2021-11-18T10:35:50.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 473456640 bytes 2021-11-18T10:35:50.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 595788800 bytes 2021-11-18T10:35:50.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 600107008 bytes 2021-11-18T10:35:50.408 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 660432896 bytes 2021-11-18T10:35:50.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 732949504 bytes 2021-11-18T10:35:50.588 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 747137024 bytes 2021-11-18T10:35:50.660 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 770612224 bytes 2021-11-18T10:35:50.738 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 807849984 bytes 2021-11-18T10:35:50.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 861289472 bytes 2021-11-18T10:35:50.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 919242752 bytes 2021-11-18T10:35:51.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 941398016 bytes 2021-11-18T10:35:51.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 963988480 bytes 2021-11-18T10:35:51.181 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1009991680 bytes 2021-11-18T10:35:51.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1024941056 bytes 2021-11-18T10:35:51.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1072884736 bytes 2021-11-18T10:35:51.490 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1164446720 bytes 2021-11-18T10:35:51.551 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1179097088 bytes 2021-11-18T10:35:51.683 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1261284352 bytes 2021-11-18T10:35:51.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1288371200 bytes 2021-11-18T10:35:51.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1335780352 bytes 2021-11-18T10:35:51.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1384143872 bytes 2021-11-18T10:35:52.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1416072192 bytes 2021-11-18T10:35:52.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1429218304 bytes 2021-11-18T10:35:52.266 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1551626240 bytes 2021-11-18T10:35:52.374 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1611832320 bytes 2021-11-18T10:35:52.508 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1691536384 bytes 2021-11-18T10:35:52.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1708215296 bytes 2021-11-18T10:35:52.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1790535680 bytes 2021-11-18T10:35:52.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1831755776 bytes 2021-11-18T10:35:52.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1901076480 bytes 2021-11-18T10:35:53.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1972471808 bytes 2021-11-18T10:35:53.119 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 2008194048 bytes 2021-11-18T10:35:53.218 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 2055685120 bytes 2021-11-18T10:35:53.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 2091715584 bytes 2021-11-18T10:35:53.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 2141765632 bytes 2021-11-18T10:35:53.564 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2257596416 bytes 2021-11-18T10:35:53.697 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2355197952 bytes 2021-11-18T10:35:53.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2450800640 bytes 2021-11-18T10:35:53.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2485610496 bytes 2021-11-18T10:35:54.000 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2522980352 bytes 2021-11-18T10:35:54.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:35:54.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:35:54.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:35:54.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:35:54.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:35:54.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_22 2021-11-18T10:35:54.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_22 snapshot 128M 2021-11-18T10:35:54.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:54.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:54.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:54.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:54.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_22 2021-11-18T10:35:54.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:54.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:54.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:35:54.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:54.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_22 128M 2021-11-18T10:35:54.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:54.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:54.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:54.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:54.026 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_22 2021-11-18T10:35:54.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:54.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:35:54.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:35:54.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:35:54.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:35:54.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_22 2021-11-18T10:35:54.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:35:54.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_22 snapshot 2021-11-18T10:35:54.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:54.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:54.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_22 2021-11-18T10:35:54.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:35:54.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_22 snapshot 2021-11-18T10:35:55.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:35:55.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_22 2021-11-18T10:35:55.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_22': 2021-11-18T10:35:55.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:35:55.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:35:55.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:35:55.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 1390e8d70481 2021-11-18T10:35:55.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.1390e8d70481 2021-11-18T10:35:55.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:35:55.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:35:55.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:35:55.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:35:55.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:35:54 2021 2021-11-18T10:35:55.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:35:54 2021 2021-11-18T10:35:55.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:35:54 2021 2021-11-18T10:35:55.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:35:55.038 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:35:55.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: a95dd37a-830d-4c6a-a1d7-d10f082a2074 2021-11-18T10:35:55.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:35:55.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:35:55.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_22 2021-11-18T10:35:55.040 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:35:55.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:35:55.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_22 2021-11-18T10:35:55.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:35:55.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=13 2021-11-18T10:35:55.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:35:55.042 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 13s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_22 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:35:55.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 7925760 bytes 2021-11-18T10:35:55.220 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 70338560 bytes 2021-11-18T10:35:55.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 95139840 bytes 2021-11-18T10:35:55.482 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 188273664 bytes 2021-11-18T10:35:55.610 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 256346112 bytes 2021-11-18T10:35:55.667 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 265280512 bytes 2021-11-18T10:35:55.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 265890816 bytes 2021-11-18T10:35:55.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 298241024 bytes 2021-11-18T10:35:55.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 416707584 bytes 2021-11-18T10:35:56.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 417337344 bytes 2021-11-18T10:35:56.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 457811968 bytes 2021-11-18T10:35:56.192 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 493568000 bytes 2021-11-18T10:35:56.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 552244224 bytes 2021-11-18T10:35:56.383 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 594481152 bytes 2021-11-18T10:35:56.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 627512320 bytes 2021-11-18T10:35:56.583 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 702175232 bytes 2021-11-18T10:35:56.711 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 780053504 bytes 2021-11-18T10:35:57.011 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 821055488 bytes 2021-11-18T10:35:57.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 876832768 bytes 2021-11-18T10:35:57.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 924078080 bytes 2021-11-18T10:35:57.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 998226944 bytes 2021-11-18T10:35:57.454 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 1069434880 bytes 2021-11-18T10:35:57.520 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1090110464 bytes 2021-11-18T10:35:57.570 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1090709504 bytes 2021-11-18T10:35:57.671 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1145465856 bytes 2021-11-18T10:35:57.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1195965440 bytes 2021-11-18T10:35:57.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1219751936 bytes 2021-11-18T10:35:57.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1230082048 bytes 2021-11-18T10:35:57.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1239486464 bytes 2021-11-18T10:35:58.041 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1257285632 bytes 2021-11-18T10:35:58.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1322703872 bytes 2021-11-18T10:35:58.238 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1343351808 bytes 2021-11-18T10:35:58.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1406214144 bytes 2021-11-18T10:35:58.435 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1442198528 bytes 2021-11-18T10:35:58.518 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1477356544 bytes 2021-11-18T10:35:58.620 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1527997440 bytes 2021-11-18T10:35:58.697 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1555444736 bytes 2021-11-18T10:35:58.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1605451776 bytes 2021-11-18T10:35:58.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1650875392 bytes 2021-11-18T10:35:59.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1738189824 bytes 2021-11-18T10:35:59.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1798503424 bytes 2021-11-18T10:35:59.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1824210944 bytes 2021-11-18T10:35:59.338 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1880823808 bytes 2021-11-18T10:35:59.455 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1945766912 bytes 2021-11-18T10:35:59.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1946381312 bytes 2021-11-18T10:35:59.596 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1984481280 bytes 2021-11-18T10:35:59.646 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1991017472 bytes 2021-11-18T10:35:59.701 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1991642112 bytes 2021-11-18T10:35:59.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2031041536 bytes 2021-11-18T10:35:59.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2162010112 bytes 2021-11-18T10:36:00.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2214740992 bytes 2021-11-18T10:36:00.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2236070912 bytes 2021-11-18T10:36:00.207 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2275713024 bytes 2021-11-18T10:36:00.341 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2340006912 bytes 2021-11-18T10:36:00.472 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2393742336 bytes 2021-11-18T10:36:00.547 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2435179520 bytes 2021-11-18T10:36:00.670 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2489871360 bytes 2021-11-18T10:36:00.742 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2530609152 bytes 2021-11-18T10:36:00.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2533816320 bytes 2021-11-18T10:36:00.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2569826304 bytes 2021-11-18T10:36:00.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2605674496 bytes 2021-11-18T10:36:01.043 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2608178176 bytes 2021-11-18T10:36:01.139 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2652940288 bytes 2021-11-18T10:36:01.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2686259200 bytes 2021-11-18T10:36:01.349 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2762963968 bytes 2021-11-18T10:36:01.496 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2859734016 bytes 2021-11-18T10:36:01.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2892496896 bytes 2021-11-18T10:36:01.640 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2906927104 bytes 2021-11-18T10:36:01.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2931265536 bytes 2021-11-18T10:36:01.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 3004462080 bytes 2021-11-18T10:36:01.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3058699264 bytes 2021-11-18T10:36:02.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3158720512 bytes 2021-11-18T10:36:02.202 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3215598592 bytes 2021-11-18T10:36:02.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3293425664 bytes 2021-11-18T10:36:02.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3302062080 bytes 2021-11-18T10:36:02.507 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3373050880 bytes 2021-11-18T10:36:02.598 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3398683648 bytes 2021-11-18T10:36:02.711 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3460820992 bytes 2021-11-18T10:36:02.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3498527744 bytes 2021-11-18T10:36:02.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3502069760 bytes 2021-11-18T10:36:02.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3530262528 bytes 2021-11-18T10:36:02.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3532304384 bytes 2021-11-18T10:36:03.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3584420864 bytes 2021-11-18T10:36:03.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3619205120 bytes 2021-11-18T10:36:03.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3657136128 bytes 2021-11-18T10:36:03.365 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3717042176 bytes 2021-11-18T10:36:03.429 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3732912128 bytes 2021-11-18T10:36:03.479 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3733517312 bytes 2021-11-18T10:36:03.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3756871680 bytes 2021-11-18T10:36:03.608 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3757489152 bytes 2021-11-18T10:36:03.699 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3831951360 bytes 2021-11-18T10:36:03.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3854163968 bytes 2021-11-18T10:36:03.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3883560960 bytes 2021-11-18T10:36:03.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3896228864 bytes 2021-11-18T10:36:04.059 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3953416192 bytes 2021-11-18T10:36:04.202 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 4043527168 bytes 2021-11-18T10:36:04.275 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 4064131072 bytes 2021-11-18T10:36:04.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4064751616 bytes 2021-11-18T10:36:04.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4100355072 bytes 2021-11-18T10:36:04.464 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4105504768 bytes 2021-11-18T10:36:04.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4165203968 bytes 2021-11-18T10:36:04.628 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4186615808 bytes 2021-11-18T10:36:04.748 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4236625920 bytes 2021-11-18T10:36:04.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4287181824 bytes 2021-11-18T10:36:04.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4287787008 bytes 2021-11-18T10:36:04.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4300978176 bytes 2021-11-18T10:36:05.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4301606912 bytes 2021-11-18T10:36:05.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4355408896 bytes 2021-11-18T10:36:05.203 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4381557760 bytes 2021-11-18T10:36:05.315 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4445583360 bytes 2021-11-18T10:36:05.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4459057152 bytes 2021-11-18T10:36:05.469 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4501223424 bytes 2021-11-18T10:36:05.531 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4512135168 bytes 2021-11-18T10:36:05.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4568308736 bytes 2021-11-18T10:36:05.733 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4602896384 bytes 2021-11-18T10:36:05.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4638130176 bytes 2021-11-18T10:36:05.882 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 4669882368 bytes 2021-11-18T10:36:06.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 4724126720 bytes 2021-11-18T10:36:06.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 4791741440 bytes 2021-11-18T10:36:06.189 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 4804587520 bytes 2021-11-18T10:36:06.266 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 4828192768 bytes 2021-11-18T10:36:06.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 4841059328 bytes 2021-11-18T10:36:06.448 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 4921451520 bytes 2021-11-18T10:36:06.497 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 4922286080 bytes 2021-11-18T10:36:06.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12500 IOs, 4932083712 bytes 2021-11-18T10:36:06.607 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12600 IOs, 4943862784 bytes 2021-11-18T10:36:06.704 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12700 IOs, 4978579456 bytes 2021-11-18T10:36:06.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12800 IOs, 5032931328 bytes 2021-11-18T10:36:06.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12900 IOs, 5064833024 bytes 2021-11-18T10:36:06.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13000 IOs, 5109592064 bytes 2021-11-18T10:36:07.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13100 IOs, 5134409728 bytes 2021-11-18T10:36:07.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13200 IOs, 5150924800 bytes 2021-11-18T10:36:07.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13300 IOs, 5228766208 bytes 2021-11-18T10:36:07.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13400 IOs, 5323739136 bytes 2021-11-18T10:36:07.479 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13500 IOs, 5348262912 bytes 2021-11-18T10:36:07.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13600 IOs, 5393295360 bytes 2021-11-18T10:36:07.674 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13700 IOs, 5438596096 bytes 2021-11-18T10:36:07.738 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13800 IOs, 5454940160 bytes 2021-11-18T10:36:07.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13900 IOs, 5481513984 bytes 2021-11-18T10:36:07.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14000 IOs, 5482143744 bytes 2021-11-18T10:36:07.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14100 IOs, 5552999424 bytes 2021-11-18T10:36:08.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:36:08.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:36:08.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:36:08.046 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:36:08.046 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:36:08.046 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_23 2021-11-18T10:36:08.046 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_23 snapshot 128M 2021-11-18T10:36:08.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:08.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:08.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:08.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:08.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_23 2021-11-18T10:36:08.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:08.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:36:08.048 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:36:08.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:08.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_23 128M 2021-11-18T10:36:08.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:08.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:08.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:08.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:08.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_23 2021-11-18T10:36:08.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:08.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:36:08.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:36:08.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:36:08.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:08.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_23 2021-11-18T10:36:08.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:36:08.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_23 snapshot 2021-11-18T10:36:08.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:08.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:08.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_23 2021-11-18T10:36:08.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:36:08.079 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_23 snapshot 2021-11-18T10:36:09.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:36:09.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_23 2021-11-18T10:36:09.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_23': 2021-11-18T10:36:09.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:36:09.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:36:09.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:36:09.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 139aca621b1b 2021-11-18T10:36:09.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.139aca621b1b 2021-11-18T10:36:09.056 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:36:09.056 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:36:09.056 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:36:09.057 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:36:09.057 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:36:08 2021 2021-11-18T10:36:09.057 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:36:08 2021 2021-11-18T10:36:09.057 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:36:08 2021 2021-11-18T10:36:09.058 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:36:09.058 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:36:09.058 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 65e7d2d3-0bd0-4888-96a1-1752e1a6d5e7 2021-11-18T10:36:09.059 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:36:09.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:36:09.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_23 2021-11-18T10:36:09.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:09.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:09.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_23 2021-11-18T10:36:09.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:36:09.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=14 2021-11-18T10:36:09.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:36:09.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 14s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_23 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:36:09.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 38129664 bytes 2021-11-18T10:36:09.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 43512832 bytes 2021-11-18T10:36:09.274 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 44112896 bytes 2021-11-18T10:36:09.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 86806528 bytes 2021-11-18T10:36:09.487 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 170414080 bytes 2021-11-18T10:36:09.604 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 270633984 bytes 2021-11-18T10:36:09.685 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 294439936 bytes 2021-11-18T10:36:09.806 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 400993280 bytes 2021-11-18T10:36:09.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 425656320 bytes 2021-11-18T10:36:10.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 481861632 bytes 2021-11-18T10:36:10.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 512800768 bytes 2021-11-18T10:36:10.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 516779008 bytes 2021-11-18T10:36:10.237 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 551797760 bytes 2021-11-18T10:36:10.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 586982400 bytes 2021-11-18T10:36:10.390 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 600611840 bytes 2021-11-18T10:36:10.465 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 623101952 bytes 2021-11-18T10:36:10.598 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 703240192 bytes 2021-11-18T10:36:10.683 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 733060096 bytes 2021-11-18T10:36:10.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 733657088 bytes 2021-11-18T10:36:10.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 815555584 bytes 2021-11-18T10:36:10.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 819440640 bytes 2021-11-18T10:36:10.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 836928512 bytes 2021-11-18T10:36:11.110 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 869696512 bytes 2021-11-18T10:36:11.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 939589632 bytes 2021-11-18T10:36:11.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 981655552 bytes 2021-11-18T10:36:11.386 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1011126272 bytes 2021-11-18T10:36:11.517 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1073190912 bytes 2021-11-18T10:36:11.617 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1119608832 bytes 2021-11-18T10:36:11.692 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1138683904 bytes 2021-11-18T10:36:11.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1183235072 bytes 2021-11-18T10:36:11.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1243237376 bytes 2021-11-18T10:36:12.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1317472256 bytes 2021-11-18T10:36:12.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1365352448 bytes 2021-11-18T10:36:12.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1396628480 bytes 2021-11-18T10:36:12.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1455538176 bytes 2021-11-18T10:36:12.388 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1467587584 bytes 2021-11-18T10:36:12.471 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1496715264 bytes 2021-11-18T10:36:12.599 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1571853312 bytes 2021-11-18T10:36:12.685 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1608778752 bytes 2021-11-18T10:36:12.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1647373312 bytes 2021-11-18T10:36:12.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1726067712 bytes 2021-11-18T10:36:13.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1789635584 bytes 2021-11-18T10:36:13.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1837930496 bytes 2021-11-18T10:36:13.199 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1862014976 bytes 2021-11-18T10:36:13.282 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1907176448 bytes 2021-11-18T10:36:13.354 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1914737664 bytes 2021-11-18T10:36:13.430 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1939081216 bytes 2021-11-18T10:36:13.521 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1976542208 bytes 2021-11-18T10:36:13.636 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2036654080 bytes 2021-11-18T10:36:13.764 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2104107008 bytes 2021-11-18T10:36:13.878 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2162918400 bytes 2021-11-18T10:36:13.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2226757632 bytes 2021-11-18T10:36:14.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2269736960 bytes 2021-11-18T10:36:14.187 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2311052288 bytes 2021-11-18T10:36:14.263 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2334612480 bytes 2021-11-18T10:36:14.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2343298048 bytes 2021-11-18T10:36:14.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2374988800 bytes 2021-11-18T10:36:14.503 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2433781760 bytes 2021-11-18T10:36:14.614 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2470600704 bytes 2021-11-18T10:36:14.713 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2514824192 bytes 2021-11-18T10:36:14.811 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2570980352 bytes 2021-11-18T10:36:14.880 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2577123328 bytes 2021-11-18T10:36:14.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2581833728 bytes 2021-11-18T10:36:15.027 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2634048512 bytes 2021-11-18T10:36:15.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2689302528 bytes 2021-11-18T10:36:15.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2718828544 bytes 2021-11-18T10:36:15.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2764700672 bytes 2021-11-18T10:36:15.405 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2785376256 bytes 2021-11-18T10:36:15.465 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2800014336 bytes 2021-11-18T10:36:15.597 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2864454656 bytes 2021-11-18T10:36:15.652 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2879563776 bytes 2021-11-18T10:36:15.749 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2908232704 bytes 2021-11-18T10:36:15.816 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2927024128 bytes 2021-11-18T10:36:15.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3058172928 bytes 2021-11-18T10:36:16.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3128388608 bytes 2021-11-18T10:36:16.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3180118016 bytes 2021-11-18T10:36:16.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3233529856 bytes 2021-11-18T10:36:16.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3269133312 bytes 2021-11-18T10:36:16.524 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3310737408 bytes 2021-11-18T10:36:16.626 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3358313472 bytes 2021-11-18T10:36:16.705 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3384120320 bytes 2021-11-18T10:36:16.802 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3426973696 bytes 2021-11-18T10:36:16.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3464869888 bytes 2021-11-18T10:36:16.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3488961536 bytes 2021-11-18T10:36:17.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3498065920 bytes 2021-11-18T10:36:17.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3531664384 bytes 2021-11-18T10:36:17.191 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3559714816 bytes 2021-11-18T10:36:17.266 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3592601600 bytes 2021-11-18T10:36:17.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3663324160 bytes 2021-11-18T10:36:17.498 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3708231680 bytes 2021-11-18T10:36:17.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3776834560 bytes 2021-11-18T10:36:17.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3800394752 bytes 2021-11-18T10:36:18.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3885288448 bytes 2021-11-18T10:36:18.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3887564800 bytes 2021-11-18T10:36:18.207 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3949280256 bytes 2021-11-18T10:36:18.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3994025984 bytes 2021-11-18T10:36:18.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 3994616832 bytes 2021-11-18T10:36:18.484 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4055105536 bytes 2021-11-18T10:36:18.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4073563136 bytes 2021-11-18T10:36:18.629 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4096784384 bytes 2021-11-18T10:36:18.696 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4110547968 bytes 2021-11-18T10:36:18.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4196281344 bytes 2021-11-18T10:36:18.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4196879360 bytes 2021-11-18T10:36:18.970 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4222528512 bytes 2021-11-18T10:36:19.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4300663808 bytes 2021-11-18T10:36:19.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4371924992 bytes 2021-11-18T10:36:19.294 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4404564992 bytes 2021-11-18T10:36:19.361 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4415688704 bytes 2021-11-18T10:36:19.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4425729024 bytes 2021-11-18T10:36:19.514 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4460041216 bytes 2021-11-18T10:36:19.665 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4558059520 bytes 2021-11-18T10:36:19.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4576561152 bytes 2021-11-18T10:36:19.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4621360128 bytes 2021-11-18T10:36:19.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4621949952 bytes 2021-11-18T10:36:19.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4675994624 bytes 2021-11-18T10:36:20.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4690777088 bytes 2021-11-18T10:36:20.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 4739728384 bytes 2021-11-18T10:36:20.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 4831481856 bytes 2021-11-18T10:36:20.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 4832095232 bytes 2021-11-18T10:36:20.506 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 4927093760 bytes 2021-11-18T10:36:20.643 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 5008431104 bytes 2021-11-18T10:36:20.729 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 5042221056 bytes 2021-11-18T10:36:20.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 5055090688 bytes 2021-11-18T10:36:20.917 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 5095591936 bytes 2021-11-18T10:36:21.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12500 IOs, 5157029888 bytes 2021-11-18T10:36:21.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12600 IOs, 5209784320 bytes 2021-11-18T10:36:21.205 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12700 IOs, 5222952960 bytes 2021-11-18T10:36:21.277 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12800 IOs, 5241786368 bytes 2021-11-18T10:36:21.354 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12900 IOs, 5264862208 bytes 2021-11-18T10:36:21.479 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13000 IOs, 5331796992 bytes 2021-11-18T10:36:21.569 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13100 IOs, 5373978624 bytes 2021-11-18T10:36:21.674 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13200 IOs, 5429551104 bytes 2021-11-18T10:36:21.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13300 IOs, 5496268800 bytes 2021-11-18T10:36:21.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13400 IOs, 5562648576 bytes 2021-11-18T10:36:22.099 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13500 IOs, 5621516288 bytes 2021-11-18T10:36:22.192 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13600 IOs, 5668853760 bytes 2021-11-18T10:36:22.305 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13700 IOs, 5724315648 bytes 2021-11-18T10:36:22.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13800 IOs, 5760905216 bytes 2021-11-18T10:36:22.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13900 IOs, 5775628288 bytes 2021-11-18T10:36:22.559 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14000 IOs, 5822393344 bytes 2021-11-18T10:36:22.628 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14100 IOs, 5840031744 bytes 2021-11-18T10:36:22.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14200 IOs, 5890156544 bytes 2021-11-18T10:36:22.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14300 IOs, 5962883072 bytes 2021-11-18T10:36:22.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14400 IOs, 6021947392 bytes 2021-11-18T10:36:23.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:36:23.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:36:23.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:36:23.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:36:23.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:36:23.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_24 2021-11-18T10:36:23.067 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_24 snapshot 128M 2021-11-18T10:36:23.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:23.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:23.068 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:23.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:23.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_24 2021-11-18T10:36:23.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:23.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:36:23.069 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:36:23.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:23.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_24 128M 2021-11-18T10:36:23.070 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:23.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:23.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:23.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:23.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_24 2021-11-18T10:36:23.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:23.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:36:23.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:36:23.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:36:23.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:23.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_24 2021-11-18T10:36:23.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:36:23.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_24 snapshot 2021-11-18T10:36:23.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:23.097 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:23.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_24 2021-11-18T10:36:23.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:36:23.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_24 snapshot 2021-11-18T10:36:24.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:36:24.094 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_24 2021-11-18T10:36:24.120 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_24': 2021-11-18T10:36:24.120 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:36:24.120 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:36:24.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:36:24.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 13a5919d8c31 2021-11-18T10:36:24.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.13a5919d8c31 2021-11-18T10:36:24.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:36:24.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:36:24.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:36:24.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:36:24.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:36:23 2021 2021-11-18T10:36:24.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:36:23 2021 2021-11-18T10:36:24.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:36:23 2021 2021-11-18T10:36:24.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:36:24.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:36:24.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 4c4034c3-e30b-49ad-9427-837873f1bc7f 2021-11-18T10:36:24.124 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:36:24.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:36:24.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_24 2021-11-18T10:36:24.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:24.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:24.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_24 2021-11-18T10:36:24.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:36:24.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=10 2021-11-18T10:36:24.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:36:24.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 10s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_24 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:36:24.268 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 63142912 bytes 2021-11-18T10:36:24.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 91791360 bytes 2021-11-18T10:36:24.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 101085184 bytes 2021-11-18T10:36:24.512 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 167401472 bytes 2021-11-18T10:36:24.591 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 199140352 bytes 2021-11-18T10:36:24.642 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 200921088 bytes 2021-11-18T10:36:24.730 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 242402304 bytes 2021-11-18T10:36:24.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 265395200 bytes 2021-11-18T10:36:24.872 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 274394112 bytes 2021-11-18T10:36:24.943 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 302051328 bytes 2021-11-18T10:36:25.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 359030784 bytes 2021-11-18T10:36:25.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 409025536 bytes 2021-11-18T10:36:25.305 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 508882944 bytes 2021-11-18T10:36:25.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 515685376 bytes 2021-11-18T10:36:25.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 539796480 bytes 2021-11-18T10:36:25.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 551055360 bytes 2021-11-18T10:36:25.585 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 599034880 bytes 2021-11-18T10:36:25.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 646285312 bytes 2021-11-18T10:36:25.757 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 686060544 bytes 2021-11-18T10:36:25.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 686668800 bytes 2021-11-18T10:36:25.875 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 687284224 bytes 2021-11-18T10:36:25.979 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 749000704 bytes 2021-11-18T10:36:26.108 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 824019968 bytes 2021-11-18T10:36:26.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 863315968 bytes 2021-11-18T10:36:26.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 930571264 bytes 2021-11-18T10:36:26.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 955551744 bytes 2021-11-18T10:36:26.447 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 972964864 bytes 2021-11-18T10:36:26.535 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1010575360 bytes 2021-11-18T10:36:26.602 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.0 2021-11-18T10:36:26.603 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Sent signal 15 2021-11-18T10:36:26.603 INFO:tasks.rbd_mirror_thrash:waiting for 5 secs before reviving daemons 2021-11-18T10:36:26.604 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba019.stderr:2021-11-18T10:36:26.606+0000 7ff6afd0f700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 (PID: 48215) UID: 1000 2021-11-18T10:36:26.606 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:36:26.609+0000 7f46d0e3c700 -1 reset not still connected to 0x556efdf29110 2021-11-18T10:36:26.613 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1038116864 bytes 2021-11-18T10:36:26.720 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1088701440 bytes 2021-11-18T10:36:26.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1105792000 bytes 2021-11-18T10:36:26.804 INFO:tasks.rbd_mirror.cluster2.client.mirror.0.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:36:26.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1154703360 bytes 2021-11-18T10:36:27.025 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1219146752 bytes 2021-11-18T10:36:27.104 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1249492992 bytes 2021-11-18T10:36:27.180 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1272145920 bytes 2021-11-18T10:36:27.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1286887424 bytes 2021-11-18T10:36:27.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1372067840 bytes 2021-11-18T10:36:27.455 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1406087168 bytes 2021-11-18T10:36:27.585 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1480925184 bytes 2021-11-18T10:36:27.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1572797440 bytes 2021-11-18T10:36:27.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1621923840 bytes 2021-11-18T10:36:27.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1701266432 bytes 2021-11-18T10:36:28.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1806827520 bytes 2021-11-18T10:36:28.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1832209408 bytes 2021-11-18T10:36:28.270 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1877280768 bytes 2021-11-18T10:36:28.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1877889024 bytes 2021-11-18T10:36:28.457 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1951313920 bytes 2021-11-18T10:36:28.595 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2032842752 bytes 2021-11-18T10:36:28.684 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2058398720 bytes 2021-11-18T10:36:28.743 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2086025216 bytes 2021-11-18T10:36:28.885 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2162048000 bytes 2021-11-18T10:36:28.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2204616704 bytes 2021-11-18T10:36:29.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2242960384 bytes 2021-11-18T10:36:29.196 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2318644224 bytes 2021-11-18T10:36:29.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2362694656 bytes 2021-11-18T10:36:29.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2408646656 bytes 2021-11-18T10:36:29.496 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2455249920 bytes 2021-11-18T10:36:29.569 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2476972032 bytes 2021-11-18T10:36:29.653 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2507344896 bytes 2021-11-18T10:36:29.774 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2586793984 bytes 2021-11-18T10:36:29.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2630670336 bytes 2021-11-18T10:36:29.984 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2682953728 bytes 2021-11-18T10:36:30.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2714904576 bytes 2021-11-18T10:36:30.139 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2737325056 bytes 2021-11-18T10:36:30.284 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2833974272 bytes 2021-11-18T10:36:30.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2888728576 bytes 2021-11-18T10:36:30.456 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2909289472 bytes 2021-11-18T10:36:30.518 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2914152448 bytes 2021-11-18T10:36:30.603 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2936863744 bytes 2021-11-18T10:36:30.678 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2983274496 bytes 2021-11-18T10:36:30.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3026394112 bytes 2021-11-18T10:36:30.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3031447552 bytes 2021-11-18T10:36:30.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3084645376 bytes 2021-11-18T10:36:31.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3169174528 bytes 2021-11-18T10:36:31.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3215195136 bytes 2021-11-18T10:36:31.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3215839232 bytes 2021-11-18T10:36:31.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3237474304 bytes 2021-11-18T10:36:31.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3289994240 bytes 2021-11-18T10:36:31.511 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3340840960 bytes 2021-11-18T10:36:31.593 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3367256064 bytes 2021-11-18T10:36:31.604 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.0 2021-11-18T10:36:31.605 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:36:31.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:36:31.606 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.0 2021-11-18T10:36:31.606 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Restarting daemon 2021-11-18T10:36:31.606 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.0 2021-11-18T10:36:31.609 INFO:tasks.rbd_mirror.cluster2.client.mirror.0:Started 2021-11-18T10:36:31.609 INFO:tasks.rbd_mirror_thrash:waiting for 98 secs before thrashing 2021-11-18T10:36:31.648 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3368543232 bytes 2021-11-18T10:36:31.738 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3403826176 bytes 2021-11-18T10:36:31.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3424570368 bytes 2021-11-18T10:36:31.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3427892224 bytes 2021-11-18T10:36:31.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3471082496 bytes 2021-11-18T10:36:32.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3490504704 bytes 2021-11-18T10:36:32.144 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3555169280 bytes 2021-11-18T10:36:32.276 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3637983232 bytes 2021-11-18T10:36:32.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3685834752 bytes 2021-11-18T10:36:32.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3717108736 bytes 2021-11-18T10:36:32.544 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3749274624 bytes 2021-11-18T10:36:32.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3789477888 bytes 2021-11-18T10:36:32.747 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3858113536 bytes 2021-11-18T10:36:32.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3913791488 bytes 2021-11-18T10:36:32.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3940262912 bytes 2021-11-18T10:36:33.057 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 4009973760 bytes 2021-11-18T10:36:33.286 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 4040813568 bytes 2021-11-18T10:36:33.287 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4086472704 bytes 2021-11-18T10:36:33.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4122816512 bytes 2021-11-18T10:36:33.434 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4161341440 bytes 2021-11-18T10:36:33.514 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4178817024 bytes 2021-11-18T10:36:33.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4241892352 bytes 2021-11-18T10:36:33.687 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4242500608 bytes 2021-11-18T10:36:33.753 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4256457728 bytes 2021-11-18T10:36:33.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4348409856 bytes 2021-11-18T10:36:33.955 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4361138176 bytes 2021-11-18T10:36:34.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4399349760 bytes 2021-11-18T10:36:34.120 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4425219072 bytes 2021-11-18T10:36:34.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:36:34.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:36:34.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:36:34.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:36:34.133 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:36:34.133 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_25 2021-11-18T10:36:34.134 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_25 snapshot 128M 2021-11-18T10:36:34.134 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:34.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:34.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:34.135 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:34.136 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_25 2021-11-18T10:36:34.136 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:34.137 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:36:34.138 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:36:34.138 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:34.139 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_25 128M 2021-11-18T10:36:34.139 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:34.139 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:34.140 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:34.140 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:34.141 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_25 2021-11-18T10:36:34.141 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:34.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:36:34.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:36:34.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:36:34.143 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:34.143 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_25 2021-11-18T10:36:34.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:36:34.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_25 snapshot 2021-11-18T10:36:34.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:34.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:34.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_25 2021-11-18T10:36:34.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:36:34.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_25 snapshot 2021-11-18T10:36:35.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:36:35.134 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_25 2021-11-18T10:36:35.158 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_25': 2021-11-18T10:36:35.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:36:35.159 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:36:35.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:36:35.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 13bad6b968a3 2021-11-18T10:36:35.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.13bad6b968a3 2021-11-18T10:36:35.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:36:35.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:36:35.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:36:35.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:36:35.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:36:34 2021 2021-11-18T10:36:35.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:36:34 2021 2021-11-18T10:36:35.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:36:34 2021 2021-11-18T10:36:35.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:36:35.164 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:36:35.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: c16245cc-ff71-4144-825a-ea3833b320ce 2021-11-18T10:36:35.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:36:35.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:36:35.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_25 2021-11-18T10:36:35.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:35.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:35.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_25 2021-11-18T10:36:35.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:36:35.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=11 2021-11-18T10:36:35.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:36:35.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 11s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_25 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:36:35.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 14765056 bytes 2021-11-18T10:36:35.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 46299136 bytes 2021-11-18T10:36:35.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 92570624 bytes 2021-11-18T10:36:35.488 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 110607360 bytes 2021-11-18T10:36:35.536 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 118120448 bytes 2021-11-18T10:36:35.609 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 145144832 bytes 2021-11-18T10:36:35.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 212968448 bytes 2021-11-18T10:36:35.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 256484352 bytes 2021-11-18T10:36:35.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 301075456 bytes 2021-11-18T10:36:35.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 310791168 bytes 2021-11-18T10:36:36.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 368164864 bytes 2021-11-18T10:36:36.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 392487936 bytes 2021-11-18T10:36:36.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 416993280 bytes 2021-11-18T10:36:36.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 467074048 bytes 2021-11-18T10:36:36.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 498888704 bytes 2021-11-18T10:36:36.514 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:36:36.516+0000 7f46d0e3c700 -1 reset not still connected to 0x556ef7dabd40 2021-11-18T10:36:36.514 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:36:36.517+0000 7f46d0e3c700 -1 reset not still connected to 0x556efa6656c0 2021-11-18T10:36:36.515 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:36:36.517+0000 7f46d0e3c700 -1 reset not still connected to 0x556f0543fad0 2021-11-18T10:36:36.518 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 554432512 bytes 2021-11-18T10:36:36.587 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 573526016 bytes 2021-11-18T10:36:36.664 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 603328512 bytes 2021-11-18T10:36:36.778 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 667909120 bytes 2021-11-18T10:36:36.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 698936320 bytes 2021-11-18T10:36:36.955 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 739884032 bytes 2021-11-18T10:36:37.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 760271872 bytes 2021-11-18T10:36:37.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 836773888 bytes 2021-11-18T10:36:37.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 876896256 bytes 2021-11-18T10:36:37.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 915715072 bytes 2021-11-18T10:36:37.434 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 963812352 bytes 2021-11-18T10:36:37.529 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1008524288 bytes 2021-11-18T10:36:37.650 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1077331968 bytes 2021-11-18T10:36:37.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1125841920 bytes 2021-11-18T10:36:37.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1161420800 bytes 2021-11-18T10:36:37.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1196988416 bytes 2021-11-18T10:36:38.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1259704320 bytes 2021-11-18T10:36:38.120 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1322382336 bytes 2021-11-18T10:36:38.229 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1365903360 bytes 2021-11-18T10:36:38.289 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1379002368 bytes 2021-11-18T10:36:38.343 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1379612672 bytes 2021-11-18T10:36:38.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1438213120 bytes 2021-11-18T10:36:38.546 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1482699776 bytes 2021-11-18T10:36:38.611 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1499413504 bytes 2021-11-18T10:36:38.672 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1508592640 bytes 2021-11-18T10:36:38.747 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1534022656 bytes 2021-11-18T10:36:38.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1578916864 bytes 2021-11-18T10:36:38.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1595994112 bytes 2021-11-18T10:36:38.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1622734848 bytes 2021-11-18T10:36:39.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1699280896 bytes 2021-11-18T10:36:39.194 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1732245504 bytes 2021-11-18T10:36:39.296 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1779990528 bytes 2021-11-18T10:36:39.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1829133312 bytes 2021-11-18T10:36:39.489 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1870277632 bytes 2021-11-18T10:36:39.591 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 1917639680 bytes 2021-11-18T10:36:39.668 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 1942256640 bytes 2021-11-18T10:36:39.759 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 1980507136 bytes 2021-11-18T10:36:39.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2023329792 bytes 2021-11-18T10:36:40.032 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2148196352 bytes 2021-11-18T10:36:40.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2151270400 bytes 2021-11-18T10:36:40.139 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2153286656 bytes 2021-11-18T10:36:40.265 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2231943168 bytes 2021-11-18T10:36:40.354 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2280914944 bytes 2021-11-18T10:36:40.454 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2317644800 bytes 2021-11-18T10:36:40.504 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2323439616 bytes 2021-11-18T10:36:40.615 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2385346560 bytes 2021-11-18T10:36:40.736 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2455630848 bytes 2021-11-18T10:36:40.824 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2496053248 bytes 2021-11-18T10:36:40.927 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2558041088 bytes 2021-11-18T10:36:41.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2639459328 bytes 2021-11-18T10:36:41.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2642160640 bytes 2021-11-18T10:36:41.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2667612160 bytes 2021-11-18T10:36:41.277 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2694899712 bytes 2021-11-18T10:36:41.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2745882624 bytes 2021-11-18T10:36:41.473 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2795484160 bytes 2021-11-18T10:36:41.572 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2837711872 bytes 2021-11-18T10:36:41.652 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2887230464 bytes 2021-11-18T10:36:41.760 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2929528832 bytes 2021-11-18T10:36:41.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2954267648 bytes 2021-11-18T10:36:41.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 2955902976 bytes 2021-11-18T10:36:42.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3027043328 bytes 2021-11-18T10:36:42.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3066678272 bytes 2021-11-18T10:36:42.203 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3122769920 bytes 2021-11-18T10:36:42.296 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3159243776 bytes 2021-11-18T10:36:42.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3190762496 bytes 2021-11-18T10:36:42.519 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3287309312 bytes 2021-11-18T10:36:42.612 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3322212352 bytes 2021-11-18T10:36:42.691 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3350372352 bytes 2021-11-18T10:36:42.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3393275904 bytes 2021-11-18T10:36:42.862 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3418897408 bytes 2021-11-18T10:36:42.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3431950336 bytes 2021-11-18T10:36:43.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3509388288 bytes 2021-11-18T10:36:43.137 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3542905856 bytes 2021-11-18T10:36:43.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3600153600 bytes 2021-11-18T10:36:43.342 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3636128768 bytes 2021-11-18T10:36:43.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3648696320 bytes 2021-11-18T10:36:43.500 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3683894272 bytes 2021-11-18T10:36:43.601 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3739668480 bytes 2021-11-18T10:36:43.696 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3774300160 bytes 2021-11-18T10:36:43.769 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3800562688 bytes 2021-11-18T10:36:43.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3851634688 bytes 2021-11-18T10:36:43.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 3896815616 bytes 2021-11-18T10:36:44.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 3931383808 bytes 2021-11-18T10:36:44.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4033159168 bytes 2021-11-18T10:36:44.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4151623680 bytes 2021-11-18T10:36:44.475 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4202253312 bytes 2021-11-18T10:36:44.603 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4303811584 bytes 2021-11-18T10:36:44.689 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4324222976 bytes 2021-11-18T10:36:44.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4344905728 bytes 2021-11-18T10:36:44.887 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4404142080 bytes 2021-11-18T10:36:44.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4472134656 bytes 2021-11-18T10:36:45.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4490973184 bytes 2021-11-18T10:36:45.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4491581440 bytes 2021-11-18T10:36:45.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4512931840 bytes 2021-11-18T10:36:45.335 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4572341248 bytes 2021-11-18T10:36:45.477 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4613818368 bytes 2021-11-18T10:36:45.612 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4705336320 bytes 2021-11-18T10:36:45.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4717192192 bytes 2021-11-18T10:36:45.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4781475840 bytes 2021-11-18T10:36:45.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4826942464 bytes 2021-11-18T10:36:46.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4943514624 bytes 2021-11-18T10:36:46.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:36:46.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:36:46.167 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:36:46.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:36:46.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:36:46.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_26 2021-11-18T10:36:46.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_26 snapshot 128M 2021-11-18T10:36:46.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:46.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:46.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:46.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:46.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_26 2021-11-18T10:36:46.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:46.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:36:46.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:36:46.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:46.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_26 128M 2021-11-18T10:36:46.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:46.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:46.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:46.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:46.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_26 2021-11-18T10:36:46.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:46.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:36:46.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:36:46.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:36:46.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:46.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_26 2021-11-18T10:36:46.199 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:36:46.200 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_26 snapshot 2021-11-18T10:36:46.200 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:46.200 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:46.200 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_26 2021-11-18T10:36:46.200 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:36:46.201 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_26 snapshot 2021-11-18T10:36:47.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:36:47.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_26 2021-11-18T10:36:47.208 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_26': 2021-11-18T10:36:47.209 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:36:47.209 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:36:47.209 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:36:47.209 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 13c6f0701d36 2021-11-18T10:36:47.210 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.13c6f0701d36 2021-11-18T10:36:47.210 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:36:47.210 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:36:47.210 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:36:47.211 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:36:47.211 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:36:46 2021 2021-11-18T10:36:47.211 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:36:46 2021 2021-11-18T10:36:47.211 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:36:46 2021 2021-11-18T10:36:47.211 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:36:47.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:36:47.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: aaa55aaf-8a3e-4514-8596-210a965668f0 2021-11-18T10:36:47.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:36:47.213 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:36:47.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_26 2021-11-18T10:36:47.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:47.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:47.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_26 2021-11-18T10:36:47.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:36:47.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=11 2021-11-18T10:36:47.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:36:47.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 11s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_26 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:36:47.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 70913024 bytes 2021-11-18T10:36:47.457 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 97584128 bytes 2021-11-18T10:36:47.577 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 160958464 bytes 2021-11-18T10:36:47.676 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 218269696 bytes 2021-11-18T10:36:47.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 253842432 bytes 2021-11-18T10:36:47.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 310900736 bytes 2021-11-18T10:36:47.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 346500096 bytes 2021-11-18T10:36:48.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 404068352 bytes 2021-11-18T10:36:48.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 439114752 bytes 2021-11-18T10:36:48.244 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 459932672 bytes 2021-11-18T10:36:48.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 466530304 bytes 2021-11-18T10:36:48.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 535530496 bytes 2021-11-18T10:36:48.551 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 608884736 bytes 2021-11-18T10:36:48.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 671960064 bytes 2021-11-18T10:36:48.748 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 705328128 bytes 2021-11-18T10:36:48.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 712744960 bytes 2021-11-18T10:36:48.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 742290432 bytes 2021-11-18T10:36:49.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 826280960 bytes 2021-11-18T10:36:49.082 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 827463680 bytes 2021-11-18T10:36:49.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 921280512 bytes 2021-11-18T10:36:49.304 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 945801216 bytes 2021-11-18T10:36:49.407 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 999990272 bytes 2021-11-18T10:36:49.474 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1011582976 bytes 2021-11-18T10:36:49.558 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1037529088 bytes 2021-11-18T10:36:49.622 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1050415104 bytes 2021-11-18T10:36:49.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1067741184 bytes 2021-11-18T10:36:49.847 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1164342272 bytes 2021-11-18T10:36:50.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1245053952 bytes 2021-11-18T10:36:50.059 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1245665280 bytes 2021-11-18T10:36:50.144 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1277173760 bytes 2021-11-18T10:36:50.259 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1341947904 bytes 2021-11-18T10:36:50.343 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1374366720 bytes 2021-11-18T10:36:50.448 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1418007552 bytes 2021-11-18T10:36:50.549 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1463099392 bytes 2021-11-18T10:36:50.655 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1520833536 bytes 2021-11-18T10:36:50.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1521453056 bytes 2021-11-18T10:36:50.787 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1549059072 bytes 2021-11-18T10:36:50.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1572249600 bytes 2021-11-18T10:36:50.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1692670976 bytes 2021-11-18T10:36:51.139 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1741946880 bytes 2021-11-18T10:36:51.219 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1773071360 bytes 2021-11-18T10:36:51.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1803897856 bytes 2021-11-18T10:36:51.378 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1830905856 bytes 2021-11-18T10:36:51.454 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1847607296 bytes 2021-11-18T10:36:51.579 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1919203328 bytes 2021-11-18T10:36:51.677 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1961626624 bytes 2021-11-18T10:36:51.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1996275712 bytes 2021-11-18T10:36:51.836 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2016490496 bytes 2021-11-18T10:36:51.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2043043840 bytes 2021-11-18T10:36:51.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2061850624 bytes 2021-11-18T10:36:52.086 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2113408000 bytes 2021-11-18T10:36:52.170 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2140481536 bytes 2021-11-18T10:36:52.234 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2152179712 bytes 2021-11-18T10:36:52.496 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2164252672 bytes 2021-11-18T10:36:52.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2204617728 bytes 2021-11-18T10:36:52.657 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2228426752 bytes 2021-11-18T10:36:52.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2305860608 bytes 2021-11-18T10:36:52.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2315663360 bytes 2021-11-18T10:36:52.916 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2325511168 bytes 2021-11-18T10:36:52.985 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2339593216 bytes 2021-11-18T10:36:53.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2356310016 bytes 2021-11-18T10:36:53.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2375669760 bytes 2021-11-18T10:36:53.440 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2432707584 bytes 2021-11-18T10:36:53.518 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2456561664 bytes 2021-11-18T10:36:53.604 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2485928960 bytes 2021-11-18T10:36:53.674 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2517763072 bytes 2021-11-18T10:36:53.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2547651584 bytes 2021-11-18T10:36:53.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2559428608 bytes 2021-11-18T10:36:53.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2608612352 bytes 2021-11-18T10:36:54.054 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2673000448 bytes 2021-11-18T10:36:54.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2681368576 bytes 2021-11-18T10:36:54.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2690071552 bytes 2021-11-18T10:36:54.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2709837824 bytes 2021-11-18T10:36:54.339 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2734302208 bytes 2021-11-18T10:36:54.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 2742070272 bytes 2021-11-18T10:36:54.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 2777146368 bytes 2021-11-18T10:36:54.557 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 2787530752 bytes 2021-11-18T10:36:54.641 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 2829456384 bytes 2021-11-18T10:36:54.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 2838135808 bytes 2021-11-18T10:36:54.825 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 2909683712 bytes 2021-11-18T10:36:54.971 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 2991690752 bytes 2021-11-18T10:36:55.061 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3025835008 bytes 2021-11-18T10:36:55.124 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3031235584 bytes 2021-11-18T10:36:55.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3076926464 bytes 2021-11-18T10:36:55.337 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3137441792 bytes 2021-11-18T10:36:55.437 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3174343680 bytes 2021-11-18T10:36:55.507 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3187788800 bytes 2021-11-18T10:36:55.596 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3219255296 bytes 2021-11-18T10:36:55.694 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3260802048 bytes 2021-11-18T10:36:55.813 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3332269056 bytes 2021-11-18T10:36:55.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3383267328 bytes 2021-11-18T10:36:56.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3412027392 bytes 2021-11-18T10:36:56.100 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3450244096 bytes 2021-11-18T10:36:56.207 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3496968192 bytes 2021-11-18T10:36:56.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3557744640 bytes 2021-11-18T10:36:56.446 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3623227392 bytes 2021-11-18T10:36:56.547 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 3664941056 bytes 2021-11-18T10:36:56.640 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 3693095936 bytes 2021-11-18T10:36:56.747 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 3743531008 bytes 2021-11-18T10:36:56.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 3760678912 bytes 2021-11-18T10:36:56.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 3786112000 bytes 2021-11-18T10:36:56.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 3786729472 bytes 2021-11-18T10:36:57.087 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 3856244736 bytes 2021-11-18T10:36:57.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 3948800000 bytes 2021-11-18T10:36:57.337 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4004684800 bytes 2021-11-18T10:36:57.416 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4014716928 bytes 2021-11-18T10:36:57.530 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4070728704 bytes 2021-11-18T10:36:57.635 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4120790016 bytes 2021-11-18T10:36:57.782 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4207039488 bytes 2021-11-18T10:36:58.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4254880768 bytes 2021-11-18T10:36:58.119 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4320857088 bytes 2021-11-18T10:36:58.119 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4368573440 bytes 2021-11-18T10:36:58.206 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4431935488 bytes 2021-11-18T10:36:58.221 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:36:58.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:36:58.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:36:58.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:36:58.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:36:58.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_27 2021-11-18T10:36:58.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_27 snapshot 128M 2021-11-18T10:36:58.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:58.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:58.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:58.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:58.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_27 2021-11-18T10:36:58.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:58.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:36:58.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:36:58.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:58.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_27 128M 2021-11-18T10:36:58.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:58.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:58.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:58.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:58.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_27 2021-11-18T10:36:58.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:58.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:36:58.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:36:58.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:36:58.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:36:58.228 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_27 2021-11-18T10:36:58.254 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:36:58.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_27 snapshot 2021-11-18T10:36:58.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:58.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:58.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_27 2021-11-18T10:36:58.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:36:58.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_27 snapshot 2021-11-18T10:36:59.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:36:59.220 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_27 2021-11-18T10:36:59.245 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_27': 2021-11-18T10:36:59.245 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:36:59.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:36:59.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:36:59.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 13d2836bdcde 2021-11-18T10:36:59.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.13d2836bdcde 2021-11-18T10:36:59.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:36:59.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:36:59.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:36:59.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:36:59.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:36:58 2021 2021-11-18T10:36:59.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:36:58 2021 2021-11-18T10:36:59.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:36:58 2021 2021-11-18T10:36:59.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:36:59.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:36:59.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: da83d72e-d145-4461-8363-ce49b750bfed 2021-11-18T10:36:59.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:36:59.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:36:59.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_27 2021-11-18T10:36:59.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:36:59.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:36:59.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_27 2021-11-18T10:36:59.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:36:59.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=7 2021-11-18T10:36:59.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:36:59.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 7s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_27 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:36:59.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 61245440 bytes 2021-11-18T10:36:59.529 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 144736256 bytes 2021-11-18T10:36:59.615 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 178583552 bytes 2021-11-18T10:36:59.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 220199936 bytes 2021-11-18T10:36:59.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 278630400 bytes 2021-11-18T10:36:59.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 347484160 bytes 2021-11-18T10:37:00.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 384229376 bytes 2021-11-18T10:37:00.160 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 477773824 bytes 2021-11-18T10:37:00.282 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 543086592 bytes 2021-11-18T10:37:00.350 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 543690752 bytes 2021-11-18T10:37:00.409 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 546232320 bytes 2021-11-18T10:37:00.480 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 566508544 bytes 2021-11-18T10:37:00.534 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 580125696 bytes 2021-11-18T10:37:00.621 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 597451776 bytes 2021-11-18T10:37:00.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 678269952 bytes 2021-11-18T10:37:00.868 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 734744576 bytes 2021-11-18T10:37:00.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 774049792 bytes 2021-11-18T10:37:01.080 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 827652096 bytes 2021-11-18T10:37:01.204 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 897509376 bytes 2021-11-18T10:37:01.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 980659200 bytes 2021-11-18T10:37:01.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 1012866048 bytes 2021-11-18T10:37:01.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 1048660992 bytes 2021-11-18T10:37:01.654 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1159874560 bytes 2021-11-18T10:37:01.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1187685376 bytes 2021-11-18T10:37:01.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1254793216 bytes 2021-11-18T10:37:01.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1316409344 bytes 2021-11-18T10:37:02.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1333709824 bytes 2021-11-18T10:37:02.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1377678336 bytes 2021-11-18T10:37:02.229 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1394280448 bytes 2021-11-18T10:37:02.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1422920704 bytes 2021-11-18T10:37:02.432 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1482985472 bytes 2021-11-18T10:37:02.528 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1522171904 bytes 2021-11-18T10:37:02.639 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1574054912 bytes 2021-11-18T10:37:02.795 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1670762496 bytes 2021-11-18T10:37:02.892 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1711828992 bytes 2021-11-18T10:37:02.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1755043840 bytes 2021-11-18T10:37:03.168 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1872167936 bytes 2021-11-18T10:37:03.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1891343360 bytes 2021-11-18T10:37:03.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1912337408 bytes 2021-11-18T10:37:03.435 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1964442624 bytes 2021-11-18T10:37:03.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 2045802496 bytes 2021-11-18T10:37:03.709 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 2134914048 bytes 2021-11-18T10:37:03.867 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 2241269760 bytes 2021-11-18T10:37:03.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 2252968960 bytes 2021-11-18T10:37:04.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 2317728768 bytes 2021-11-18T10:37:04.133 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2318359552 bytes 2021-11-18T10:37:04.230 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2354160640 bytes 2021-11-18T10:37:04.352 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2414901248 bytes 2021-11-18T10:37:04.450 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2452126720 bytes 2021-11-18T10:37:04.552 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2496118784 bytes 2021-11-18T10:37:04.629 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2513595392 bytes 2021-11-18T10:37:04.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2604977152 bytes 2021-11-18T10:37:04.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2605573120 bytes 2021-11-18T10:37:04.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2606172160 bytes 2021-11-18T10:37:04.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2627763200 bytes 2021-11-18T10:37:05.056 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2659572736 bytes 2021-11-18T10:37:05.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2697739264 bytes 2021-11-18T10:37:05.236 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2725723136 bytes 2021-11-18T10:37:05.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2788789248 bytes 2021-11-18T10:37:05.429 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2800692224 bytes 2021-11-18T10:37:05.528 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2842430464 bytes 2021-11-18T10:37:05.614 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2886804480 bytes 2021-11-18T10:37:05.718 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2911434752 bytes 2021-11-18T10:37:05.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2928142336 bytes 2021-11-18T10:37:05.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 3000218624 bytes 2021-11-18T10:37:05.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 3016340480 bytes 2021-11-18T10:37:06.073 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 3041496064 bytes 2021-11-18T10:37:06.162 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 3076383744 bytes 2021-11-18T10:37:06.255 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:37:06.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:37:06.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:37:06.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:37:06.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:37:06.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_28 2021-11-18T10:37:06.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_28 snapshot 128M 2021-11-18T10:37:06.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:06.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:06.257 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:06.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:06.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_28 2021-11-18T10:37:06.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:06.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:06.259 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:37:06.259 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:06.259 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_28 128M 2021-11-18T10:37:06.259 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:06.259 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:06.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:06.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:06.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_28 2021-11-18T10:37:06.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:06.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:37:06.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:37:06.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:37:06.262 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:06.262 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_28 2021-11-18T10:37:06.288 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:37:06.288 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_28 snapshot 2021-11-18T10:37:06.289 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:06.289 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:06.289 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_28 2021-11-18T10:37:06.289 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:06.290 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_28 snapshot 2021-11-18T10:37:06.865 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:37:06.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_28 2021-11-18T10:37:06.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_28': 2021-11-18T10:37:06.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:37:06.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:37:06.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:37:06.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 13dc42daec07 2021-11-18T10:37:06.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.13dc42daec07 2021-11-18T10:37:06.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:37:06.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:37:06.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:37:06.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:37:06.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:37:06 2021 2021-11-18T10:37:06.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:37:06 2021 2021-11-18T10:37:06.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:37:06 2021 2021-11-18T10:37:06.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:37:06.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:37:06.904 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 6fa97cc8-4faa-49fc-afcd-598875321aa1 2021-11-18T10:37:06.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:37:06.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:37:06.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_28 2021-11-18T10:37:06.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:06.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:06.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_28 2021-11-18T10:37:06.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:37:06.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=13 2021-11-18T10:37:06.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:37:06.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 13s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_28 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:37:07.121 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 118213632 bytes 2021-11-18T10:37:07.188 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 129393664 bytes 2021-11-18T10:37:07.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 133236736 bytes 2021-11-18T10:37:07.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 161062912 bytes 2021-11-18T10:37:07.403 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 183119872 bytes 2021-11-18T10:37:07.536 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 265134080 bytes 2021-11-18T10:37:07.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 308420608 bytes 2021-11-18T10:37:07.697 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 317608960 bytes 2021-11-18T10:37:07.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 327342080 bytes 2021-11-18T10:37:07.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 327964672 bytes 2021-11-18T10:37:07.897 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 357814272 bytes 2021-11-18T10:37:07.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 383077376 bytes 2021-11-18T10:37:08.037 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 407184384 bytes 2021-11-18T10:37:08.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 438141952 bytes 2021-11-18T10:37:08.294 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 531284992 bytes 2021-11-18T10:37:08.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 587431936 bytes 2021-11-18T10:37:08.538 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 655507456 bytes 2021-11-18T10:37:08.638 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 698518528 bytes 2021-11-18T10:37:08.712 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 718443520 bytes 2021-11-18T10:37:08.810 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 754507776 bytes 2021-11-18T10:37:08.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 768355328 bytes 2021-11-18T10:37:08.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 805212160 bytes 2021-11-18T10:37:09.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 843234304 bytes 2021-11-18T10:37:09.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 889110528 bytes 2021-11-18T10:37:09.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1007154176 bytes 2021-11-18T10:37:09.430 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1029331968 bytes 2021-11-18T10:37:09.520 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1063095296 bytes 2021-11-18T10:37:09.591 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1073560576 bytes 2021-11-18T10:37:09.697 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1123792896 bytes 2021-11-18T10:37:09.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1171529728 bytes 2021-11-18T10:37:09.906 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1218976768 bytes 2021-11-18T10:37:10.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1269648384 bytes 2021-11-18T10:37:10.113 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1316050944 bytes 2021-11-18T10:37:10.199 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1341899776 bytes 2021-11-18T10:37:10.313 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1395913728 bytes 2021-11-18T10:37:10.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1447498752 bytes 2021-11-18T10:37:10.545 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1517449216 bytes 2021-11-18T10:37:10.656 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1574342656 bytes 2021-11-18T10:37:10.790 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1640776704 bytes 2021-11-18T10:37:10.874 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1666842624 bytes 2021-11-18T10:37:10.939 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1672599552 bytes 2021-11-18T10:37:11.084 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1760119808 bytes 2021-11-18T10:37:11.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1839233024 bytes 2021-11-18T10:37:11.341 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1898847232 bytes 2021-11-18T10:37:11.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1912899584 bytes 2021-11-18T10:37:11.516 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1956429824 bytes 2021-11-18T10:37:11.578 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1960705024 bytes 2021-11-18T10:37:11.661 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1982584832 bytes 2021-11-18T10:37:11.805 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2070323200 bytes 2021-11-18T10:37:11.987 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2178400256 bytes 2021-11-18T10:37:12.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2242226176 bytes 2021-11-18T10:37:12.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2242816000 bytes 2021-11-18T10:37:12.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2322603008 bytes 2021-11-18T10:37:12.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2361180160 bytes 2021-11-18T10:37:12.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2446694400 bytes 2021-11-18T10:37:12.634 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2454172672 bytes 2021-11-18T10:37:12.727 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2478066688 bytes 2021-11-18T10:37:12.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2504856576 bytes 2021-11-18T10:37:12.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2580615168 bytes 2021-11-18T10:37:13.060 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2638390272 bytes 2021-11-18T10:37:13.136 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2674428928 bytes 2021-11-18T10:37:13.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2709548032 bytes 2021-11-18T10:37:13.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2710184960 bytes 2021-11-18T10:37:13.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2762988544 bytes 2021-11-18T10:37:13.534 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2818999296 bytes 2021-11-18T10:37:13.606 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2835794944 bytes 2021-11-18T10:37:13.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2892852224 bytes 2021-11-18T10:37:13.790 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2898711552 bytes 2021-11-18T10:37:13.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2964643840 bytes 2021-11-18T10:37:13.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2987378688 bytes 2021-11-18T10:37:14.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2987988992 bytes 2021-11-18T10:37:14.152 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3032259584 bytes 2021-11-18T10:37:14.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3074964480 bytes 2021-11-18T10:37:14.334 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3105684480 bytes 2021-11-18T10:37:14.384 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:37:14.386+0000 7f46d0e3c700 -1 reset not still connected to 0x556ef8eaaa90 2021-11-18T10:37:14.432 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3162413056 bytes 2021-11-18T10:37:14.562 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3239883776 bytes 2021-11-18T10:37:14.671 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3271622656 bytes 2021-11-18T10:37:14.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3351716864 bytes 2021-11-18T10:37:14.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3382274048 bytes 2021-11-18T10:37:15.021 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3444005888 bytes 2021-11-18T10:37:15.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3455013888 bytes 2021-11-18T10:37:15.171 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3480503296 bytes 2021-11-18T10:37:15.237 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3489286144 bytes 2021-11-18T10:37:15.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3523543040 bytes 2021-11-18T10:37:15.477 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3581593600 bytes 2021-11-18T10:37:15.593 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3641441280 bytes 2021-11-18T10:37:15.684 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3673930752 bytes 2021-11-18T10:37:15.794 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3726688256 bytes 2021-11-18T10:37:15.855 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3751285760 bytes 2021-11-18T10:37:15.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3751890944 bytes 2021-11-18T10:37:16.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3810251776 bytes 2021-11-18T10:37:16.185 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3892593664 bytes 2021-11-18T10:37:16.288 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3936204800 bytes 2021-11-18T10:37:16.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 4011439104 bytes 2021-11-18T10:37:16.558 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 4074060800 bytes 2021-11-18T10:37:16.657 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 4122931200 bytes 2021-11-18T10:37:16.723 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 4123540480 bytes 2021-11-18T10:37:16.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4163012608 bytes 2021-11-18T10:37:17.072 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4221715456 bytes 2021-11-18T10:37:17.138 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4225696768 bytes 2021-11-18T10:37:17.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4273780736 bytes 2021-11-18T10:37:17.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4333480960 bytes 2021-11-18T10:37:17.491 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4387468288 bytes 2021-11-18T10:37:17.611 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4448121856 bytes 2021-11-18T10:37:17.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4494283776 bytes 2021-11-18T10:37:17.797 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4524467200 bytes 2021-11-18T10:37:17.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4539870208 bytes 2021-11-18T10:37:17.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4581481472 bytes 2021-11-18T10:37:18.047 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4608348160 bytes 2021-11-18T10:37:18.145 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4658045952 bytes 2021-11-18T10:37:18.290 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4740842496 bytes 2021-11-18T10:37:18.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4814730240 bytes 2021-11-18T10:37:18.508 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4840743936 bytes 2021-11-18T10:37:18.613 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4887515136 bytes 2021-11-18T10:37:18.699 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4931543040 bytes 2021-11-18T10:37:18.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4951363584 bytes 2021-11-18T10:37:18.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 5011003392 bytes 2021-11-18T10:37:19.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 5060934656 bytes 2021-11-18T10:37:19.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 5121992704 bytes 2021-11-18T10:37:19.256 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 5195259904 bytes 2021-11-18T10:37:19.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 5238406144 bytes 2021-11-18T10:37:19.492 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 5315593216 bytes 2021-11-18T10:37:19.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 5346689024 bytes 2021-11-18T10:37:19.698 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 5406698496 bytes 2021-11-18T10:37:20.102 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12500 IOs, 5419062272 bytes 2021-11-18T10:37:20.103 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12600 IOs, 5432561664 bytes 2021-11-18T10:37:20.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:37:20.105 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:37:20.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:37:20.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:37:20.106 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:37:20.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_29 2021-11-18T10:37:20.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_29 snapshot 128M 2021-11-18T10:37:20.108 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:20.108 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:20.108 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:20.109 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:20.109 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_29 2021-11-18T10:37:20.109 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:20.109 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:20.110 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:37:20.110 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:20.111 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_29 128M 2021-11-18T10:37:20.111 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:20.111 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:20.111 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:20.112 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:20.112 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_29 2021-11-18T10:37:20.112 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:20.112 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:37:20.112 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:37:20.113 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:37:20.113 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:20.113 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_29 2021-11-18T10:37:20.113 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:37:20.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_29 snapshot 2021-11-18T10:37:20.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:20.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:20.114 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_29 2021-11-18T10:37:20.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:20.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_29 snapshot 2021-11-18T10:37:20.928 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:37:20.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_29 2021-11-18T10:37:20.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_29': 2021-11-18T10:37:20.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:37:20.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:37:20.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:37:20.961 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 13e671de9354 2021-11-18T10:37:20.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.13e671de9354 2021-11-18T10:37:20.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:37:20.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:37:20.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:37:20.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:37:20.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:37:19 2021 2021-11-18T10:37:20.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:37:19 2021 2021-11-18T10:37:20.963 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:37:19 2021 2021-11-18T10:37:20.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:37:20.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:37:20.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: dd8081a2-47a5-4818-ab4f-92334ed86c80 2021-11-18T10:37:20.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:37:20.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:37:20.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_29 2021-11-18T10:37:20.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:20.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:20.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_29 2021-11-18T10:37:20.966 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:37:20.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=9 2021-11-18T10:37:20.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:37:20.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 9s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_29 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:37:21.138 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 125040640 bytes 2021-11-18T10:37:21.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 212158464 bytes 2021-11-18T10:37:21.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 240107520 bytes 2021-11-18T10:37:21.475 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 254971904 bytes 2021-11-18T10:37:21.562 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 282590208 bytes 2021-11-18T10:37:21.622 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 284598272 bytes 2021-11-18T10:37:21.723 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 333310976 bytes 2021-11-18T10:37:21.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 413046784 bytes 2021-11-18T10:37:21.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 444306432 bytes 2021-11-18T10:37:22.056 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 497587200 bytes 2021-11-18T10:37:22.132 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 514573312 bytes 2021-11-18T10:37:22.200 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 529054720 bytes 2021-11-18T10:37:22.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 600410112 bytes 2021-11-18T10:37:22.442 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 658697216 bytes 2021-11-18T10:37:22.538 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 698854400 bytes 2021-11-18T10:37:22.636 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 740423680 bytes 2021-11-18T10:37:22.726 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 793331712 bytes 2021-11-18T10:37:22.808 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 793951232 bytes 2021-11-18T10:37:22.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 859060224 bytes 2021-11-18T10:37:23.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 884462592 bytes 2021-11-18T10:37:23.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 930813952 bytes 2021-11-18T10:37:23.175 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 931447808 bytes 2021-11-18T10:37:23.274 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 981069824 bytes 2021-11-18T10:37:23.375 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1013231616 bytes 2021-11-18T10:37:23.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1044052992 bytes 2021-11-18T10:37:23.564 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1085346816 bytes 2021-11-18T10:37:23.714 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1176126464 bytes 2021-11-18T10:37:23.831 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1235482624 bytes 2021-11-18T10:37:23.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1319927808 bytes 2021-11-18T10:37:24.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1386089472 bytes 2021-11-18T10:37:24.206 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1429004288 bytes 2021-11-18T10:37:24.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1481938944 bytes 2021-11-18T10:37:24.376 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1492646912 bytes 2021-11-18T10:37:24.489 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1541538816 bytes 2021-11-18T10:37:24.561 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1555246080 bytes 2021-11-18T10:37:24.669 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1609068544 bytes 2021-11-18T10:37:24.763 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1639321600 bytes 2021-11-18T10:37:24.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1710261248 bytes 2021-11-18T10:37:25.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1765600256 bytes 2021-11-18T10:37:25.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1781358592 bytes 2021-11-18T10:37:25.145 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1794980864 bytes 2021-11-18T10:37:25.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1822242816 bytes 2021-11-18T10:37:25.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1871893504 bytes 2021-11-18T10:37:25.584 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1883122688 bytes 2021-11-18T10:37:25.679 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1916641280 bytes 2021-11-18T10:37:25.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1991719936 bytes 2021-11-18T10:37:25.915 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2038463488 bytes 2021-11-18T10:37:26.043 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2108420096 bytes 2021-11-18T10:37:26.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2133724160 bytes 2021-11-18T10:37:26.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2160061440 bytes 2021-11-18T10:37:26.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2189225984 bytes 2021-11-18T10:37:26.406 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2238919680 bytes 2021-11-18T10:37:26.499 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2274453504 bytes 2021-11-18T10:37:26.608 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2324134912 bytes 2021-11-18T10:37:26.676 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2335731712 bytes 2021-11-18T10:37:26.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2372579328 bytes 2021-11-18T10:37:26.886 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2418288640 bytes 2021-11-18T10:37:26.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2444022784 bytes 2021-11-18T10:37:27.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2473874432 bytes 2021-11-18T10:37:27.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2510978048 bytes 2021-11-18T10:37:27.263 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2561810432 bytes 2021-11-18T10:37:27.374 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2616165376 bytes 2021-11-18T10:37:27.446 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2631780352 bytes 2021-11-18T10:37:27.561 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2701791232 bytes 2021-11-18T10:37:27.746 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2814128128 bytes 2021-11-18T10:37:27.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2887244800 bytes 2021-11-18T10:37:28.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2976845824 bytes 2021-11-18T10:37:28.122 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 3014373376 bytes 2021-11-18T10:37:28.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 3047198720 bytes 2021-11-18T10:37:28.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 3074915328 bytes 2021-11-18T10:37:28.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3098230784 bytes 2021-11-18T10:37:28.449 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3112904704 bytes 2021-11-18T10:37:28.537 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3148188672 bytes 2021-11-18T10:37:28.621 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3172225024 bytes 2021-11-18T10:37:28.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3261566976 bytes 2021-11-18T10:37:28.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3298704384 bytes 2021-11-18T10:37:28.960 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3330585600 bytes 2021-11-18T10:37:29.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3342395392 bytes 2021-11-18T10:37:29.098 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3357038592 bytes 2021-11-18T10:37:29.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3440763904 bytes 2021-11-18T10:37:29.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3488700416 bytes 2021-11-18T10:37:29.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3498644480 bytes 2021-11-18T10:37:29.499 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3526945792 bytes 2021-11-18T10:37:29.607 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3576285184 bytes 2021-11-18T10:37:29.680 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3590511616 bytes 2021-11-18T10:37:29.779 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3634153472 bytes 2021-11-18T10:37:29.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3634782208 bytes 2021-11-18T10:37:29.949 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3682885632 bytes 2021-11-18T10:37:29.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:37:29.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:37:29.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:37:29.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:37:29.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:37:29.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_30 2021-11-18T10:37:29.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_30 snapshot 128M 2021-11-18T10:37:29.973 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:29.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:29.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:29.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:29.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_30 2021-11-18T10:37:29.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:29.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:29.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:37:29.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:29.975 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_30 128M 2021-11-18T10:37:29.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:29.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:29.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:29.976 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:29.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_30 2021-11-18T10:37:29.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:29.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:37:29.977 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:37:29.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:37:29.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:29.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_30 2021-11-18T10:37:30.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:37:30.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_30 snapshot 2021-11-18T10:37:30.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:30.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:30.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_30 2021-11-18T10:37:30.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:30.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_30 snapshot 2021-11-18T10:37:30.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:37:30.967 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_30 2021-11-18T10:37:30.992 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_30': 2021-11-18T10:37:30.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:37:30.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:37:30.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:37:30.994 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 13f1da5c660d 2021-11-18T10:37:30.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.13f1da5c660d 2021-11-18T10:37:30.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:37:30.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:37:30.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:37:30.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:37:30.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:37:30 2021 2021-11-18T10:37:30.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:37:30 2021 2021-11-18T10:37:30.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:37:30 2021 2021-11-18T10:37:30.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:37:30.998 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:37:30.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 2e26b719-06ce-4cde-bb3e-30fd76424b9c 2021-11-18T10:37:30.999 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:37:31.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:37:31.001 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_30 2021-11-18T10:37:31.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:31.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:31.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_30 2021-11-18T10:37:31.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:37:31.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=9 2021-11-18T10:37:31.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:37:31.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 9s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_30 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:37:31.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 33457152 bytes 2021-11-18T10:37:31.193 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 51175424 bytes 2021-11-18T10:37:31.304 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 120035328 bytes 2021-11-18T10:37:31.375 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 124578816 bytes 2021-11-18T10:37:31.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 156733440 bytes 2021-11-18T10:37:31.586 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 221117440 bytes 2021-11-18T10:37:31.651 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 225957888 bytes 2021-11-18T10:37:31.708 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 237529088 bytes 2021-11-18T10:37:31.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 247713792 bytes 2021-11-18T10:37:31.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 287809536 bytes 2021-11-18T10:37:31.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 336819200 bytes 2021-11-18T10:37:32.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 371867648 bytes 2021-11-18T10:37:32.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 462924800 bytes 2021-11-18T10:37:32.283 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 493524992 bytes 2021-11-18T10:37:32.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 575546368 bytes 2021-11-18T10:37:32.526 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 625128448 bytes 2021-11-18T10:37:32.642 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 691618816 bytes 2021-11-18T10:37:32.733 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 724925440 bytes 2021-11-18T10:37:32.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 771779584 bytes 2021-11-18T10:37:32.913 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 792457216 bytes 2021-11-18T10:37:33.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 842296320 bytes 2021-11-18T10:37:33.090 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 855724032 bytes 2021-11-18T10:37:33.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 865606656 bytes 2021-11-18T10:37:33.263 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 918752256 bytes 2021-11-18T10:37:33.351 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 948460544 bytes 2021-11-18T10:37:33.508 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1045239808 bytes 2021-11-18T10:37:33.581 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1055966208 bytes 2021-11-18T10:37:33.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1113536512 bytes 2021-11-18T10:37:33.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1175108608 bytes 2021-11-18T10:37:33.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1209503744 bytes 2021-11-18T10:37:34.014 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1251280896 bytes 2021-11-18T10:37:34.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1327588352 bytes 2021-11-18T10:37:34.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1364348928 bytes 2021-11-18T10:37:34.339 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1403943936 bytes 2021-11-18T10:37:34.395 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.0 with skip (0.377244830021744) > weight (0.25) 2021-11-18T10:37:34.395 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.1 with skip (0.7229105239517668) > weight (0.25) 2021-11-18T10:37:34.395 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.2 with skip (0.9989973869719949) > weight (0.25) 2021-11-18T10:37:34.396 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster1.client.mirror.3 with skip (0.5099819380248805) > weight (0.25) 2021-11-18T10:37:34.396 INFO:tasks.rbd_mirror_thrash:waiting for 96 secs before thrashing 2021-11-18T10:37:34.424 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1444081664 bytes 2021-11-18T10:37:34.501 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1454055424 bytes 2021-11-18T10:37:34.658 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1554211840 bytes 2021-11-18T10:37:34.809 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1637155840 bytes 2021-11-18T10:37:34.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1676027904 bytes 2021-11-18T10:37:34.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1690760192 bytes 2021-11-18T10:37:35.072 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:37:35.074+0000 7f46d985b700 -1 bdev(0x556ee517a000 /var/lib/ceph/osd/cluster2-0/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-18T10:37:35.074 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f46d985b700 time 2021-11-18T10:37:35.076143+0000 2021-11-18T10:37:35.074 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: 612: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-18T10:37:35.075 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:37:35.075 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x556ee12d31e9] 2021-11-18T10:37:35.075 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2: (KernelDevice::_aio_thread()+0xf9e) [0x556ee1efa45e] 2021-11-18T10:37:35.076 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556ee1f061b1] 2021-11-18T10:37:35.076 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 4: /lib64/libpthread.so.0(+0x814a) [0x7f46e94ab14a] 2021-11-18T10:37:35.076 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 5: clone() 2021-11-18T10:37:35.077 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:37:35.076+0000 7f46d985b700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f46d985b700 time 2021-11-18T10:37:35.076143+0000 2021-11-18T10:37:35.077 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: 612: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-18T10:37:35.077 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.078 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:37:35.078 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x556ee12d31e9] 2021-11-18T10:37:35.078 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2: (KernelDevice::_aio_thread()+0xf9e) [0x556ee1efa45e] 2021-11-18T10:37:35.079 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556ee1f061b1] 2021-11-18T10:37:35.079 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 4: /lib64/libpthread.so.0(+0x814a) [0x7f46e94ab14a] 2021-11-18T10:37:35.079 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 5: clone() 2021-11-18T10:37:35.079 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.080 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:*** Caught signal (Aborted) ** 2021-11-18T10:37:35.080 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: in thread 7f46d985b700 thread_name:bstore_aio 2021-11-18T10:37:35.081 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:37:35.082 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f46e94b5b20] 2021-11-18T10:37:35.082 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2: gsignal() 2021-11-18T10:37:35.082 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 3: abort() 2021-11-18T10:37:35.083 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x556ee12d32bc] 2021-11-18T10:37:35.083 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 5: (KernelDevice::_aio_thread()+0xf9e) [0x556ee1efa45e] 2021-11-18T10:37:35.083 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556ee1f061b1] 2021-11-18T10:37:35.084 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 7: /lib64/libpthread.so.0(+0x814a) [0x7f46e94ab14a] 2021-11-18T10:37:35.084 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 8: clone() 2021-11-18T10:37:35.084 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:2021-11-18T10:37:35.079+0000 7f46d985b700 -1 *** Caught signal (Aborted) ** 2021-11-18T10:37:35.085 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: in thread 7f46d985b700 thread_name:bstore_aio 2021-11-18T10:37:35.085 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.085 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:37:35.085 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f46e94b5b20] 2021-11-18T10:37:35.086 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2: gsignal() 2021-11-18T10:37:35.086 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 3: abort() 2021-11-18T10:37:35.086 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x556ee12d32bc] 2021-11-18T10:37:35.086 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 5: (KernelDevice::_aio_thread()+0xf9e) [0x556ee1efa45e] 2021-11-18T10:37:35.087 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556ee1f061b1] 2021-11-18T10:37:35.087 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 7: /lib64/libpthread.so.0(+0x814a) [0x7f46e94ab14a] 2021-11-18T10:37:35.087 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 8: clone() 2021-11-18T10:37:35.087 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-18T10:37:35.088 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.091 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: -761> 2021-11-18T10:37:35.074+0000 7f46d985b700 -1 bdev(0x556ee517a000 /var/lib/ceph/osd/cluster2-0/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-18T10:37:35.092 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: -169> 2021-11-18T10:37:35.076+0000 7f46d985b700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f46d985b700 time 2021-11-18T10:37:35.076143+0000 2021-11-18T10:37:35.092 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: 612: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-18T10:37:35.093 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.093 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:37:35.093 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x556ee12d31e9] 2021-11-18T10:37:35.093 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2: (KernelDevice::_aio_thread()+0xf9e) [0x556ee1efa45e] 2021-11-18T10:37:35.094 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556ee1f061b1] 2021-11-18T10:37:35.094 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 4: /lib64/libpthread.so.0(+0x814a) [0x7f46e94ab14a] 2021-11-18T10:37:35.094 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 5: clone() 2021-11-18T10:37:35.094 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.095 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 0> 2021-11-18T10:37:35.079+0000 7f46d985b700 -1 *** Caught signal (Aborted) ** 2021-11-18T10:37:35.095 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: in thread 7f46d985b700 thread_name:bstore_aio 2021-11-18T10:37:35.095 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.095 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:37:35.095 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f46e94b5b20] 2021-11-18T10:37:35.096 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2: gsignal() 2021-11-18T10:37:35.096 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 3: abort() 2021-11-18T10:37:35.096 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x556ee12d32bc] 2021-11-18T10:37:35.096 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 5: (KernelDevice::_aio_thread()+0xf9e) [0x556ee1efa45e] 2021-11-18T10:37:35.097 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556ee1f061b1] 2021-11-18T10:37:35.097 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 7: /lib64/libpthread.so.0(+0x814a) [0x7f46e94ab14a] 2021-11-18T10:37:35.097 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 8: clone() 2021-11-18T10:37:35.097 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-18T10:37:35.098 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.100 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: -1762> 2021-11-18T10:37:35.074+0000 7f46d985b700 -1 bdev(0x556ee517a000 /var/lib/ceph/osd/cluster2-0/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-18T10:37:35.100 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: -1170> 2021-11-18T10:37:35.076+0000 7f46d985b700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f46d985b700 time 2021-11-18T10:37:35.076143+0000 2021-11-18T10:37:35.100 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: 612: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-18T10:37:35.101 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.101 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:37:35.101 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x556ee12d31e9] 2021-11-18T10:37:35.101 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2: (KernelDevice::_aio_thread()+0xf9e) [0x556ee1efa45e] 2021-11-18T10:37:35.102 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556ee1f061b1] 2021-11-18T10:37:35.102 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 4: /lib64/libpthread.so.0(+0x814a) [0x7f46e94ab14a] 2021-11-18T10:37:35.102 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 5: clone() 2021-11-18T10:37:35.103 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.103 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: -1001> 2021-11-18T10:37:35.079+0000 7f46d985b700 -1 *** Caught signal (Aborted) ** 2021-11-18T10:37:35.103 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: in thread 7f46d985b700 thread_name:bstore_aio 2021-11-18T10:37:35.103 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.104 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:37:35.104 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f46e94b5b20] 2021-11-18T10:37:35.104 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2: gsignal() 2021-11-18T10:37:35.104 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 3: abort() 2021-11-18T10:37:35.104 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x556ee12d32bc] 2021-11-18T10:37:35.105 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 5: (KernelDevice::_aio_thread()+0xf9e) [0x556ee1efa45e] 2021-11-18T10:37:35.105 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x556ee1f061b1] 2021-11-18T10:37:35.105 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 7: /lib64/libpthread.so.0(+0x814a) [0x7f46e94ab14a] 2021-11-18T10:37:35.105 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 8: clone() 2021-11-18T10:37:35.106 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-18T10:37:35.106 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr: 2021-11-18T10:37:35.305 INFO:tasks.ceph.cluster2.osd.0.gibba019.stderr:daemon-helper: command failed with exit status 5 2021-11-18T10:37:36.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1753314304 bytes 2021-11-18T10:37:37.049 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1799675904 bytes 2021-11-18T10:37:37.111 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1826140160 bytes 2021-11-18T10:37:37.197 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1885063168 bytes 2021-11-18T10:37:37.260 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1935203328 bytes 2021-11-18T10:37:37.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1971564544 bytes 2021-11-18T10:37:37.402 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2003726336 bytes 2021-11-18T10:37:37.456 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2018972672 bytes 2021-11-18T10:37:37.505 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2019589120 bytes 2021-11-18T10:37:37.569 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2051074048 bytes 2021-11-18T10:37:37.630 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2076673024 bytes 2021-11-18T10:37:37.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2108256256 bytes 2021-11-18T10:37:37.739 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2114049024 bytes 2021-11-18T10:37:37.795 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2133896192 bytes 2021-11-18T10:37:37.853 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2156734464 bytes 2021-11-18T10:37:37.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2197173248 bytes 2021-11-18T10:37:38.015 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2262220800 bytes 2021-11-18T10:37:38.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2295883776 bytes 2021-11-18T10:37:38.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2331576320 bytes 2021-11-18T10:37:38.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2400318464 bytes 2021-11-18T10:37:38.309 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2461149184 bytes 2021-11-18T10:37:38.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2493713408 bytes 2021-11-18T10:37:38.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~0s 2021-11-18T10:37:38.454 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2562382848 bytes 2021-11-18T10:37:38.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2618778624 bytes 2021-11-18T10:37:38.600 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2676659200 bytes 2021-11-18T10:37:38.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2763503616 bytes 2021-11-18T10:37:38.801 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2847296512 bytes 2021-11-18T10:37:38.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2918413312 bytes 2021-11-18T10:37:38.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2966667264 bytes 2021-11-18T10:37:39.024 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2981794816 bytes 2021-11-18T10:37:39.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3055588352 bytes 2021-11-18T10:37:39.174 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3074453504 bytes 2021-11-18T10:37:39.285 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3181782016 bytes 2021-11-18T10:37:39.348 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3211229184 bytes 2021-11-18T10:37:39.449 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3291132928 bytes 2021-11-18T10:37:39.506 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3319828480 bytes 2021-11-18T10:37:39.556 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3334975488 bytes 2021-11-18T10:37:39.625 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3384379392 bytes 2021-11-18T10:37:39.684 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3417043968 bytes 2021-11-18T10:37:39.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3435151360 bytes 2021-11-18T10:37:39.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3460163584 bytes 2021-11-18T10:37:39.869 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3488208896 bytes 2021-11-18T10:37:39.950 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3561963520 bytes 2021-11-18T10:37:40.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:37:40.002 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:37:40.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:37:40.003 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:37:40.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:37:40.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_31 2021-11-18T10:37:40.004 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_31 snapshot 128M 2021-11-18T10:37:40.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:40.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:40.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:40.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:40.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_31 2021-11-18T10:37:40.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:40.006 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:37:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_31 128M 2021-11-18T10:37:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:40.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_31 2021-11-18T10:37:40.008 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:37:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:37:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:37:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:40.009 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_31 2021-11-18T10:37:40.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:37:40.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_31 snapshot 2021-11-18T10:37:40.034 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:40.034 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:40.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_31 2021-11-18T10:37:40.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:40.036 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_31 snapshot 2021-11-18T10:37:41.237 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:37:41.267 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_31 2021-11-18T10:37:41.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_31': 2021-11-18T10:37:41.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:37:41.315 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:37:41.315 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:37:41.315 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 13fda6bf58a 2021-11-18T10:37:41.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.13fda6bf58a 2021-11-18T10:37:41.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:37:41.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:37:41.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:37:41.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:37:41.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:37:40 2021 2021-11-18T10:37:41.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:37:40 2021 2021-11-18T10:37:41.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:37:40 2021 2021-11-18T10:37:41.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:37:41.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:37:41.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: c37346c9-e886-4242-b8c7-8e2e0b7f8ff4 2021-11-18T10:37:41.321 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:37:41.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:37:41.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_31 2021-11-18T10:37:41.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:41.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:41.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_31 2021-11-18T10:37:41.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:37:41.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=10 2021-11-18T10:37:41.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:37:41.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 10s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_31 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:37:41.660 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 50760704 bytes 2021-11-18T10:37:41.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 110410752 bytes 2021-11-18T10:37:42.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 179322880 bytes 2021-11-18T10:37:42.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 232780800 bytes 2021-11-18T10:37:42.199 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 251949056 bytes 2021-11-18T10:37:42.295 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 289168384 bytes 2021-11-18T10:37:42.388 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 342496256 bytes 2021-11-18T10:37:42.496 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 445146112 bytes 2021-11-18T10:37:42.607 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 502198272 bytes 2021-11-18T10:37:42.681 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 544394240 bytes 2021-11-18T10:37:42.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 588122112 bytes 2021-11-18T10:37:42.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 628803584 bytes 2021-11-18T10:37:43.386 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 656167936 bytes 2021-11-18T10:37:43.387 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 700450816 bytes 2021-11-18T10:37:43.387 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 776800256 bytes 2021-11-18T10:37:43.387 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 841233408 bytes 2021-11-18T10:37:43.387 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 880898048 bytes 2021-11-18T10:37:43.388 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 970213376 bytes 2021-11-18T10:37:43.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 1013875712 bytes 2021-11-18T10:37:43.471 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 1015756800 bytes 2021-11-18T10:37:43.537 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 1046787072 bytes 2021-11-18T10:37:43.588 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 1061888000 bytes 2021-11-18T10:37:43.657 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1103307776 bytes 2021-11-18T10:37:43.746 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1154362368 bytes 2021-11-18T10:37:43.830 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~5s 2021-11-18T10:37:43.832 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1214316544 bytes 2021-11-18T10:37:43.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1249199104 bytes 2021-11-18T10:37:43.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1314983936 bytes 2021-11-18T10:37:44.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1352693760 bytes 2021-11-18T10:37:44.125 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1393188864 bytes 2021-11-18T10:37:44.178 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1404289024 bytes 2021-11-18T10:37:44.267 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1464227840 bytes 2021-11-18T10:37:44.356 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1539201024 bytes 2021-11-18T10:37:44.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1552652288 bytes 2021-11-18T10:37:44.502 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1606576128 bytes 2021-11-18T10:37:44.577 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1652151296 bytes 2021-11-18T10:37:44.652 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1690895360 bytes 2021-11-18T10:37:44.717 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1724647424 bytes 2021-11-18T10:37:44.820 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1818413056 bytes 2021-11-18T10:37:44.894 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1867052032 bytes 2021-11-18T10:37:44.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1909868544 bytes 2021-11-18T10:37:45.043 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1954456576 bytes 2021-11-18T10:37:45.131 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 2023842816 bytes 2021-11-18T10:37:45.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 2087456768 bytes 2021-11-18T10:37:45.298 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 2152201216 bytes 2021-11-18T10:37:45.369 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 2190722048 bytes 2021-11-18T10:37:45.468 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 2275119104 bytes 2021-11-18T10:37:45.550 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 2320010240 bytes 2021-11-18T10:37:45.612 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 2345450496 bytes 2021-11-18T10:37:45.673 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2387602432 bytes 2021-11-18T10:37:45.766 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2432122880 bytes 2021-11-18T10:37:45.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2471937024 bytes 2021-11-18T10:37:45.959 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2571484160 bytes 2021-11-18T10:37:46.022 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2593771520 bytes 2021-11-18T10:37:46.089 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2619550720 bytes 2021-11-18T10:37:46.181 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2695771136 bytes 2021-11-18T10:37:46.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2738311168 bytes 2021-11-18T10:37:46.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2763405312 bytes 2021-11-18T10:37:46.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2779851776 bytes 2021-11-18T10:37:46.446 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2823835648 bytes 2021-11-18T10:37:46.507 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2857722880 bytes 2021-11-18T10:37:46.584 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2910947328 bytes 2021-11-18T10:37:46.667 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2954303488 bytes 2021-11-18T10:37:46.776 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 3057069056 bytes 2021-11-18T10:37:46.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 3066762240 bytes 2021-11-18T10:37:46.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 3082161152 bytes 2021-11-18T10:37:46.938 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 3082924032 bytes 2021-11-18T10:37:46.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 3088056320 bytes 2021-11-18T10:37:47.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 3152547840 bytes 2021-11-18T10:37:47.145 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 3190631424 bytes 2021-11-18T10:37:47.232 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 3242261504 bytes 2021-11-18T10:37:47.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 3314206720 bytes 2021-11-18T10:37:47.396 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 3356263424 bytes 2021-11-18T10:37:47.483 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3398558720 bytes 2021-11-18T10:37:47.550 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3437430784 bytes 2021-11-18T10:37:47.625 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3472420864 bytes 2021-11-18T10:37:47.716 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3533297664 bytes 2021-11-18T10:37:47.802 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3593793536 bytes 2021-11-18T10:37:47.854 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3610179584 bytes 2021-11-18T10:37:47.912 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3630380032 bytes 2021-11-18T10:37:47.978 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3655845888 bytes 2021-11-18T10:37:48.029 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3672598528 bytes 2021-11-18T10:37:48.104 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3693082624 bytes 2021-11-18T10:37:48.156 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3700121600 bytes 2021-11-18T10:37:48.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3729633280 bytes 2021-11-18T10:37:48.291 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3760933888 bytes 2021-11-18T10:37:48.342 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3766078464 bytes 2021-11-18T10:37:48.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3801769984 bytes 2021-11-18T10:37:48.486 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3872574464 bytes 2021-11-18T10:37:48.564 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3915890688 bytes 2021-11-18T10:37:48.646 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3969951744 bytes 2021-11-18T10:37:48.733 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 4030629888 bytes 2021-11-18T10:37:48.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 4048687104 bytes 2021-11-18T10:37:48.866 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 4094049280 bytes 2021-11-18T10:37:48.962 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 4173796352 bytes 2021-11-18T10:37:49.023 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 4193866752 bytes 2021-11-18T10:37:49.071 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 4197707776 bytes 2021-11-18T10:37:49.165 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 4267333632 bytes 2021-11-18T10:37:49.234 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~11s 2021-11-18T10:37:49.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4341261312 bytes 2021-11-18T10:37:49.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4380362752 bytes 2021-11-18T10:37:49.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4431106048 bytes 2021-11-18T10:37:49.479 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4477577216 bytes 2021-11-18T10:37:49.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4550647808 bytes 2021-11-18T10:37:49.654 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4616968192 bytes 2021-11-18T10:37:49.756 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4695443456 bytes 2021-11-18T10:37:49.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4731521024 bytes 2021-11-18T10:37:49.908 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4788411392 bytes 2021-11-18T10:37:49.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4808007680 bytes 2021-11-18T10:37:50.028 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4830484480 bytes 2021-11-18T10:37:50.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4866235392 bytes 2021-11-18T10:37:50.146 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4866877440 bytes 2021-11-18T10:37:50.222 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4912941056 bytes 2021-11-18T10:37:50.272 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4913542144 bytes 2021-11-18T10:37:50.346 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4953199616 bytes 2021-11-18T10:37:50.417 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4987819008 bytes 2021-11-18T10:37:50.461 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4988406784 bytes 2021-11-18T10:37:50.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 5066383360 bytes 2021-11-18T10:37:50.656 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 5122337792 bytes 2021-11-18T10:37:50.718 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 5144704000 bytes 2021-11-18T10:37:50.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 5195470848 bytes 2021-11-18T10:37:50.859 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 5231472640 bytes 2021-11-18T10:37:50.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 5242741760 bytes 2021-11-18T10:37:50.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 5312952320 bytes 2021-11-18T10:37:51.081 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 5383153664 bytes 2021-11-18T10:37:51.143 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 5394712576 bytes 2021-11-18T10:37:51.230 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12500 IOs, 5460458496 bytes 2021-11-18T10:37:51.285 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12600 IOs, 5479154688 bytes 2021-11-18T10:37:51.324 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:37:51.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:37:51.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:37:51.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:37:51.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:37:51.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_32 2021-11-18T10:37:51.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_32 snapshot 128M 2021-11-18T10:37:51.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:51.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:51.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:51.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:51.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_32 2021-11-18T10:37:51.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:51.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:51.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:37:51.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:51.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_32 128M 2021-11-18T10:37:51.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:51.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:51.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:51.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:51.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_32 2021-11-18T10:37:51.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:51.330 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:37:51.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:37:51.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:37:51.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:51.331 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_32 2021-11-18T10:37:51.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:37:51.358 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_32 snapshot 2021-11-18T10:37:51.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:51.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:51.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_32 2021-11-18T10:37:51.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:51.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_32 snapshot 2021-11-18T10:37:52.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:37:52.286 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_32 2021-11-18T10:37:52.344 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_32': 2021-11-18T10:37:52.344 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:37:52.344 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:37:52.344 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:37:52.345 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 14084fcafabb 2021-11-18T10:37:52.345 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.14084fcafabb 2021-11-18T10:37:52.345 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:37:52.345 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:37:52.346 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:37:52.346 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:37:52.346 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:37:51 2021 2021-11-18T10:37:52.346 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:37:51 2021 2021-11-18T10:37:52.347 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:37:51 2021 2021-11-18T10:37:52.347 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:37:52.347 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:37:52.347 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: ecfa5a73-45cd-402b-8515-6e73b3887987 2021-11-18T10:37:52.348 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:37:52.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:37:52.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_32 2021-11-18T10:37:52.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:52.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:52.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_32 2021-11-18T10:37:52.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:37:52.361 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=5 2021-11-18T10:37:52.361 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:37:52.361 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 5s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_32 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:37:52.685 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 13560832 bytes 2021-11-18T10:37:52.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 75354112 bytes 2021-11-18T10:37:53.034 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 98662400 bytes 2021-11-18T10:37:53.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 190129152 bytes 2021-11-18T10:37:53.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 224513024 bytes 2021-11-18T10:37:53.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 324473856 bytes 2021-11-18T10:37:53.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 364967936 bytes 2021-11-18T10:37:53.521 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 365569024 bytes 2021-11-18T10:37:53.641 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 470154240 bytes 2021-11-18T10:37:53.697 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 489862144 bytes 2021-11-18T10:37:53.774 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 540975104 bytes 2021-11-18T10:37:53.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 614278144 bytes 2021-11-18T10:37:53.907 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 614891520 bytes 2021-11-18T10:37:53.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 648222720 bytes 2021-11-18T10:37:54.031 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 673701888 bytes 2021-11-18T10:37:54.107 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 724651008 bytes 2021-11-18T10:37:54.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 763239424 bytes 2021-11-18T10:37:54.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 763823104 bytes 2021-11-18T10:37:54.271 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 764407808 bytes 2021-11-18T10:37:54.467 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 842740736 bytes 2021-11-18T10:37:54.543 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 880808960 bytes 2021-11-18T10:37:54.586 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 902187008 bytes 2021-11-18T10:37:54.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~16s 2021-11-18T10:37:54.661 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 931123200 bytes 2021-11-18T10:37:54.725 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 976584704 bytes 2021-11-18T10:37:54.798 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1008011264 bytes 2021-11-18T10:37:54.873 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1056846848 bytes 2021-11-18T10:37:54.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1064051712 bytes 2021-11-18T10:37:54.982 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1092421632 bytes 2021-11-18T10:37:55.066 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1152759808 bytes 2021-11-18T10:37:55.126 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1185381376 bytes 2021-11-18T10:37:55.201 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1242484736 bytes 2021-11-18T10:37:55.275 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1281219584 bytes 2021-11-18T10:37:55.359 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1349048320 bytes 2021-11-18T10:37:55.445 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1404153856 bytes 2021-11-18T10:37:55.493 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1410221056 bytes 2021-11-18T10:37:55.566 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1449540608 bytes 2021-11-18T10:37:55.645 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1518147584 bytes 2021-11-18T10:37:55.746 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1622200320 bytes 2021-11-18T10:37:55.830 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1671515136 bytes 2021-11-18T10:37:55.898 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1714381824 bytes 2021-11-18T10:37:55.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1751806976 bytes 2021-11-18T10:37:56.042 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1800279040 bytes 2021-11-18T10:37:56.104 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1831975936 bytes 2021-11-18T10:37:56.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1832590336 bytes 2021-11-18T10:37:56.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1889935360 bytes 2021-11-18T10:37:56.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1931242496 bytes 2021-11-18T10:37:56.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1955644416 bytes 2021-11-18T10:37:56.441 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1999210496 bytes 2021-11-18T10:37:56.510 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2030637056 bytes 2021-11-18T10:37:56.590 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2079171584 bytes 2021-11-18T10:37:56.661 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2117808128 bytes 2021-11-18T10:37:56.720 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2151263232 bytes 2021-11-18T10:37:56.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2202498048 bytes 2021-11-18T10:37:56.860 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2227526656 bytes 2021-11-18T10:37:56.947 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2291773440 bytes 2021-11-18T10:37:57.055 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2378385408 bytes 2021-11-18T10:37:57.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2398223360 bytes 2021-11-18T10:37:57.230 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2547163136 bytes 2021-11-18T10:37:57.335 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2614523904 bytes 2021-11-18T10:37:57.366 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:37:57.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:37:57.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:37:57.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:37:57.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:37:57.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_33 2021-11-18T10:37:57.368 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_33 snapshot 128M 2021-11-18T10:37:57.368 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:57.368 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:57.369 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:57.369 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:57.369 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_33 2021-11-18T10:37:57.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:57.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:57.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:37:57.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:57.370 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_33 128M 2021-11-18T10:37:57.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:57.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:57.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:57.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:57.372 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_33 2021-11-18T10:37:57.372 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:57.372 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:37:57.373 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:37:57.373 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:37:57.373 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:37:57.373 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_33 2021-11-18T10:37:57.398 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:37:57.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_33 snapshot 2021-11-18T10:37:57.399 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:57.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:57.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_33 2021-11-18T10:37:57.400 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:37:57.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_33 snapshot 2021-11-18T10:37:58.155 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:37:58.187 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_33 2021-11-18T10:37:58.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_33': 2021-11-18T10:37:58.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:37:58.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:37:58.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:37:58.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 14137ade86c3 2021-11-18T10:37:58.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.14137ade86c3 2021-11-18T10:37:58.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:37:58.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:37:58.225 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:37:58.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:37:58.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:37:57 2021 2021-11-18T10:37:58.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:37:57 2021 2021-11-18T10:37:58.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:37:57 2021 2021-11-18T10:37:58.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:37:58.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:37:58.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: c7df849c-cc73-4e96-8b6a-98249d255e63 2021-11-18T10:37:58.227 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:37:58.239 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:37:58.239 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_33 2021-11-18T10:37:58.239 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:37:58.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:37:58.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_33 2021-11-18T10:37:58.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:37:58.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=14 2021-11-18T10:37:58.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:37:58.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 14s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_33 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:37:58.690 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 69496832 bytes 2021-11-18T10:37:58.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 82306048 bytes 2021-11-18T10:37:58.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 99867648 bytes 2021-11-18T10:37:59.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 139814912 bytes 2021-11-18T10:37:59.172 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 186032128 bytes 2021-11-18T10:37:59.261 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 213529600 bytes 2021-11-18T10:37:59.339 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 250289152 bytes 2021-11-18T10:37:59.408 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 269306880 bytes 2021-11-18T10:37:59.488 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 302722048 bytes 2021-11-18T10:37:59.565 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 359961600 bytes 2021-11-18T10:37:59.616 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 360589312 bytes 2021-11-18T10:37:59.695 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 405367808 bytes 2021-11-18T10:37:59.781 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 450032640 bytes 2021-11-18T10:37:59.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 504560640 bytes 2021-11-18T10:37:59.951 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 570756096 bytes 2021-11-18T10:38:00.044 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~22s 2021-11-18T10:38:00.056 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 657827840 bytes 2021-11-18T10:38:00.109 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 675548160 bytes 2021-11-18T10:38:00.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 715262976 bytes 2021-11-18T10:38:00.272 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 795688960 bytes 2021-11-18T10:38:00.363 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 860808192 bytes 2021-11-18T10:38:00.432 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 884036608 bytes 2021-11-18T10:38:00.514 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 952938496 bytes 2021-11-18T10:38:00.596 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 999881728 bytes 2021-11-18T10:38:00.662 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1035978752 bytes 2021-11-18T10:38:00.706 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1036615680 bytes 2021-11-18T10:38:00.783 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1077622784 bytes 2021-11-18T10:38:00.837 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1113400320 bytes 2021-11-18T10:38:00.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1144539136 bytes 2021-11-18T10:38:00.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1173794816 bytes 2021-11-18T10:38:01.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1198057472 bytes 2021-11-18T10:38:01.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1252487168 bytes 2021-11-18T10:38:01.199 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1290902528 bytes 2021-11-18T10:38:01.272 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1330813952 bytes 2021-11-18T10:38:01.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1399691264 bytes 2021-11-18T10:38:01.438 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1450054656 bytes 2021-11-18T10:38:01.518 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1504610304 bytes 2021-11-18T10:38:01.613 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1547433984 bytes 2021-11-18T10:38:01.665 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1557569536 bytes 2021-11-18T10:38:01.719 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1570968576 bytes 2021-11-18T10:38:01.803 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1621107712 bytes 2021-11-18T10:38:01.894 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1693854720 bytes 2021-11-18T10:38:01.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1735682048 bytes 2021-11-18T10:38:02.020 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1763503104 bytes 2021-11-18T10:38:02.119 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1827510272 bytes 2021-11-18T10:38:02.169 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1853818880 bytes 2021-11-18T10:38:02.277 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1914320896 bytes 2021-11-18T10:38:02.347 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1948695552 bytes 2021-11-18T10:38:02.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1967640576 bytes 2021-11-18T10:38:02.489 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2013646848 bytes 2021-11-18T10:38:02.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2036038656 bytes 2021-11-18T10:38:02.615 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2055531520 bytes 2021-11-18T10:38:02.690 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2137555968 bytes 2021-11-18T10:38:02.762 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2154827776 bytes 2021-11-18T10:38:02.833 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2192926720 bytes 2021-11-18T10:38:02.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2267028480 bytes 2021-11-18T10:38:03.010 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2316612608 bytes 2021-11-18T10:38:03.076 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2349566976 bytes 2021-11-18T10:38:03.124 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2366503936 bytes 2021-11-18T10:38:03.182 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2372179968 bytes 2021-11-18T10:38:03.262 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2422479872 bytes 2021-11-18T10:38:03.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2456688640 bytes 2021-11-18T10:38:03.439 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2577990656 bytes 2021-11-18T10:38:03.524 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2613780480 bytes 2021-11-18T10:38:03.593 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2651969536 bytes 2021-11-18T10:38:03.640 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2652576768 bytes 2021-11-18T10:38:03.724 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2708672512 bytes 2021-11-18T10:38:03.804 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2753827840 bytes 2021-11-18T10:38:03.889 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2812854272 bytes 2021-11-18T10:38:03.980 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2872924160 bytes 2021-11-18T10:38:04.039 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2902064128 bytes 2021-11-18T10:38:04.111 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2937994240 bytes 2021-11-18T10:38:04.183 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2986058752 bytes 2021-11-18T10:38:04.258 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3022371840 bytes 2021-11-18T10:38:04.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3040624640 bytes 2021-11-18T10:38:04.388 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3074488320 bytes 2021-11-18T10:38:04.481 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3161048064 bytes 2021-11-18T10:38:04.539 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3161686016 bytes 2021-11-18T10:38:04.636 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3238577152 bytes 2021-11-18T10:38:04.750 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3339228160 bytes 2021-11-18T10:38:04.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3367458816 bytes 2021-11-18T10:38:04.881 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3397378048 bytes 2021-11-18T10:38:04.957 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3429022720 bytes 2021-11-18T10:38:05.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3449293824 bytes 2021-11-18T10:38:05.127 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3543266304 bytes 2021-11-18T10:38:05.195 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3579947008 bytes 2021-11-18T10:38:05.286 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3645009920 bytes 2021-11-18T10:38:05.371 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3700744192 bytes 2021-11-18T10:38:05.430 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3725718528 bytes 2021-11-18T10:38:05.450 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~27s 2021-11-18T10:38:05.511 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3768658944 bytes 2021-11-18T10:38:05.602 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3838020608 bytes 2021-11-18T10:38:05.690 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3898101760 bytes 2021-11-18T10:38:05.765 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3936839680 bytes 2021-11-18T10:38:05.848 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3996552192 bytes 2021-11-18T10:38:05.905 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 4013284352 bytes 2021-11-18T10:38:05.981 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 4059623424 bytes 2021-11-18T10:38:06.077 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 4121448448 bytes 2021-11-18T10:38:06.145 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 4152726528 bytes 2021-11-18T10:38:06.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4203104256 bytes 2021-11-18T10:38:06.417 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4260685824 bytes 2021-11-18T10:38:06.417 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4274194432 bytes 2021-11-18T10:38:06.464 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 4341815296 bytes 2021-11-18T10:38:06.528 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 4367153152 bytes 2021-11-18T10:38:06.591 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 4390111232 bytes 2021-11-18T10:38:06.661 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4415867904 bytes 2021-11-18T10:38:06.752 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4491699200 bytes 2021-11-18T10:38:06.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4523497472 bytes 2021-11-18T10:38:06.902 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4587645952 bytes 2021-11-18T10:38:06.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4621970432 bytes 2021-11-18T10:38:07.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4675036160 bytes 2021-11-18T10:38:07.113 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4681412608 bytes 2021-11-18T10:38:07.182 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4714186752 bytes 2021-11-18T10:38:07.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4749793280 bytes 2021-11-18T10:38:07.333 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4805688320 bytes 2021-11-18T10:38:07.425 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4852773888 bytes 2021-11-18T10:38:07.521 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4925200384 bytes 2021-11-18T10:38:07.580 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4944181248 bytes 2021-11-18T10:38:07.626 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 4944797696 bytes 2021-11-18T10:38:07.693 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 4980539392 bytes 2021-11-18T10:38:07.774 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 5039916032 bytes 2021-11-18T10:38:07.828 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 5060882432 bytes 2021-11-18T10:38:07.893 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 5068517376 bytes 2021-11-18T10:38:07.941 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 5069126656 bytes 2021-11-18T10:38:08.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 5110214656 bytes 2021-11-18T10:38:08.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 5127136256 bytes 2021-11-18T10:38:08.143 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12500 IOs, 5144282112 bytes 2021-11-18T10:38:08.220 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12600 IOs, 5190567936 bytes 2021-11-18T10:38:08.302 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12700 IOs, 5251293184 bytes 2021-11-18T10:38:08.378 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12800 IOs, 5291090944 bytes 2021-11-18T10:38:08.458 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12900 IOs, 5329510400 bytes 2021-11-18T10:38:08.524 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13000 IOs, 5360089088 bytes 2021-11-18T10:38:08.594 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13100 IOs, 5398386688 bytes 2021-11-18T10:38:08.691 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13200 IOs, 5476108288 bytes 2021-11-18T10:38:08.774 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13300 IOs, 5522580480 bytes 2021-11-18T10:38:08.856 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13400 IOs, 5574351872 bytes 2021-11-18T10:38:08.925 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13500 IOs, 5599448064 bytes 2021-11-18T10:38:08.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13600 IOs, 5611656192 bytes 2021-11-18T10:38:09.065 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13700 IOs, 5675754496 bytes 2021-11-18T10:38:09.136 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13800 IOs, 5701368832 bytes 2021-11-18T10:38:09.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13900 IOs, 5701981184 bytes 2021-11-18T10:38:09.253 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14000 IOs, 5741000704 bytes 2021-11-18T10:38:09.364 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14100 IOs, 5830126592 bytes 2021-11-18T10:38:09.450 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14200 IOs, 5877257216 bytes 2021-11-18T10:38:09.507 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14300 IOs, 5896026112 bytes 2021-11-18T10:38:09.602 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14400 IOs, 5965143040 bytes 2021-11-18T10:38:09.611 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.9566752565103608) > weight (0.25) 2021-11-18T10:38:09.611 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.1 2021-11-18T10:38:09.612 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Sent signal 15 2021-11-18T10:38:09.612 INFO:tasks.rbd_mirror_thrash:waiting for 5 secs before reviving daemons 2021-11-18T10:38:09.613 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:2021-11-18T10:38:09.616+0000 7f407dd26700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 (PID: 50387) UID: 1000 2021-11-18T10:38:09.685 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14500 IOs, 6012528640 bytes 2021-11-18T10:38:09.793 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14600 IOs, 6100807680 bytes 2021-11-18T10:38:09.813 INFO:tasks.rbd_mirror.cluster2.client.mirror.1.gibba019.stderr:daemon-helper: command failed with exit status 1 2021-11-18T10:38:09.849 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14700 IOs, 6115577856 bytes 2021-11-18T10:38:09.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14800 IOs, 6148551680 bytes 2021-11-18T10:38:09.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14900 IOs, 6175677440 bytes 2021-11-18T10:38:10.052 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15000 IOs, 6214206464 bytes 2021-11-18T10:38:10.130 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15100 IOs, 6231171072 bytes 2021-11-18T10:38:10.217 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15200 IOs, 6285775872 bytes 2021-11-18T10:38:10.279 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15300 IOs, 6307015680 bytes 2021-11-18T10:38:10.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15400 IOs, 6328381440 bytes 2021-11-18T10:38:10.445 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15500 IOs, 6406205440 bytes 2021-11-18T10:38:10.506 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15600 IOs, 6425952256 bytes 2021-11-18T10:38:10.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15700 IOs, 6455667712 bytes 2021-11-18T10:38:10.624 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15800 IOs, 6476789760 bytes 2021-11-18T10:38:10.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15900 IOs, 6530221056 bytes 2021-11-18T10:38:10.761 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16000 IOs, 6532304896 bytes 2021-11-18T10:38:10.824 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16100 IOs, 6563033088 bytes 2021-11-18T10:38:10.865 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~32s 2021-11-18T10:38:10.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16200 IOs, 6621765632 bytes 2021-11-18T10:38:10.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16300 IOs, 6660953088 bytes 2021-11-18T10:38:11.043 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16400 IOs, 6690713600 bytes 2021-11-18T10:38:11.108 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16500 IOs, 6728446976 bytes 2021-11-18T10:38:11.214 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16600 IOs, 6801359872 bytes 2021-11-18T10:38:11.284 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16700 IOs, 6842826752 bytes 2021-11-18T10:38:11.367 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16800 IOs, 6896145408 bytes 2021-11-18T10:38:11.431 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16900 IOs, 6925925376 bytes 2021-11-18T10:38:11.501 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17000 IOs, 6959589376 bytes 2021-11-18T10:38:11.575 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17100 IOs, 7018920960 bytes 2021-11-18T10:38:11.676 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17200 IOs, 7097783296 bytes 2021-11-18T10:38:11.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17300 IOs, 7145658368 bytes 2021-11-18T10:38:11.817 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17400 IOs, 7146260480 bytes 2021-11-18T10:38:11.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17500 IOs, 7178194944 bytes 2021-11-18T10:38:11.948 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17600 IOs, 7208764416 bytes 2021-11-18T10:38:12.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17700 IOs, 7236818944 bytes 2021-11-18T10:38:12.095 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17800 IOs, 7284055040 bytes 2021-11-18T10:38:12.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17900 IOs, 7335942144 bytes 2021-11-18T10:38:12.232 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:18000 IOs, 7353693184 bytes 2021-11-18T10:38:12.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:38:12.246 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:38:12.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:38:12.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:38:12.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:38:12.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_34 2021-11-18T10:38:12.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_34 snapshot 128M 2021-11-18T10:38:12.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:12.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:12.248 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:12.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:12.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_34 2021-11-18T10:38:12.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:12.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:38:12.249 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:38:12.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:12.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_34 128M 2021-11-18T10:38:12.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:12.250 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:12.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:12.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:12.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_34 2021-11-18T10:38:12.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:12.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:38:12.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:38:12.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:38:12.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:12.252 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_34 2021-11-18T10:38:12.279 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:38:12.280 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_34 snapshot 2021-11-18T10:38:12.280 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:12.280 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:12.281 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_34 2021-11-18T10:38:12.281 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:38:12.281 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_34 snapshot 2021-11-18T10:38:13.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:38:13.263 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_34 2021-11-18T10:38:13.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_34': 2021-11-18T10:38:13.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:38:13.301 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:38:13.302 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:38:13.302 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 141ed8578801 2021-11-18T10:38:13.302 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.141ed8578801 2021-11-18T10:38:13.303 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:38:13.303 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:38:13.304 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:38:13.304 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:38:13.305 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:38:12 2021 2021-11-18T10:38:13.305 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:38:12 2021 2021-11-18T10:38:13.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:38:12 2021 2021-11-18T10:38:13.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:38:13.306 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:38:13.307 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 28e60901-e33b-45f1-b9e5-344df0855afe 2021-11-18T10:38:13.307 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:38:13.310 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:38:13.311 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_34 2021-11-18T10:38:13.311 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:13.312 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:13.312 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_34 2021-11-18T10:38:13.313 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:38:13.313 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=8 2021-11-18T10:38:13.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:38:13.314 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 8s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_34 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:38:13.671 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 30524416 bytes 2021-11-18T10:38:13.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 77524992 bytes 2021-11-18T10:38:14.085 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 172673024 bytes 2021-11-18T10:38:14.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 215483392 bytes 2021-11-18T10:38:14.287 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 251837440 bytes 2021-11-18T10:38:14.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 312797184 bytes 2021-11-18T10:38:14.480 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 337987584 bytes 2021-11-18T10:38:14.549 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 345364480 bytes 2021-11-18T10:38:14.613 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.1 2021-11-18T10:38:14.613 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:38:14.614 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-11-18T10:38:14.614 INFO:tasks.rbd_mirror_thrash:reviving cluster2.client.mirror.1 2021-11-18T10:38:14.614 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Restarting daemon 2021-11-18T10:38:14.615 DEBUG:teuthology.orchestra.run.gibba019:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.1 2021-11-18T10:38:14.620 INFO:tasks.rbd_mirror.cluster2.client.mirror.1:Started 2021-11-18T10:38:14.621 INFO:tasks.rbd_mirror_thrash:waiting for 72 secs before thrashing 2021-11-18T10:38:14.666 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 417933312 bytes 2021-11-18T10:38:14.738 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 435693568 bytes 2021-11-18T10:38:14.815 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 486567936 bytes 2021-11-18T10:38:14.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 510589952 bytes 2021-11-18T10:38:14.995 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 567309312 bytes 2021-11-18T10:38:15.078 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 611174400 bytes 2021-11-18T10:38:15.161 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 658123776 bytes 2021-11-18T10:38:15.238 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 683401216 bytes 2021-11-18T10:38:15.300 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 696758272 bytes 2021-11-18T10:38:15.387 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 750623744 bytes 2021-11-18T10:38:15.484 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 794057728 bytes 2021-11-18T10:38:15.557 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 836774912 bytes 2021-11-18T10:38:15.647 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 901357568 bytes 2021-11-18T10:38:15.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 950940672 bytes 2021-11-18T10:38:15.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 1025494016 bytes 2021-11-18T10:38:15.901 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1070401536 bytes 2021-11-18T10:38:15.944 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1071015936 bytes 2021-11-18T10:38:16.013 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1099310080 bytes 2021-11-18T10:38:16.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1209458688 bytes 2021-11-18T10:38:16.188 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1238061056 bytes 2021-11-18T10:38:16.234 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1247099904 bytes 2021-11-18T10:38:16.271 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~38s 2021-11-18T10:38:16.307 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1282495488 bytes 2021-11-18T10:38:16.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1324293120 bytes 2021-11-18T10:38:16.462 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1354895360 bytes 2021-11-18T10:38:16.528 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1389058048 bytes 2021-11-18T10:38:16.597 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1432651776 bytes 2021-11-18T10:38:16.644 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1436456960 bytes 2021-11-18T10:38:16.716 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1471008768 bytes 2021-11-18T10:38:16.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1518786560 bytes 2021-11-18T10:38:16.871 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1587206144 bytes 2021-11-18T10:38:16.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1623275520 bytes 2021-11-18T10:38:17.017 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1684737024 bytes 2021-11-18T10:38:17.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1756888064 bytes 2021-11-18T10:38:17.157 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1769025536 bytes 2021-11-18T10:38:17.223 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1789045760 bytes 2021-11-18T10:38:17.282 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1811248128 bytes 2021-11-18T10:38:17.338 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1836144640 bytes 2021-11-18T10:38:17.401 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1861569536 bytes 2021-11-18T10:38:17.476 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1901379584 bytes 2021-11-18T10:38:17.562 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1957227520 bytes 2021-11-18T10:38:17.660 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 2037354496 bytes 2021-11-18T10:38:17.729 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 2071454720 bytes 2021-11-18T10:38:17.823 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 2148625408 bytes 2021-11-18T10:38:17.890 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 2188763136 bytes 2021-11-18T10:38:17.937 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2197322752 bytes 2021-11-18T10:38:17.986 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2211770368 bytes 2021-11-18T10:38:18.053 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2258315264 bytes 2021-11-18T10:38:18.128 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2307283968 bytes 2021-11-18T10:38:18.233 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2392446976 bytes 2021-11-18T10:38:18.299 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2421794816 bytes 2021-11-18T10:38:18.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2479209472 bytes 2021-11-18T10:38:18.435 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2485547008 bytes 2021-11-18T10:38:18.531 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2562683904 bytes 2021-11-18T10:38:18.582 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2572107776 bytes 2021-11-18T10:38:18.655 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2633242624 bytes 2021-11-18T10:38:18.736 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2673586176 bytes 2021-11-18T10:38:18.789 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2697155584 bytes 2021-11-18T10:38:18.850 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2726998016 bytes 2021-11-18T10:38:18.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2807091200 bytes 2021-11-18T10:38:18.997 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2824203264 bytes 2021-11-18T10:38:19.050 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2839349248 bytes 2021-11-18T10:38:19.117 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2871416832 bytes 2021-11-18T10:38:19.173 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2901015552 bytes 2021-11-18T10:38:19.247 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2941436928 bytes 2021-11-18T10:38:19.347 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 3047296000 bytes 2021-11-18T10:38:19.443 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 3124433920 bytes 2021-11-18T10:38:19.491 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 3143764992 bytes 2021-11-18T10:38:19.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 3199688704 bytes 2021-11-18T10:38:19.640 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3224889344 bytes 2021-11-18T10:38:19.685 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3228717056 bytes 2021-11-18T10:38:19.795 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3311527936 bytes 2021-11-18T10:38:19.870 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3364505600 bytes 2021-11-18T10:38:19.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3378696192 bytes 2021-11-18T10:38:19.996 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3418591232 bytes 2021-11-18T10:38:20.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3427983360 bytes 2021-11-18T10:38:20.147 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3512465408 bytes 2021-11-18T10:38:20.197 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3518935040 bytes 2021-11-18T10:38:20.251 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3535709184 bytes 2021-11-18T10:38:20.332 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3596588032 bytes 2021-11-18T10:38:20.409 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3653528576 bytes 2021-11-18T10:38:20.486 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3694471168 bytes 2021-11-18T10:38:20.539 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3709714432 bytes 2021-11-18T10:38:20.602 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3741919232 bytes 2021-11-18T10:38:20.707 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3824436224 bytes 2021-11-18T10:38:20.792 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3900085248 bytes 2021-11-18T10:38:20.864 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3941886976 bytes 2021-11-18T10:38:20.936 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3980490752 bytes 2021-11-18T10:38:20.983 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 4004826112 bytes 2021-11-18T10:38:21.059 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 4051734528 bytes 2021-11-18T10:38:21.141 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 4084382720 bytes 2021-11-18T10:38:21.184 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 4085004288 bytes 2021-11-18T10:38:21.270 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 4158612480 bytes 2021-11-18T10:38:21.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:38:21.316 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:38:21.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:38:21.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:38:21.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:38:21.317 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_35 2021-11-18T10:38:21.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_35 snapshot 128M 2021-11-18T10:38:21.318 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:21.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:21.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:21.319 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:21.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_35 2021-11-18T10:38:21.320 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:21.322 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:38:21.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:38:21.323 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:21.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_35 128M 2021-11-18T10:38:21.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:21.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:21.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:21.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:21.326 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_35 2021-11-18T10:38:21.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:21.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:38:21.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:38:21.327 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:38:21.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:21.328 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_35 2021-11-18T10:38:21.356 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:38:21.356 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_35 snapshot 2021-11-18T10:38:21.356 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:21.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:21.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_35 2021-11-18T10:38:21.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:38:21.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_35 snapshot 2021-11-18T10:38:21.677 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~43s 2021-11-18T10:38:22.283 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:38:22.311 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_35 2021-11-18T10:38:22.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_35': 2021-11-18T10:38:22.377 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:38:22.378 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:38:22.378 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:38:22.378 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 1432cca92a31 2021-11-18T10:38:22.378 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.1432cca92a31 2021-11-18T10:38:22.379 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:38:22.379 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:38:22.379 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:38:22.379 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:38:22.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:38:21 2021 2021-11-18T10:38:22.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:38:21 2021 2021-11-18T10:38:22.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:38:21 2021 2021-11-18T10:38:22.380 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:38:22.381 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:38:22.381 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: e0739a21-90e4-40e2-939b-b1dcfdae452a 2021-11-18T10:38:22.381 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:38:22.382 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:38:22.383 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_35 2021-11-18T10:38:22.383 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:22.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:22.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_35 2021-11-18T10:38:22.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:38:22.384 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=12 2021-11-18T10:38:22.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:38:22.385 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 12s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_35 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:38:22.703 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 45386752 bytes 2021-11-18T10:38:22.969 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 106413056 bytes 2021-11-18T10:38:23.044 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 130825216 bytes 2021-11-18T10:38:23.129 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 165449728 bytes 2021-11-18T10:38:23.215 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 220588032 bytes 2021-11-18T10:38:23.284 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 238243840 bytes 2021-11-18T10:38:23.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 260140032 bytes 2021-11-18T10:38:23.465 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 358364160 bytes 2021-11-18T10:38:23.526 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 381456384 bytes 2021-11-18T10:38:23.592 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 421608448 bytes 2021-11-18T10:38:23.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 478906368 bytes 2021-11-18T10:38:23.726 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 498534400 bytes 2021-11-18T10:38:23.788 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 536343552 bytes 2021-11-18T10:38:23.851 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 577095680 bytes 2021-11-18T10:38:23.900 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 577722368 bytes 2021-11-18T10:38:23.954 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 603038720 bytes 2021-11-18T10:38:24.007 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 634287104 bytes 2021-11-18T10:38:24.075 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 675633152 bytes 2021-11-18T10:38:24.119 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 700903424 bytes 2021-11-18T10:38:24.186 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 734893056 bytes 2021-11-18T10:38:24.240 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 779407360 bytes 2021-11-18T10:38:24.304 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 800899072 bytes 2021-11-18T10:38:24.361 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 831333376 bytes 2021-11-18T10:38:24.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 878143488 bytes 2021-11-18T10:38:24.487 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 912271360 bytes 2021-11-18T10:38:24.539 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 938487808 bytes 2021-11-18T10:38:24.615 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 985100288 bytes 2021-11-18T10:38:24.666 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2800 IOs, 1028104192 bytes 2021-11-18T10:38:24.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2900 IOs, 1069992960 bytes 2021-11-18T10:38:25.030 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3000 IOs, 1175444480 bytes 2021-11-18T10:38:25.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3100 IOs, 1267516416 bytes 2021-11-18T10:38:25.177 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3200 IOs, 1288775680 bytes 2021-11-18T10:38:25.234 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3300 IOs, 1319247872 bytes 2021-11-18T10:38:25.277 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3400 IOs, 1322980352 bytes 2021-11-18T10:38:25.334 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3500 IOs, 1373149184 bytes 2021-11-18T10:38:25.396 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3600 IOs, 1398617088 bytes 2021-11-18T10:38:25.450 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3700 IOs, 1421590528 bytes 2021-11-18T10:38:25.467 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:38:25.469+0000 7fc5ccfe3700 -1 reset not still connected to 0x56196b2b0000 2021-11-18T10:38:25.506 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3800 IOs, 1468713984 bytes 2021-11-18T10:38:25.564 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:3900 IOs, 1479011328 bytes 2021-11-18T10:38:25.637 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4000 IOs, 1532530688 bytes 2021-11-18T10:38:25.697 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4100 IOs, 1584834560 bytes 2021-11-18T10:38:25.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4200 IOs, 1631325184 bytes 2021-11-18T10:38:25.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4300 IOs, 1633914880 bytes 2021-11-18T10:38:25.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4400 IOs, 1666548736 bytes 2021-11-18T10:38:25.930 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4500 IOs, 1684780032 bytes 2021-11-18T10:38:25.991 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4600 IOs, 1720230912 bytes 2021-11-18T10:38:26.045 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4700 IOs, 1749016576 bytes 2021-11-18T10:38:26.115 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4800 IOs, 1808628736 bytes 2021-11-18T10:38:26.183 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:38:26.186+0000 7fc5ccfe3700 -1 reset not still connected to 0x56196b2b0000 2021-11-18T10:38:26.188 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:4900 IOs, 1855811584 bytes 2021-11-18T10:38:26.273 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5000 IOs, 1910459392 bytes 2021-11-18T10:38:26.325 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5100 IOs, 1938203648 bytes 2021-11-18T10:38:26.387 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5200 IOs, 1975902208 bytes 2021-11-18T10:38:26.450 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5300 IOs, 2023915520 bytes 2021-11-18T10:38:26.503 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5400 IOs, 2054375424 bytes 2021-11-18T10:38:26.575 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5500 IOs, 2112373760 bytes 2021-11-18T10:38:26.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5600 IOs, 2139843584 bytes 2021-11-18T10:38:26.673 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5700 IOs, 2167121920 bytes 2021-11-18T10:38:26.726 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5800 IOs, 2175826944 bytes 2021-11-18T10:38:26.730 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:38:26.733+0000 7fc5ccfe3700 -1 reset not still connected to 0x56196b2b0000 2021-11-18T10:38:26.799 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:5900 IOs, 2239962112 bytes 2021-11-18T10:38:26.852 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6000 IOs, 2252460032 bytes 2021-11-18T10:38:26.914 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6100 IOs, 2296742912 bytes 2021-11-18T10:38:26.958 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6200 IOs, 2303423488 bytes 2021-11-18T10:38:27.034 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6300 IOs, 2371921920 bytes 2021-11-18T10:38:27.081 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~49s 2021-11-18T10:38:27.088 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6400 IOs, 2411526144 bytes 2021-11-18T10:38:27.151 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6500 IOs, 2443208704 bytes 2021-11-18T10:38:27.231 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6600 IOs, 2507555840 bytes 2021-11-18T10:38:27.285 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6700 IOs, 2533605376 bytes 2021-11-18T10:38:27.360 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6800 IOs, 2589409280 bytes 2021-11-18T10:38:27.429 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:6900 IOs, 2640410624 bytes 2021-11-18T10:38:27.508 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7000 IOs, 2711590912 bytes 2021-11-18T10:38:27.567 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7100 IOs, 2735113216 bytes 2021-11-18T10:38:27.620 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7200 IOs, 2767413248 bytes 2021-11-18T10:38:27.682 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7300 IOs, 2811400192 bytes 2021-11-18T10:38:27.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7400 IOs, 2835002368 bytes 2021-11-18T10:38:27.814 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7500 IOs, 2906158080 bytes 2021-11-18T10:38:27.899 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7600 IOs, 2981729280 bytes 2021-11-18T10:38:27.952 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7700 IOs, 3001344000 bytes 2021-11-18T10:38:28.005 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7800 IOs, 3033111552 bytes 2021-11-18T10:38:28.062 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:7900 IOs, 3060663296 bytes 2021-11-18T10:38:28.144 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8000 IOs, 3117292544 bytes 2021-11-18T10:38:28.200 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8100 IOs, 3141316608 bytes 2021-11-18T10:38:28.237 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8200 IOs, 3141945344 bytes 2021-11-18T10:38:28.303 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8300 IOs, 3200771072 bytes 2021-11-18T10:38:28.357 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8400 IOs, 3212879872 bytes 2021-11-18T10:38:28.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8500 IOs, 3239484416 bytes 2021-11-18T10:38:28.468 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8600 IOs, 3277905920 bytes 2021-11-18T10:38:28.526 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8700 IOs, 3304650752 bytes 2021-11-18T10:38:28.603 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8800 IOs, 3362778112 bytes 2021-11-18T10:38:28.651 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:8900 IOs, 3381832704 bytes 2021-11-18T10:38:28.721 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9000 IOs, 3426583552 bytes 2021-11-18T10:38:28.785 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9100 IOs, 3463536640 bytes 2021-11-18T10:38:28.834 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9200 IOs, 3482114048 bytes 2021-11-18T10:38:28.891 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9300 IOs, 3510220800 bytes 2021-11-18T10:38:28.972 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9400 IOs, 3600485376 bytes 2021-11-18T10:38:29.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9500 IOs, 3646791680 bytes 2021-11-18T10:38:29.116 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9600 IOs, 3688777728 bytes 2021-11-18T10:38:29.192 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9700 IOs, 3760409600 bytes 2021-11-18T10:38:29.459 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9800 IOs, 3769596928 bytes 2021-11-18T10:38:29.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:9900 IOs, 3781857280 bytes 2021-11-18T10:38:29.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10000 IOs, 3831573504 bytes 2021-11-18T10:38:29.460 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10100 IOs, 3858214912 bytes 2021-11-18T10:38:29.481 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10200 IOs, 3902481408 bytes 2021-11-18T10:38:29.533 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10300 IOs, 3921867776 bytes 2021-11-18T10:38:29.615 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10400 IOs, 4018007040 bytes 2021-11-18T10:38:29.692 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10500 IOs, 4098016256 bytes 2021-11-18T10:38:29.755 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10600 IOs, 4113202176 bytes 2021-11-18T10:38:29.829 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10700 IOs, 4181585920 bytes 2021-11-18T10:38:29.879 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10800 IOs, 4195237888 bytes 2021-11-18T10:38:29.974 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:10900 IOs, 4293145600 bytes 2021-11-18T10:38:30.018 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11000 IOs, 4303309824 bytes 2021-11-18T10:38:30.057 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11100 IOs, 4303922176 bytes 2021-11-18T10:38:30.118 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11200 IOs, 4345271296 bytes 2021-11-18T10:38:30.176 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11300 IOs, 4370418688 bytes 2021-11-18T10:38:30.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11400 IOs, 4396425216 bytes 2021-11-18T10:38:30.287 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11500 IOs, 4431488000 bytes 2021-11-18T10:38:30.340 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11600 IOs, 4456033280 bytes 2021-11-18T10:38:30.388 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11700 IOs, 4473311232 bytes 2021-11-18T10:38:30.437 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11800 IOs, 4491441152 bytes 2021-11-18T10:38:30.477 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:11900 IOs, 4493262848 bytes 2021-11-18T10:38:30.517 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12000 IOs, 4493872128 bytes 2021-11-18T10:38:30.571 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12100 IOs, 4507687936 bytes 2021-11-18T10:38:30.655 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12200 IOs, 4596784128 bytes 2021-11-18T10:38:30.730 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12300 IOs, 4641782784 bytes 2021-11-18T10:38:30.791 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12400 IOs, 4706252800 bytes 2021-11-18T10:38:30.895 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12500 IOs, 4785315840 bytes 2021-11-18T10:38:30.956 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12600 IOs, 4814583808 bytes 2021-11-18T10:38:31.035 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12700 IOs, 4866453504 bytes 2021-11-18T10:38:31.092 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12800 IOs, 4899347456 bytes 2021-11-18T10:38:31.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:12900 IOs, 4927335424 bytes 2021-11-18T10:38:31.226 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13000 IOs, 4987424768 bytes 2021-11-18T10:38:31.288 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13100 IOs, 5037201408 bytes 2021-11-18T10:38:31.334 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13200 IOs, 5037788160 bytes 2021-11-18T10:38:31.397 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13300 IOs, 5090150400 bytes 2021-11-18T10:38:31.449 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13400 IOs, 5134129152 bytes 2021-11-18T10:38:31.525 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13500 IOs, 5164038144 bytes 2021-11-18T10:38:31.583 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13600 IOs, 5199984640 bytes 2021-11-18T10:38:31.659 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13700 IOs, 5259077632 bytes 2021-11-18T10:38:31.715 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13800 IOs, 5277855744 bytes 2021-11-18T10:38:31.784 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:13900 IOs, 5328181248 bytes 2021-11-18T10:38:31.857 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14000 IOs, 5379554304 bytes 2021-11-18T10:38:31.910 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14100 IOs, 5399948288 bytes 2021-11-18T10:38:31.988 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14200 IOs, 5472039936 bytes 2021-11-18T10:38:32.063 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14300 IOs, 5534249984 bytes 2021-11-18T10:38:32.149 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14400 IOs, 5604268032 bytes 2021-11-18T10:38:32.423 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14500 IOs, 5675703296 bytes 2021-11-18T10:38:32.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~54s 2021-11-18T10:38:32.491 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14600 IOs, 5725634560 bytes 2021-11-18T10:38:32.585 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14700 IOs, 5800133632 bytes 2021-11-18T10:38:32.635 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14800 IOs, 5843683328 bytes 2021-11-18T10:38:32.690 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:14900 IOs, 5847794688 bytes 2021-11-18T10:38:32.768 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15000 IOs, 5916886016 bytes 2021-11-18T10:38:32.824 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15100 IOs, 5948505088 bytes 2021-11-18T10:38:32.861 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15200 IOs, 5950968832 bytes 2021-11-18T10:38:32.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15300 IOs, 6000987136 bytes 2021-11-18T10:38:32.968 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15400 IOs, 6004807680 bytes 2021-11-18T10:38:33.016 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15500 IOs, 6018003968 bytes 2021-11-18T10:38:33.064 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15600 IOs, 6039834624 bytes 2021-11-18T10:38:33.142 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15700 IOs, 6114849792 bytes 2021-11-18T10:38:33.241 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15800 IOs, 6199288832 bytes 2021-11-18T10:38:33.329 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:15900 IOs, 6279498752 bytes 2021-11-18T10:38:33.404 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16000 IOs, 6338280448 bytes 2021-11-18T10:38:33.474 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16100 IOs, 6399687680 bytes 2021-11-18T10:38:33.553 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16200 IOs, 6470744064 bytes 2021-11-18T10:38:33.606 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16300 IOs, 6491078656 bytes 2021-11-18T10:38:33.661 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16400 IOs, 6513012736 bytes 2021-11-18T10:38:33.735 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16500 IOs, 6571403264 bytes 2021-11-18T10:38:33.818 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16600 IOs, 6649063424 bytes 2021-11-18T10:38:33.911 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16700 IOs, 6719265792 bytes 2021-11-18T10:38:33.993 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16800 IOs, 6788674560 bytes 2021-11-18T10:38:34.051 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:16900 IOs, 6840351744 bytes 2021-11-18T10:38:34.163 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17000 IOs, 6947094528 bytes 2021-11-18T10:38:34.212 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17100 IOs, 6955746304 bytes 2021-11-18T10:38:34.269 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17200 IOs, 6994804736 bytes 2021-11-18T10:38:34.336 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:17300 IOs, 7037007872 bytes 2021-11-18T10:38:34.388 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:38:34.388 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:38:34.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:38:34.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:38:34.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:38:34.389 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_36 2021-11-18T10:38:34.390 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_36 snapshot 128M 2021-11-18T10:38:34.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:34.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:34.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:34.391 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:34.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_36 2021-11-18T10:38:34.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:34.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:38:34.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:38:34.392 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:34.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_36 128M 2021-11-18T10:38:34.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:34.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:34.393 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:34.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:34.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_36 2021-11-18T10:38:34.394 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:34.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:38:34.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:38:34.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:38:34.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:34.395 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_36 2021-11-18T10:38:34.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' image = image ']' 2021-11-18T10:38:34.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ enable_mirror cluster2 mirror image_36 snapshot 2021-11-18T10:38:34.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:34.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:34.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_36 2021-11-18T10:38:34.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:38:34.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 mirror image enable mirror/image_36 snapshot 2021-11-18T10:38:35.361 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:Mirroring enabled 2021-11-18T10:38:35.369 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster=cluster2 info mirror/image_36 2021-11-18T10:38:35.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:rbd image 'image_36': 2021-11-18T10:38:35.411 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: size 128 MiB in 32 objects 2021-11-18T10:38:35.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: order 22 (4 MiB objects) 2021-11-18T10:38:35.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: snapshot_count: 1 2021-11-18T10:38:35.412 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: id: 143c46e3e88c 2021-11-18T10:38:35.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: block_name_prefix: rbd_data.143c46e3e88c 2021-11-18T10:38:35.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: format: 2 2021-11-18T10:38:35.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: features: layering, exclusive-lock 2021-11-18T10:38:35.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: op_features: 2021-11-18T10:38:35.413 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: flags: 2021-11-18T10:38:35.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: create_timestamp: Thu Nov 18 10:38:34 2021 2021-11-18T10:38:35.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: access_timestamp: Thu Nov 18 10:38:34 2021 2021-11-18T10:38:35.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: modify_timestamp: Thu Nov 18 10:38:34 2021 2021-11-18T10:38:35.414 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring state: enabled 2021-11-18T10:38:35.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring mode: snapshot 2021-11-18T10:38:35.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring global id: 56177ea6-3f3a-4503-8311-9bdb82fd7d2c 2021-11-18T10:38:35.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: mirroring primary: true 2021-11-18T10:38:35.418 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n '' ']' 2021-11-18T10:38:35.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ stress_write_image cluster2 mirror image_36 2021-11-18T10:38:35.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:35.419 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:35.420 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_36 2021-11-18T10:38:35.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ awk 'BEGIN {srand(); print int(10 * rand()) + 5}' 2021-11-18T10:38:35.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local duration=11 2021-11-18T10:38:35.421 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set +e 2021-11-18T10:38:35.422 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ timeout 11s ceph_test_rbd_mirror_random_write --cluster cluster2 mirror image_36 --debug-rbd=20 --debug-journaler=20 2021-11-18T10:38:35.780 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:100 IOs, 28658688 bytes 2021-11-18T10:38:35.965 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:200 IOs, 38887424 bytes 2021-11-18T10:38:36.123 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:300 IOs, 137719808 bytes 2021-11-18T10:38:36.224 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:400 IOs, 185528320 bytes 2021-11-18T10:38:36.350 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:500 IOs, 273794048 bytes 2021-11-18T10:38:36.415 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:600 IOs, 289826816 bytes 2021-11-18T10:38:36.498 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:700 IOs, 342695936 bytes 2021-11-18T10:38:36.568 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:800 IOs, 361766912 bytes 2021-11-18T10:38:36.666 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:900 IOs, 405439488 bytes 2021-11-18T10:38:36.734 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1000 IOs, 441896960 bytes 2021-11-18T10:38:36.819 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1100 IOs, 512898048 bytes 2021-11-18T10:38:36.884 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1200 IOs, 534003712 bytes 2021-11-18T10:38:36.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1300 IOs, 572366848 bytes 2021-11-18T10:38:37.033 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1400 IOs, 612331520 bytes 2021-11-18T10:38:37.083 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1500 IOs, 621363200 bytes 2021-11-18T10:38:37.153 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1600 IOs, 669677568 bytes 2021-11-18T10:38:37.289 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1700 IOs, 719485952 bytes 2021-11-18T10:38:37.405 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1800 IOs, 806429696 bytes 2021-11-18T10:38:37.444 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:1900 IOs, 808241152 bytes 2021-11-18T10:38:37.517 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2000 IOs, 850506752 bytes 2021-11-18T10:38:37.573 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2100 IOs, 877399040 bytes 2021-11-18T10:38:37.628 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2200 IOs, 897657856 bytes 2021-11-18T10:38:37.702 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2300 IOs, 939394048 bytes 2021-11-18T10:38:37.789 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2400 IOs, 1003957248 bytes 2021-11-18T10:38:37.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2500 IOs, 1020988416 bytes 2021-11-18T10:38:37.891 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~59s 2021-11-18T10:38:37.924 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2600 IOs, 1084547072 bytes 2021-11-18T10:38:37.964 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:2700 IOs, 1087644672 bytes 2021-11-18T10:38:38.003 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:38:38.006+0000 7fc5d5a02700 -1 bdev(0x561956f0a000 /var/lib/ceph/osd/cluster2-1/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-18T10:38:38.005 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fc5d5a02700 time 2021-11-18T10:38:38.007713+0000 2021-11-18T10:38:38.005 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: 612: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-18T10:38:38.006 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:38:38.006 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x5619526ce1e9] 2021-11-18T10:38:38.006 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2: (KernelDevice::_aio_thread()+0xf9e) [0x5619532f545e] 2021-11-18T10:38:38.006 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5619533011b1] 2021-11-18T10:38:38.007 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 4: /lib64/libpthread.so.0(+0x814a) [0x7fc5e565214a] 2021-11-18T10:38:38.007 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 5: clone() 2021-11-18T10:38:38.007 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:*** Caught signal (Aborted) ** 2021-11-18T10:38:38.007 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: in thread 7fc5d5a02700 thread_name:bstore_aio 2021-11-18T10:38:38.007 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:38:38.008+0000 7fc5d5a02700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fc5d5a02700 time 2021-11-18T10:38:38.007713+0000 2021-11-18T10:38:38.008 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: 612: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-18T10:38:38.008 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.008 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:38:38.008 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x5619526ce1e9] 2021-11-18T10:38:38.009 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2: (KernelDevice::_aio_thread()+0xf9e) [0x5619532f545e] 2021-11-18T10:38:38.009 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5619533011b1] 2021-11-18T10:38:38.009 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 4: /lib64/libpthread.so.0(+0x814a) [0x7fc5e565214a] 2021-11-18T10:38:38.009 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 5: clone() 2021-11-18T10:38:38.009 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.010 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:38:38.010 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7fc5e565cb20] 2021-11-18T10:38:38.011 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2: gsignal() 2021-11-18T10:38:38.011 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 3: abort() 2021-11-18T10:38:38.011 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x5619526ce2bc] 2021-11-18T10:38:38.011 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 5: (KernelDevice::_aio_thread()+0xf9e) [0x5619532f545e] 2021-11-18T10:38:38.012 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5619533011b1] 2021-11-18T10:38:38.012 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 7: /lib64/libpthread.so.0(+0x814a) [0x7fc5e565214a] 2021-11-18T10:38:38.012 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 8: clone() 2021-11-18T10:38:38.012 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:2021-11-18T10:38:38.009+0000 7fc5d5a02700 -1 *** Caught signal (Aborted) ** 2021-11-18T10:38:38.012 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: in thread 7fc5d5a02700 thread_name:bstore_aio 2021-11-18T10:38:38.013 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.013 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:38:38.013 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7fc5e565cb20] 2021-11-18T10:38:38.014 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2: gsignal() 2021-11-18T10:38:38.014 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 3: abort() 2021-11-18T10:38:38.014 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x5619526ce2bc] 2021-11-18T10:38:38.014 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 5: (KernelDevice::_aio_thread()+0xf9e) [0x5619532f545e] 2021-11-18T10:38:38.015 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5619533011b1] 2021-11-18T10:38:38.015 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 7: /lib64/libpthread.so.0(+0x814a) [0x7fc5e565214a] 2021-11-18T10:38:38.015 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 8: clone() 2021-11-18T10:38:38.015 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-18T10:38:38.015 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.016 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: -244> 2021-11-18T10:38:38.006+0000 7fc5d5a02700 -1 bdev(0x561956f0a000 /var/lib/ceph/osd/cluster2-1/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-18T10:38:38.017 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: -77> 2021-11-18T10:38:38.008+0000 7fc5d5a02700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fc5d5a02700 time 2021-11-18T10:38:38.007713+0000 2021-11-18T10:38:38.017 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: 612: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-18T10:38:38.017 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.017 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:38:38.018 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x5619526ce1e9] 2021-11-18T10:38:38.018 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2: (KernelDevice::_aio_thread()+0xf9e) [0x5619532f545e] 2021-11-18T10:38:38.018 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5619533011b1] 2021-11-18T10:38:38.018 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 4: /lib64/libpthread.so.0(+0x814a) [0x7fc5e565214a] 2021-11-18T10:38:38.018 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 5: clone() 2021-11-18T10:38:38.019 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.019 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 0> 2021-11-18T10:38:38.009+0000 7fc5d5a02700 -1 *** Caught signal (Aborted) ** 2021-11-18T10:38:38.019 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: in thread 7fc5d5a02700 thread_name:bstore_aio 2021-11-18T10:38:38.019 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.020 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:38:38.020 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7fc5e565cb20] 2021-11-18T10:38:38.020 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2: gsignal() 2021-11-18T10:38:38.020 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 3: abort() 2021-11-18T10:38:38.020 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x5619526ce2bc] 2021-11-18T10:38:38.021 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 5: (KernelDevice::_aio_thread()+0xf9e) [0x5619532f545e] 2021-11-18T10:38:38.021 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5619533011b1] 2021-11-18T10:38:38.021 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 7: /lib64/libpthread.so.0(+0x814a) [0x7fc5e565214a] 2021-11-18T10:38:38.021 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 8: clone() 2021-11-18T10:38:38.022 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-18T10:38:38.022 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.024 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: -400> 2021-11-18T10:38:38.006+0000 7fc5d5a02700 -1 bdev(0x561956f0a000 /var/lib/ceph/osd/cluster2-1/block) _aio_thread got r=-28 ((28) No space left on device) 2021-11-18T10:38:38.024 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: -233> 2021-11-18T10:38:38.008+0000 7fc5d5a02700 -1 /home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7fc5d5a02700 time 2021-11-18T10:38:38.007713+0000 2021-11-18T10:38:38.024 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:/home/jenkins-build/build/workspace/ceph-dev-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos8/DIST/centos8/MACHINE_SIZE/gigantic/release/17.0.0-9003-g44cd7c76/rpm/el8/BUILD/ceph-17.0.0-9003-g44cd7c76/src/blk/kernel/KernelDevice.cc: 612: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2021-11-18T10:38:38.025 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.025 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:38:38.025 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x5619526ce1e9] 2021-11-18T10:38:38.025 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2: (KernelDevice::_aio_thread()+0xf9e) [0x5619532f545e] 2021-11-18T10:38:38.026 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 3: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5619533011b1] 2021-11-18T10:38:38.026 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 4: /lib64/libpthread.so.0(+0x814a) [0x7fc5e565214a] 2021-11-18T10:38:38.026 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 5: clone() 2021-11-18T10:38:38.026 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.027 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: -156> 2021-11-18T10:38:38.009+0000 7fc5d5a02700 -1 *** Caught signal (Aborted) ** 2021-11-18T10:38:38.027 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: in thread 7fc5d5a02700 thread_name:bstore_aio 2021-11-18T10:38:38.027 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.027 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:38:38.028 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7fc5e565cb20] 2021-11-18T10:38:38.028 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2: gsignal() 2021-11-18T10:38:38.028 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 3: abort() 2021-11-18T10:38:38.028 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 4: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x1b8) [0x5619526ce2bc] 2021-11-18T10:38:38.028 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 5: (KernelDevice::_aio_thread()+0xf9e) [0x5619532f545e] 2021-11-18T10:38:38.029 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 6: (KernelDevice::AioCompletionThread::entry()+0x11) [0x5619533011b1] 2021-11-18T10:38:38.029 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 7: /lib64/libpthread.so.0(+0x814a) [0x7fc5e565214a] 2021-11-18T10:38:38.029 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 8: clone() 2021-11-18T10:38:38.029 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-18T10:38:38.030 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr: 2021-11-18T10:38:38.290 INFO:tasks.ceph.cluster2.osd.1.gibba019.stderr:daemon-helper: command failed with exit status 5 2021-11-18T10:38:43.196 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~65s 2021-11-18T10:38:43.197 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~0s 2021-11-18T10:38:43.314 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:38:43.316+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:38:46.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ error_code=124 2021-11-18T10:38:46.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ set -e 2021-11-18T10:38:46.426 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' 124 -eq 124 ']' 2021-11-18T10:38:46.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ return 0 2021-11-18T10:38:46.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ for i in `seq 1 ${IMAGE_COUNT}` 2021-11-18T10:38:46.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ image=image_37 2021-11-18T10:38:46.427 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image_and_enable_mirror cluster2 mirror image_37 snapshot 128M 2021-11-18T10:38:46.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:46.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:46.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:46.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:46.428 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_37 2021-11-18T10:38:46.429 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:46.429 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local mode=snapshot 2021-11-18T10:38:46.429 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n snapshot ']' 2021-11-18T10:38:46.429 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:46.430 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ create_image cluster2 mirror image_37 128M 2021-11-18T10:38:46.430 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local cluster=cluster2 2021-11-18T10:38:46.430 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:46.430 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local pool=mirror 2021-11-18T10:38:46.431 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:46.431 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local image=image_37 2021-11-18T10:38:46.431 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:46.431 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ local size=128 2021-11-18T10:38:46.432 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ '[' -n 128M ']' 2021-11-18T10:38:46.432 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ size=128M 2021-11-18T10:38:46.432 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ shift 2021-11-18T10:38:46.432 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+ rbd --cluster cluster2 create --size 128M --image-feature layering,exclusive-lock mirror/image_37 2021-11-18T10:38:48.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:38:48.317+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:38:48.499 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~70s 2021-11-18T10:38:48.500 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~5s 2021-11-18T10:38:53.315 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:38:53.318+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:38:53.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~75s 2021-11-18T10:38:53.804 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~11s 2021-11-18T10:38:58.317 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:38:58.320+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:38:59.108 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~81s 2021-11-18T10:38:59.109 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~16s 2021-11-18T10:39:02.576 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:39:02.579+0000 7f788168a700 -1 reset not still connected to 0x55e0eed64410 2021-11-18T10:39:02.576 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:39:02.579+0000 7f788168a700 -1 reset not still connected to 0x55e0eed651e0 2021-11-18T10:39:03.318 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:03.321+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:04.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~86s 2021-11-18T10:39:04.412 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~21s 2021-11-18T10:39:08.320 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:08.323+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:09.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~91s 2021-11-18T10:39:09.717 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~27s 2021-11-18T10:39:10.397 INFO:tasks.rbd_mirror_thrash:kill cluster1.client.mirror.0 2021-11-18T10:39:10.398 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 15 2021-11-18T10:39:10.399 INFO:tasks.rbd_mirror_thrash:waiting for 8 secs before reviving daemons 2021-11-18T10:39:10.400 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:10.402+0000 7f3169cb6700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 39735) UID: 1000 2021-11-18T10:39:13.322 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:13.325+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:15.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~97s 2021-11-18T10:39:15.021 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~32s 2021-11-18T10:39:18.323 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:18.326+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:18.400 INFO:tasks.rbd_mirror_thrash:waiting for cluster1.client.mirror.0 2021-11-18T10:39:18.400 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:39:20.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~102s 2021-11-18T10:39:20.325 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~37s 2021-11-18T10:39:23.325 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:23.327+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:25.629 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~107s 2021-11-18T10:39:25.630 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~42s 2021-11-18T10:39:26.622 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.0 with skip (0.7310622097868366) > weight (0.25) 2021-11-18T10:39:26.622 INFO:tasks.rbd_mirror_thrash:skipping daemon cluster2.client.mirror.1 with skip (0.5132083097828861) > weight (0.25) 2021-11-18T10:39:26.623 INFO:tasks.rbd_mirror_thrash:kill cluster2.client.mirror.2 2021-11-18T10:39:26.623 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Sent signal 15 2021-11-18T10:39:26.624 INFO:tasks.rbd_mirror_thrash:waiting for 6 secs before reviving daemons 2021-11-18T10:39:26.625 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr:2021-11-18T10:39:26.627+0000 7f1cc6e10700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 (PID: 39946) UID: 1000 2021-11-18T10:39:28.326 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:28.329+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:30.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~113s 2021-11-18T10:39:30.934 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~48s 2021-11-18T10:39:32.625 INFO:tasks.rbd_mirror_thrash:waiting for cluster2.client.mirror.2 2021-11-18T10:39:32.626 INFO:teuthology.orchestra.run:waiting for 600 2021-11-18T10:39:33.328 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:33.331+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:36.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~118s 2021-11-18T10:39:36.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~53s 2021-11-18T10:39:38.330 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:38.333+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:41.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~123s 2021-11-18T10:39:41.665 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~58s 2021-11-18T10:39:43.331 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:43.334+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:46.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~129s 2021-11-18T10:39:46.969 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~64s 2021-11-18T10:39:48.332 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:48.335+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:52.273 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~134s 2021-11-18T10:39:52.274 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~69s 2021-11-18T10:39:53.334 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:53.336+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:57.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~139s 2021-11-18T10:39:57.577 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~74s 2021-11-18T10:39:58.335 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:39:58.338+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:39:59.761 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:39:59.763+0000 7f788168a700 -1 reset not still connected to 0x55e0ede3b5f0 2021-11-18T10:39:59.762 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:39:59.765+0000 7f788168a700 -1 reset not still connected to 0x55e0ef61de10 2021-11-18T10:39:59.762 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:39:59.765+0000 7f788168a700 -1 reset not still connected to 0x55e0f23c1380 2021-11-18T10:40:02.881 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~145s 2021-11-18T10:40:02.882 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~80s 2021-11-18T10:40:03.337 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:03.340+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:40:08.185 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~150s 2021-11-18T10:40:08.186 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~85s 2021-11-18T10:40:08.338 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:08.341+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:40:13.340 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:13.343+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:40:13.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~155s 2021-11-18T10:40:13.490 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~90s 2021-11-18T10:40:18.341 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:18.344+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:40:18.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~160s 2021-11-18T10:40:18.794 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~96s 2021-11-18T10:40:23.342 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:23.346+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:40:24.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~166s 2021-11-18T10:40:24.097 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~101s 2021-11-18T10:40:28.344 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:28.347+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:40:29.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~171s 2021-11-18T10:40:29.401 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~106s 2021-11-18T10:40:33.348 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:33.349+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:40:34.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~176s 2021-11-18T10:40:34.705 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~112s 2021-11-18T10:40:38.347 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:38.350+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:40:40.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~182s 2021-11-18T10:40:40.008 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~117s 2021-11-18T10:40:43.349 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:43.352+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:40:45.312 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~187s 2021-11-18T10:40:45.313 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~122s 2021-11-18T10:40:48.350 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:48.354+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:40:50.615 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~192s 2021-11-18T10:40:50.616 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~127s 2021-11-18T10:40:53.352 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:53.355+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:40:55.919 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~198s 2021-11-18T10:40:55.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~133s 2021-11-18T10:40:58.353 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:40:58.357+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:01.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~203s 2021-11-18T10:41:01.225 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~138s 2021-11-18T10:41:03.355 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:03.358+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:06.528 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~208s 2021-11-18T10:41:06.529 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~143s 2021-11-18T10:41:08.356 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:08.360+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:11.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~214s 2021-11-18T10:41:11.832 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~149s 2021-11-18T10:41:13.357 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:13.361+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:17.135 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~219s 2021-11-18T10:41:17.136 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~154s 2021-11-18T10:41:18.359 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:18.362+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:22.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~224s 2021-11-18T10:41:22.439 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~159s 2021-11-18T10:41:23.360 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:23.364+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:27.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~229s 2021-11-18T10:41:27.743 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~165s 2021-11-18T10:41:28.361 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:28.364+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:33.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~235s 2021-11-18T10:41:33.046 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~170s 2021-11-18T10:41:33.363 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:33.366+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:38.350 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~240s 2021-11-18T10:41:38.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~175s 2021-11-18T10:41:38.365 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:38.367+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:43.366 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:43.369+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:43.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~245s 2021-11-18T10:41:43.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~180s 2021-11-18T10:41:48.368 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:48.371+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:48.957 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~251s 2021-11-18T10:41:48.958 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~186s 2021-11-18T10:41:53.369 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:53.372+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:54.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~256s 2021-11-18T10:41:54.262 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~191s 2021-11-18T10:41:58.371 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:41:58.373+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:41:59.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~261s 2021-11-18T10:41:59.566 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~196s 2021-11-18T10:42:03.372 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:03.375+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:42:04.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~267s 2021-11-18T10:42:04.870 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~202s 2021-11-18T10:42:08.374 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:08.377+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:42:10.173 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~272s 2021-11-18T10:42:10.174 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~207s 2021-11-18T10:42:13.375 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:13.378+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:42:15.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~277s 2021-11-18T10:42:15.478 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~212s 2021-11-18T10:42:18.377 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:18.379+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:42:20.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~282s 2021-11-18T10:42:20.782 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~218s 2021-11-18T10:42:23.378 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:23.381+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:42:26.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~288s 2021-11-18T10:42:26.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~223s 2021-11-18T10:42:28.380 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:28.382+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:42:31.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~293s 2021-11-18T10:42:31.389 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~228s 2021-11-18T10:42:33.381 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:33.385+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:42:36.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~298s 2021-11-18T10:42:36.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~233s 2021-11-18T10:42:38.383 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:38.386+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:42:41.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.0 is failed for ~304s 2021-11-18T10:42:41.996 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon cluster2.osd.1 is failed for ~239s 2021-11-18T10:42:41.996 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2021-11-18T10:42:42.299 INFO:tasks.ceph.cluster2.osd.2:Sent signal 15 2021-11-18T10:42:42.300 INFO:tasks.ceph.cluster2.mon.a:Sent signal 15 2021-11-18T10:42:42.301 INFO:tasks.ceph.cluster2.mgr.x:Sent signal 15 2021-11-18T10:42:42.302 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:42:42.304+0000 7f789371a700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster cluster2 -i 2 (PID: 33558) UID: 0 2021-11-18T10:42:42.302 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:42:42.304+0000 7f789371a700 -1 osd.2 155 *** Got signal Terminated *** 2021-11-18T10:42:42.302 INFO:tasks.ceph.cluster2.osd.2.gibba019.stderr:2021-11-18T10:42:42.304+0000 7f789371a700 -1 osd.2 155 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-11-18T10:42:42.303 INFO:tasks.ceph.cluster2.mon.a.gibba019.stderr:2021-11-18T10:42:42.304+0000 7f49ee7cb700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster cluster2 -i a (PID: 33252) UID: 0 2021-11-18T10:42:42.303 INFO:tasks.ceph.cluster2.mon.a.gibba019.stderr:2021-11-18T10:42:42.304+0000 7f49ee7cb700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-11-18T10:42:42.304 INFO:tasks.ceph.cluster2.mgr.x.gibba005.stderr:2021-11-18T10:42:42.305+0000 7f687bab0700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster cluster2 -i x (PID: 39115) UID: 0 2021-11-18T10:42:42.304 INFO:tasks.ceph.cluster2.mgr.x.gibba005.stderr:2021-11-18T10:42:42.305+0000 7f687bab0700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2021-11-18T10:42:43.385 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:43.387+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:42:48.386 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:48.389+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:42:53.388 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:53.391+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:42:58.389 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:42:58.391+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:43:03.390 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:43:03.393+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:43:08.392 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:43:08.396+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:43:13.394 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:43:13.396+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:43:18.395 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:43:18.398+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:43:23.396 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:43:23.399+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:43:33.460 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:43:33.464+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:43:38.461 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:43:38.465+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:43:43.462 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:43:43.464+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:43:48.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:43:48.465+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:43:53.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:43:53.467+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:43:58.463 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:43:58.467+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:03.464 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:03.468+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:08.465 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:08.469+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:13.466 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:13.470+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:18.467 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:18.470+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:23.468 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:23.471+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:28.469 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:28.472+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:33.470 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:33.472+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:38.471 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:38.473+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:43.472 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:43.475+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:48.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:48.475+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:53.473 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:53.476+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:44:58.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:44:58.478+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:03.475 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:03.478+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:08.476 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:08.479+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:13.478 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:13.481+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:18.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:18.482+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:23.479 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:23.482+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:28.480 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:28.483+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:33.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:33.484+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:38.482 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:38.485+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:43.483 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:43.486+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:48.484 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:48.487+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:53.486 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:53.488+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:45:58.487 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:45:58.490+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:03.488 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:03.490+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:08.489 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:08.491+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:13.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:13.492+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:18.490 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:18.493+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:23.491 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:23.494+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:28.493 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:28.496+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:33.494 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:33.497+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:38.495 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:38.497+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:43.496 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:43.499+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:48.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:48.500+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:53.497 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:53.501+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:46:58.498 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:46:58.502+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:03.499 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:03.503+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:08.500 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:08.504+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:13.501 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:13.505+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:18.502 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:18.506+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:23.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:23.506+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:28.503 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:28.507+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:33.504 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:33.507+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:38.505 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:38.508+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:43.507 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:43.510+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:48.508 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:48.510+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:53.509 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:53.511+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:47:58.510 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:47:58.513+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:03.511 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:03.513+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:08.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:08.514+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:13.512 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:13.515+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:18.514 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:18.517+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:23.515 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:23.518+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:28.516 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:28.519+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:33.517 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:33.520+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:38.518 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:38.521+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:43.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:43.521+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:48.519 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:48.522+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:53.521 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:53.523+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:48:58.522 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:48:58.525+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:03.523 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:49:03.525+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:08.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:49:08.527+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:13.524 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:49:13.527+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:18.525 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:49:18.528+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.542 INFO:tasks.rbd_mirror_thrash:Failed to stop cluster1.client.mirror.0 2021-11-18T10:49:22.543 INFO:tasks.rbd_mirror.cluster1.client.mirror.0:Sent signal 6 2021-11-18T10:49:22.544 ERROR:tasks.rbd_mirror_thrash:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_44cd7c7650ed2227d3597352b00bd2ef65f4388f/qa/tasks/rbd_mirror_thrash.py", line 84, in _run self.do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph_44cd7c7650ed2227d3597352b00bd2ef65f4388f/qa/tasks/rbd_mirror_thrash.py", line 156, in do_thrash run.wait([daemon.proc], timeout=600) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (100) after waiting for 600 seconds 2021-11-18T10:49:22.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:*** Caught signal (Aborted) ** 2021-11-18T10:49:22.545 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: in thread 7f3172e4f540 thread_name:rbd-mirror 2021-11-18T10:49:22.546 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:49:22.546 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f31707ecb20] 2021-11-18T10:49:22.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 2: /lib64/libpthread.so.0(+0x963d) [0x7f31707e363d] 2021-11-18T10:49:22.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 3: (Thread::join(void**)+0x31) [0x7f31714bbfc1] 2021-11-18T10:49:22.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 4: (rbd::mirror::PoolReplayer::shut_down()+0x28a) [0x556188d355ca] 2021-11-18T10:49:22.547 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 5: (rbd::mirror::PoolReplayer::~PoolReplayer()+0x12) [0x556188d35622] 2021-11-18T10:49:22.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 6: (std::_Rb_tree, std::pair const, std::unique_ptr, std::default_delete > > >, std::_Select1st const, std::unique_ptr, std::default_delete > > > >, std::less >, std::allocator const, std::unique_ptr, std::default_delete > > > > >::_M_erase(std::_Rb_tree_node const, std::unique_ptr, std::default_delete > > > >*)+0x41) [0x556188d2d041] 2021-11-18T10:49:22.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 7: (rbd::mirror::Mirror::~Mirror()+0xc5) [0x556188d270d5] 2021-11-18T10:49:22.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 8: main() 2021-11-18T10:49:22.548 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 9: __libc_start_main() 2021-11-18T10:49:22.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 10: _start() 2021-11-18T10:49:22.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:2021-11-18T10:49:22.549+0000 7f3172e4f540 -1 *** Caught signal (Aborted) ** 2021-11-18T10:49:22.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: in thread 7f3172e4f540 thread_name:rbd-mirror 2021-11-18T10:49:22.549 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 2021-11-18T10:49:22.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:49:22.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f31707ecb20] 2021-11-18T10:49:22.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 2: /lib64/libpthread.so.0(+0x963d) [0x7f31707e363d] 2021-11-18T10:49:22.550 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 3: (Thread::join(void**)+0x31) [0x7f31714bbfc1] 2021-11-18T10:49:22.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 4: (rbd::mirror::PoolReplayer::shut_down()+0x28a) [0x556188d355ca] 2021-11-18T10:49:22.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 5: (rbd::mirror::PoolReplayer::~PoolReplayer()+0x12) [0x556188d35622] 2021-11-18T10:49:22.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 6: (std::_Rb_tree, std::pair const, std::unique_ptr, std::default_delete > > >, std::_Select1st const, std::unique_ptr, std::default_delete > > > >, std::less >, std::allocator const, std::unique_ptr, std::default_delete > > > > >::_M_erase(std::_Rb_tree_node const, std::unique_ptr, std::default_delete > > > >*)+0x41) [0x556188d2d041] 2021-11-18T10:49:22.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 7: (rbd::mirror::Mirror::~Mirror()+0xc5) [0x556188d270d5] 2021-11-18T10:49:22.551 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 8: main() 2021-11-18T10:49:22.552 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 9: __libc_start_main() 2021-11-18T10:49:22.552 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 10: _start() 2021-11-18T10:49:22.552 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-18T10:49:22.552 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 2021-11-18T10:49:22.565 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -9595> 2021-11-18T10:38:43.316+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -9482> 2021-11-18T10:38:48.317+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -9333> 2021-11-18T10:38:53.318+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -9272> 2021-11-18T10:38:58.320+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.566 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -9181> 2021-11-18T10:39:03.321+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -9120> 2021-11-18T10:39:08.323+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -9077> 2021-11-18T10:39:10.402+0000 7f3169cb6700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster1 --id mirror.0 (PID: 39735) UID: 1000 2021-11-18T10:49:22.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8886> 2021-11-18T10:39:13.325+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.567 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8807> 2021-11-18T10:39:18.326+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8714> 2021-11-18T10:39:23.327+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8661> 2021-11-18T10:39:28.329+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8578> 2021-11-18T10:39:33.331+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.568 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8525> 2021-11-18T10:39:38.333+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8442> 2021-11-18T10:39:43.334+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8360> 2021-11-18T10:39:48.335+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8267> 2021-11-18T10:39:53.336+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8214> 2021-11-18T10:39:58.338+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.569 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8131> 2021-11-18T10:40:03.340+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -8078> 2021-11-18T10:40:08.341+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7995> 2021-11-18T10:40:13.343+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7916> 2021-11-18T10:40:18.344+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.570 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7823> 2021-11-18T10:40:23.346+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7770> 2021-11-18T10:40:28.347+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7687> 2021-11-18T10:40:33.349+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7634> 2021-11-18T10:40:38.350+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7551> 2021-11-18T10:40:43.352+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.571 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7472> 2021-11-18T10:40:48.354+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7379> 2021-11-18T10:40:53.355+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7326> 2021-11-18T10:40:58.357+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7243> 2021-11-18T10:41:03.358+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7190> 2021-11-18T10:41:08.360+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.572 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7107> 2021-11-18T10:41:13.361+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -7028> 2021-11-18T10:41:18.362+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6935> 2021-11-18T10:41:23.364+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6882> 2021-11-18T10:41:28.364+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.573 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6799> 2021-11-18T10:41:33.366+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6746> 2021-11-18T10:41:38.367+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6663> 2021-11-18T10:41:43.369+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6584> 2021-11-18T10:41:48.371+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6491> 2021-11-18T10:41:53.372+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.574 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6438> 2021-11-18T10:41:58.373+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6355> 2021-11-18T10:42:03.375+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6302> 2021-11-18T10:42:08.377+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6219> 2021-11-18T10:42:13.378+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6140> 2021-11-18T10:42:18.379+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.575 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -6047> 2021-11-18T10:42:23.381+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5994> 2021-11-18T10:42:28.382+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5911> 2021-11-18T10:42:33.385+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5858> 2021-11-18T10:42:38.386+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.576 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5775> 2021-11-18T10:42:43.387+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5694> 2021-11-18T10:42:48.389+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5609> 2021-11-18T10:42:53.391+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5556> 2021-11-18T10:42:58.391+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5473> 2021-11-18T10:43:03.393+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.577 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5420> 2021-11-18T10:43:08.396+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5337> 2021-11-18T10:43:13.396+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5260> 2021-11-18T10:43:18.398+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5177> 2021-11-18T10:43:23.399+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.578 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -5045> 2021-11-18T10:43:33.464+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4992> 2021-11-18T10:43:38.465+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4909> 2021-11-18T10:43:43.464+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4832> 2021-11-18T10:43:48.465+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4749> 2021-11-18T10:43:53.467+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.579 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4696> 2021-11-18T10:43:58.467+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.580 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4613> 2021-11-18T10:44:03.468+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.580 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4560> 2021-11-18T10:44:08.469+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.580 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4477> 2021-11-18T10:44:13.470+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.580 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4400> 2021-11-18T10:44:18.470+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4317> 2021-11-18T10:44:23.471+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4264> 2021-11-18T10:44:28.472+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4181> 2021-11-18T10:44:33.472+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4128> 2021-11-18T10:44:38.473+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.581 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -4045> 2021-11-18T10:44:43.475+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3968> 2021-11-18T10:44:48.475+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3885> 2021-11-18T10:44:53.476+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3832> 2021-11-18T10:44:58.478+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3749> 2021-11-18T10:45:03.478+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.582 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3696> 2021-11-18T10:45:08.479+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3613> 2021-11-18T10:45:13.481+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3536> 2021-11-18T10:45:18.482+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3453> 2021-11-18T10:45:23.482+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3400> 2021-11-18T10:45:28.483+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.583 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3317> 2021-11-18T10:45:33.484+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3264> 2021-11-18T10:45:38.485+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3181> 2021-11-18T10:45:43.486+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3101> 2021-11-18T10:45:48.487+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.584 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -3018> 2021-11-18T10:45:53.488+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2965> 2021-11-18T10:45:58.490+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2882> 2021-11-18T10:46:03.490+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2829> 2021-11-18T10:46:08.491+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2746> 2021-11-18T10:46:13.492+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.585 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2669> 2021-11-18T10:46:18.493+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2586> 2021-11-18T10:46:23.494+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2533> 2021-11-18T10:46:28.496+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2447> 2021-11-18T10:46:33.497+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.586 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2394> 2021-11-18T10:46:38.497+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2311> 2021-11-18T10:46:43.499+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2234> 2021-11-18T10:46:48.500+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2151> 2021-11-18T10:46:53.501+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2098> 2021-11-18T10:46:58.502+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.587 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -2015> 2021-11-18T10:47:03.503+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1962> 2021-11-18T10:47:08.504+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1879> 2021-11-18T10:47:13.505+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1802> 2021-11-18T10:47:18.506+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.588 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1719> 2021-11-18T10:47:23.506+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1666> 2021-11-18T10:47:28.507+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1583> 2021-11-18T10:47:33.507+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1530> 2021-11-18T10:47:38.508+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1447> 2021-11-18T10:47:43.510+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.589 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1370> 2021-11-18T10:47:48.510+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1287> 2021-11-18T10:47:53.511+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1234> 2021-11-18T10:47:58.513+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1151> 2021-11-18T10:48:03.513+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.590 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1098> 2021-11-18T10:48:08.514+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -1015> 2021-11-18T10:48:13.515+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -938> 2021-11-18T10:48:18.517+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -855> 2021-11-18T10:48:23.518+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -802> 2021-11-18T10:48:28.519+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.591 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -719> 2021-11-18T10:48:33.520+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -666> 2021-11-18T10:48:38.521+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -583> 2021-11-18T10:48:43.521+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -503> 2021-11-18T10:48:48.522+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -420> 2021-11-18T10:48:53.523+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.592 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -367> 2021-11-18T10:48:58.525+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -284> 2021-11-18T10:49:03.525+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -231> 2021-11-18T10:49:08.527+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -148> 2021-11-18T10:49:13.527+0000 7f3168cb4700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: -71> 2021-11-18T10:49:18.528+0000 7f31694b5700 -1 rbd::mirror::InstanceWatcher: C_NotifyInstanceRequest: 0x55618fa09c80 finish: resending after timeout 2021-11-18T10:49:22.593 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 0> 2021-11-18T10:49:22.549+0000 7f3172e4f540 -1 *** Caught signal (Aborted) ** 2021-11-18T10:49:22.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: in thread 7f3172e4f540 thread_name:rbd-mirror 2021-11-18T10:49:22.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 2021-11-18T10:49:22.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:49:22.594 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f31707ecb20] 2021-11-18T10:49:22.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 2: /lib64/libpthread.so.0(+0x963d) [0x7f31707e363d] 2021-11-18T10:49:22.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 3: (Thread::join(void**)+0x31) [0x7f31714bbfc1] 2021-11-18T10:49:22.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 4: (rbd::mirror::PoolReplayer::shut_down()+0x28a) [0x556188d355ca] 2021-11-18T10:49:22.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 5: (rbd::mirror::PoolReplayer::~PoolReplayer()+0x12) [0x556188d35622] 2021-11-18T10:49:22.595 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 6: (std::_Rb_tree, std::pair const, std::unique_ptr, std::default_delete > > >, std::_Select1st const, std::unique_ptr, std::default_delete > > > >, std::less >, std::allocator const, std::unique_ptr, std::default_delete > > > > >::_M_erase(std::_Rb_tree_node const, std::unique_ptr, std::default_delete > > > >*)+0x41) [0x556188d2d041] 2021-11-18T10:49:22.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 7: (rbd::mirror::Mirror::~Mirror()+0xc5) [0x556188d270d5] 2021-11-18T10:49:22.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 8: main() 2021-11-18T10:49:22.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 9: __libc_start_main() 2021-11-18T10:49:22.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 10: _start() 2021-11-18T10:49:22.596 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-18T10:49:22.597 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr: 2021-11-18T10:49:22.847 INFO:tasks.daemonwatchdog.daemon_watchdog:thrasher.rbd_mirror.[cluster1] failed 2021-11-18T10:49:22.847 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2021-11-18T10:49:22.946 INFO:tasks.rbd_mirror.cluster1.client.mirror.0.gibba019.stderr:daemon-helper: command crashed with signal 11 2021-11-18T10:49:23.427 INFO:tasks.ceph.cluster1.osd.0:Sent signal 15 2021-11-18T10:49:23.428 INFO:tasks.ceph.cluster1.osd.1:Sent signal 15 2021-11-18T10:49:23.428 INFO:tasks.ceph.cluster1.osd.2:Sent signal 15 2021-11-18T10:49:23.429 INFO:tasks.ceph.cluster1.mon.a:Sent signal 15 2021-11-18T10:49:23.429 INFO:tasks.ceph.cluster1.mgr.x:Sent signal 15 2021-11-18T10:49:23.430 INFO:tasks.ceph.cluster1.osd.0.gibba005.stderr:2021-11-18T10:49:23.432+0000 7fdd79998700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster cluster1 -i 0 (PID: 32913) UID: 0 2021-11-18T10:49:23.430 INFO:tasks.ceph.cluster1.osd.0.gibba005.stderr:2021-11-18T10:49:23.432+0000 7fdd79998700 -1 osd.0 131 *** Got signal Terminated *** 2021-11-18T10:49:23.430 INFO:tasks.ceph.cluster1.osd.0.gibba005.stderr:2021-11-18T10:49:23.432+0000 7fdd79998700 -1 osd.0 131 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-11-18T10:49:23.431 INFO:tasks.ceph.cluster1.osd.1.gibba005.stderr:2021-11-18T10:49:23.432+0000 7f1dd87f0700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster cluster1 -i 1 (PID: 32920) UID: 0 2021-11-18T10:49:23.431 INFO:tasks.ceph.cluster1.osd.1.gibba005.stderr:2021-11-18T10:49:23.432+0000 7f1dd87f0700 -1 osd.1 131 *** Got signal Terminated *** 2021-11-18T10:49:23.431 INFO:tasks.ceph.cluster1.osd.1.gibba005.stderr:2021-11-18T10:49:23.432+0000 7f1dd87f0700 -1 osd.1 131 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-11-18T10:49:23.432 INFO:tasks.ceph.cluster1.osd.2.gibba005.stderr:2021-11-18T10:49:23.433+0000 7fe0baab3700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster cluster1 -i 2 (PID: 32923) UID: 0 2021-11-18T10:49:23.432 INFO:tasks.ceph.cluster1.osd.2.gibba005.stderr:2021-11-18T10:49:23.433+0000 7fe0baab3700 -1 osd.2 131 *** Got signal Terminated *** 2021-11-18T10:49:23.432 INFO:tasks.ceph.cluster1.osd.2.gibba005.stderr:2021-11-18T10:49:23.433+0000 7fe0baab3700 -1 osd.2 131 *** Immediate shutdown (osd_fast_shutdown=true) *** 2021-11-18T10:49:23.433 INFO:tasks.ceph.cluster1.mon.a.gibba005.stderr:2021-11-18T10:49:23.433+0000 7fe2e8de5700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster cluster1 -i a (PID: 32582) UID: 0 2021-11-18T10:49:23.433 INFO:tasks.ceph.cluster1.mon.a.gibba005.stderr:2021-11-18T10:49:23.433+0000 7fe2e8de5700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-11-18T10:49:23.434 INFO:tasks.ceph.cluster1.mgr.x.gibba005.stderr:2021-11-18T10:49:23.433+0000 7f54798ad700 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster cluster1 -i x (PID: 32589) UID: 0 2021-11-18T10:49:23.434 INFO:tasks.ceph.cluster1.mgr.x.gibba005.stderr:2021-11-18T10:49:23.433+0000 7f54798ad700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2021-11-18T10:49:36.761 INFO:tasks.rbd_mirror_thrash:Failed to stop cluster2.client.mirror.2 2021-11-18T10:49:36.762 INFO:tasks.rbd_mirror.cluster2.client.mirror.2:Sent signal 6 2021-11-18T10:49:36.763 ERROR:tasks.rbd_mirror_thrash:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph_44cd7c7650ed2227d3597352b00bd2ef65f4388f/qa/tasks/rbd_mirror_thrash.py", line 84, in _run self.do_thrash() File "/home/teuthworker/src/github.com_ceph_ceph_44cd7c7650ed2227d3597352b00bd2ef65f4388f/qa/tasks/rbd_mirror_thrash.py", line 156, in do_thrash run.wait([daemon.proc], timeout=600) File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_git_teuthology_d4737010a85099043cf081dc05b4069d301b23fb/teuthology/contextutil.py", line 133, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (100) after waiting for 600 seconds 2021-11-18T10:49:36.764 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr:*** Caught signal (Aborted) ** 2021-11-18T10:49:36.764 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: in thread 7f1ccffa9540 thread_name:rbd-mirror 2021-11-18T10:49:36.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:49:36.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f1ccd946b20] 2021-11-18T10:49:36.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 2: pthread_cond_wait() 2021-11-18T10:49:36.765 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 3: (std::condition_variable::wait(std::unique_lock&)+0x10) [0x7f1ccc7528f0] 2021-11-18T10:49:36.766 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 4: /lib64/librados.so.2(+0xa3923) [0x7f1ccfa47923] 2021-11-18T10:49:36.766 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 5: (librados::v14_2_0::IoCtx::operate(std::__cxx11::basic_string, std::allocator > const&, librados::v14_2_0::ObjectReadOperation*, ceph::buffer::v15_2_0::list*)+0x62) [0x7f1ccfa1eee2] 2021-11-18T10:49:36.766 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 6: (librbd::cls_client::mirror_mode_get(librados::v14_2_0::IoCtx*, cls::rbd::MirrorMode*)+0x96) [0x5638867bd0e6] 2021-11-18T10:49:36.766 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 7: (rbd::mirror::ClusterWatcher::read_pool_peers(std::map >, std::less, std::allocator > > > >*)+0x5db) [0x563885f3e3eb] 2021-11-18T10:49:36.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 8: (rbd::mirror::ClusterWatcher::refresh_pools()+0x22d) [0x563885f4033d] 2021-11-18T10:49:36.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 9: (rbd::mirror::Mirror::run()+0x1dc) [0x563885eff6dc] 2021-11-18T10:49:36.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 10: main() 2021-11-18T10:49:36.767 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 11: __libc_start_main() 2021-11-18T10:49:36.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 12: _start() 2021-11-18T10:49:36.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr:2021-11-18T10:49:36.768+0000 7f1ccffa9540 -1 *** Caught signal (Aborted) ** 2021-11-18T10:49:36.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: in thread 7f1ccffa9540 thread_name:rbd-mirror 2021-11-18T10:49:36.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 2021-11-18T10:49:36.768 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:49:36.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f1ccd946b20] 2021-11-18T10:49:36.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 2: pthread_cond_wait() 2021-11-18T10:49:36.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 3: (std::condition_variable::wait(std::unique_lock&)+0x10) [0x7f1ccc7528f0] 2021-11-18T10:49:36.769 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 4: /lib64/librados.so.2(+0xa3923) [0x7f1ccfa47923] 2021-11-18T10:49:36.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 5: (librados::v14_2_0::IoCtx::operate(std::__cxx11::basic_string, std::allocator > const&, librados::v14_2_0::ObjectReadOperation*, ceph::buffer::v15_2_0::list*)+0x62) [0x7f1ccfa1eee2] 2021-11-18T10:49:36.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 6: (librbd::cls_client::mirror_mode_get(librados::v14_2_0::IoCtx*, cls::rbd::MirrorMode*)+0x96) [0x5638867bd0e6] 2021-11-18T10:49:36.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 7: (rbd::mirror::ClusterWatcher::read_pool_peers(std::map >, std::less, std::allocator > > > >*)+0x5db) [0x563885f3e3eb] 2021-11-18T10:49:36.770 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 8: (rbd::mirror::ClusterWatcher::refresh_pools()+0x22d) [0x563885f4033d] 2021-11-18T10:49:36.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 9: (rbd::mirror::Mirror::run()+0x1dc) [0x563885eff6dc] 2021-11-18T10:49:36.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 10: main() 2021-11-18T10:49:36.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 11: __libc_start_main() 2021-11-18T10:49:36.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 12: _start() 2021-11-18T10:49:36.771 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-18T10:49:36.772 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 2021-11-18T10:49:36.772 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: -2350> 2021-11-18T10:39:26.627+0000 7f1cc6e10700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 (PID: 39946) UID: 1000 2021-11-18T10:49:36.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 0> 2021-11-18T10:49:36.768+0000 7f1ccffa9540 -1 *** Caught signal (Aborted) ** 2021-11-18T10:49:36.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: in thread 7f1ccffa9540 thread_name:rbd-mirror 2021-11-18T10:49:36.774 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 2021-11-18T10:49:36.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:49:36.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f1ccd946b20] 2021-11-18T10:49:36.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 2: pthread_cond_wait() 2021-11-18T10:49:36.775 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 3: (std::condition_variable::wait(std::unique_lock&)+0x10) [0x7f1ccc7528f0] 2021-11-18T10:49:36.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 4: /lib64/librados.so.2(+0xa3923) [0x7f1ccfa47923] 2021-11-18T10:49:36.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 5: (librados::v14_2_0::IoCtx::operate(std::__cxx11::basic_string, std::allocator > const&, librados::v14_2_0::ObjectReadOperation*, ceph::buffer::v15_2_0::list*)+0x62) [0x7f1ccfa1eee2] 2021-11-18T10:49:36.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 6: (librbd::cls_client::mirror_mode_get(librados::v14_2_0::IoCtx*, cls::rbd::MirrorMode*)+0x96) [0x5638867bd0e6] 2021-11-18T10:49:36.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 7: (rbd::mirror::ClusterWatcher::read_pool_peers(std::map >, std::less, std::allocator > > > >*)+0x5db) [0x563885f3e3eb] 2021-11-18T10:49:36.776 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 8: (rbd::mirror::ClusterWatcher::refresh_pools()+0x22d) [0x563885f4033d] 2021-11-18T10:49:36.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 9: (rbd::mirror::Mirror::run()+0x1dc) [0x563885eff6dc] 2021-11-18T10:49:36.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 10: main() 2021-11-18T10:49:36.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 11: __libc_start_main() 2021-11-18T10:49:36.777 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 12: _start() 2021-11-18T10:49:36.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-18T10:49:36.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 2021-11-18T10:49:36.778 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: -9999> 2021-11-18T10:39:26.627+0000 7f1cc6e10700 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term rbd-mirror --foreground --cluster cluster2 --id mirror.2 (PID: 39946) UID: 1000 2021-11-18T10:49:36.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: -9998> 2021-11-18T10:49:36.768+0000 7f1ccffa9540 -1 *** Caught signal (Aborted) ** 2021-11-18T10:49:36.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: in thread 7f1ccffa9540 thread_name:rbd-mirror 2021-11-18T10:49:36.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 2021-11-18T10:49:36.779 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: ceph version 17.0.0-9003-g44cd7c76 (44cd7c7650ed2227d3597352b00bd2ef65f4388f) quincy (dev) 2021-11-18T10:49:36.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 1: /lib64/libpthread.so.0(+0x12b20) [0x7f1ccd946b20] 2021-11-18T10:49:36.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 2: pthread_cond_wait() 2021-11-18T10:49:36.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 3: (std::condition_variable::wait(std::unique_lock&)+0x10) [0x7f1ccc7528f0] 2021-11-18T10:49:36.780 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 4: /lib64/librados.so.2(+0xa3923) [0x7f1ccfa47923] 2021-11-18T10:49:36.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 5: (librados::v14_2_0::IoCtx::operate(std::__cxx11::basic_string, std::allocator > const&, librados::v14_2_0::ObjectReadOperation*, ceph::buffer::v15_2_0::list*)+0x62) [0x7f1ccfa1eee2] 2021-11-18T10:49:36.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 6: (librbd::cls_client::mirror_mode_get(librados::v14_2_0::IoCtx*, cls::rbd::MirrorMode*)+0x96) [0x5638867bd0e6] 2021-11-18T10:49:36.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 7: (rbd::mirror::ClusterWatcher::read_pool_peers(std::map >, std::less, std::allocator > > > >*)+0x5db) [0x563885f3e3eb] 2021-11-18T10:49:36.781 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 8: (rbd::mirror::ClusterWatcher::refresh_pools()+0x22d) [0x563885f4033d] 2021-11-18T10:49:36.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 9: (rbd::mirror::Mirror::run()+0x1dc) [0x563885eff6dc] 2021-11-18T10:49:36.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 10: main() 2021-11-18T10:49:36.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 11: __libc_start_main() 2021-11-18T10:49:36.782 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 12: _start() 2021-11-18T10:49:36.783 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2021-11-18T10:49:36.783 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr: 2021-11-18T10:49:37.165 INFO:tasks.rbd_mirror.cluster2.client.mirror.2.gibba019.stderr:daemon-helper: command crashed with signal 6 2021-11-18T16:22:15.632 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:Terminated 2021-11-18T16:22:15.661 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ cleanup 143 2021-11-18T16:22:15.662 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:cluster1 status 2021-11-18T16:22:15.662 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local error_code=143 2021-11-18T16:22:15.662 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ set +e 2021-11-18T16:22:15.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ '[' 143 -ne 0 ']' 2021-11-18T16:22:15.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ status 2021-11-18T16:22:15.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ local cluster daemon image_pool image_ns image 2021-11-18T16:22:15.663 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for cluster in ${CLUSTER1} ${CLUSTER2} 2021-11-18T16:22:15.664 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo 'cluster1 status' 2021-11-18T16:22:15.664 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ CEPH_ARGS= 2021-11-18T16:22:15.664 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --cluster cluster1 -s 2021-11-18T16:27:15.697 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T16:27:15.694+0000 7f9d0507a700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T16:32:15.699 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T16:32:15.695+0000 7f9d0507a700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T16:37:15.700 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T16:37:15.696+0000 7f9d0507a700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T16:42:15.699 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T16:42:15.697+0000 7f9d0507a700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T16:47:15.699 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T16:47:15.697+0000 7f9d0507a700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T16:52:15.699 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T16:52:15.697+0000 7f9d0507a700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T16:57:15.700 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T16:57:15.698+0000 7f9d0507a700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:02:15.700 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:02:15.699+0000 7f9d0507a700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:07:15.701 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:07:15.700+0000 7f9d0507a700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:12:15.701 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:12:15.699+0000 7f9d0507a700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:12:15.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:[errno 110] RADOS timed out (error connecting to the cluster) 2021-11-18T17:12:15.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ CEPH_ARGS= 2021-11-18T17:12:15.732 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --cluster cluster1 service dump 2021-11-18T17:17:15.769 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:17:15.768+0000 7f0b7d2c0700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:22:15.769 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:22:15.769+0000 7f0b7d2c0700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:27:15.770 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:27:15.770+0000 7f0b7d2c0700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:32:15.771 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:32:15.771+0000 7f0b7d2c0700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:37:15.771 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:37:15.771+0000 7f0b7d2c0700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:42:15.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:42:15.772+0000 7f0b7d2c0700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:47:15.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:47:15.773+0000 7f0b7d2c0700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:52:15.772 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:52:15.773+0000 7f0b7d2c0700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T17:57:15.773 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T17:57:15.774+0000 7f0b7d2c0700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:02:15.774 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T18:02:15.775+0000 7f0b7d2c0700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:02:15.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:[errno 110] RADOS timed out (error connecting to the cluster) 2021-11-18T18:02:15.775 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ CEPH_ARGS= 2021-11-18T18:02:15.776 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ ceph --cluster cluster1 service status 2021-11-18T18:07:15.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T18:07:15.842+0000 7f6b8f1cd700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:12:15.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T18:12:15.843+0000 7f6b8f1cd700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:17:15.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T18:17:15.844+0000 7f6b8f1cd700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:22:15.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T18:22:15.844+0000 7f6b8f1cd700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:27:15.838 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T18:27:15.845+0000 7f6b8f1cd700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:32:15.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T18:32:15.846+0000 7f6b8f1cd700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:37:15.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T18:37:15.845+0000 7f6b8f1cd700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:42:15.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T18:42:15.846+0000 7f6b8f1cd700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:47:15.839 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T18:47:15.848+0000 7f6b8f1cd700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:52:15.840 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:2021-11-18T18:52:15.848+0000 7f6b8f1cd700 0 monclient(hunting): authenticate timed out after 300 2021-11-18T18:52:15.841 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:[errno 110] RADOS timed out (error connecting to the cluster) 2021-11-18T18:52:15.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: 2021-11-18T18:52:15.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo 2021-11-18T18:52:15.842 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for image_pool in ${POOL} ${PARENT_POOL} 2021-11-18T18:52:15.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ for image_ns in "" "${NS1}" "${NS2}" 2021-11-18T18:52:15.843 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:cluster1 mirror images 2021-11-18T18:52:15.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo 'cluster1 mirror images' 2021-11-18T18:52:15.844 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' ls -l 2021-11-18T19:42:15.877 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: couldn't connect to the cluster! 2021-11-18T19:42:15.919 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: listing images failed: (110) Connection timed out 2021-11-18T19:42:15.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: 2021-11-18T19:42:15.921 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:cluster1 mirror mirror pool info 2021-11-18T19:42:15.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo 2021-11-18T19:42:15.922 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo 'cluster1 mirror mirror pool info' 2021-11-18T19:42:15.923 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' mirror pool info 2021-11-18T20:32:15.903 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: couldn't connect to the cluster! 2021-11-18T20:32:15.931 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: 2021-11-18T20:32:15.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout:cluster1 mirror mirror pool status 2021-11-18T20:32:15.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo 2021-11-18T20:32:15.932 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo 'cluster1 mirror mirror pool status' 2021-11-18T20:32:15.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ CEPH_ARGS= 2021-11-18T20:32:15.933 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ rbd --cluster cluster1 -p mirror --namespace '' mirror pool status --verbose 2021-11-18T21:22:15.929 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:rbd: couldn't connect to the cluster! 2021-11-18T21:22:15.945 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stdout: 2021-11-18T21:22:15.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:++ echo 2021-11-18T21:22:15.946 INFO:tasks.workunit.cluster1.client.mirror.gibba019.stderr:+++ rbd --cluster cluster1 -p mirror --namespace '' ls 2021-11-18T22:11:17.644 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2021-11-18T22:11:17.679 DEBUG:teuthology.task.console_log:Killing console logger for gibba005 2021-11-18T22:11:17.680 DEBUG:teuthology.task.console_log:Killing console logger for gibba019 2021-11-18T22:11:17.680 DEBUG:teuthology.exit:Finished running handlers